00000100:00100000:3.0:1790771164.913577:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2398:x1877759533501184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.913611:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.913628:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f07f8c lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e58 expref: 110 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.913702:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f07f8c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e58 expref: 110 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.913775:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4a:0x0].0x0 (ffff8bfc310f2200) 00010000:00010000:3.0:1790771164.913791:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f08295 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.913836:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f08295 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.913882:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f08295 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.913940:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.913974:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2398:x1877759533501184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 401us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.913986:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1365 00000100:00100000:3.0:1790771164.914095:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539676160:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771164.914135:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.914163:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759533483392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 50068us (50510us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.914194:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1350 00000100:00100000:3.0:1790771164.914335:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533500416 00000100:00100000:3.0:1790771164.914344:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533500416 00000100:00100000:3.0:1790771164.914395:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533500928 00000100:00100000:3.0:1790771164.914400:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533500928 00000100:00100000:3.0:1790771164.914442:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533496576 00000100:00100000:3.0:1790771164.914447:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533496576 00000100:00100000:3.0:1790771164.914482:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4902 00000100:00100000:3.0:1790771164.914569:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:13975:x1877759533500416:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771164.914601:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.914620:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08574 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3400a expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914732:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914782:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914829:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914847:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914890:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.914938:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915054:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915094:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915121:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.915192:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x39:0x0]: returning size 0 00000004:00200000:3.0:1790771164.915201:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.915579:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915604:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915645:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915657:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915705:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915724:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.915736:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915757:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915798:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771164.915810:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.915816:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915827:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08582 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915865:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915872:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915881:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915888:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.915897:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915935:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.915986:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x61bf1dfb (ffff8bfc20109900) 00010000:00010000:3.0:1790771164.916003:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.916015:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916073:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f08597 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916170:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08574 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3400a expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916208:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f085b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3400a expref: 140 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916237:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x39:0x0].0x0 (ffff8bfc29009d00) 00010000:00010000:3.0:1790771164.916241:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771164.916248:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00000100:00100000:3.0:1790771164.916288:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533501696 00000100:00100000:3.0:1790771164.916296:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533501696 00010000:00010000:3.0:1790771164.916335:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a000/0xfa0c505d97f082b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f23 expref: 106 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.916398:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533501952 00000100:00100000:3.0:1790771164.916409:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533501952 00010000:00010000:3.0:1790771164.916458:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0801f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e97 expref: 61 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.916569:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1369 00000100:00100000:3.0:1790771164.916597:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:2398:x1877759533501952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.916615:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.916630:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0801f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e97 expref: 62 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916686:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0801f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e97 expref: 62 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916721:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0801f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e97 expref: 62 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916741:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771164.916755:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f08398 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916778:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f08398 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.916797:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.916839:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:2398:x1877759533501952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 246us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.916870:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1369 00000100:00100000:3.0:1790771164.916906:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533502464 00000100:00100000:3.0:1790771164.916914:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533502464 00010000:00010000:3.0:1790771164.916939:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f06daa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33973 expref: 107 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.916987:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1370 00000100:00100000:3.0:1790771164.917017:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2398:x1877759533502464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.917043:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.917062:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f06daa lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33973 expref: 107 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.917096:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f06daa lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33973 expref: 107 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.917143:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f06daa lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33973 expref: 108 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.917200:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f2100) 00010000:00010000:3.0:1790771164.917218:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0839f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.917268:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0839f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.917278:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.917306:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2398:x1877759533502464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 306us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.917349:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1370 00000100:00100000:3.0:1790771164.917472:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:13975:x1877759533500416:12345-192.168.204.50@tcp:101:rm.0 Request processed in 2919us (4459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.917553:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4902 00000100:00100000:3.0:1790771164.917732:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.917803:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.917869:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.917971:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918057:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918150:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918225:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918295:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918449:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918614:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.918740:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533496832 00000100:00100000:3.0:1790771164.918747:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533496832 00000100:00100000:3.0:1790771164.918803:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533506304 00000100:00100000:3.0:1790771164.918812:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533506304 00000100:00100000:3.0:1790771164.918838:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4911 00000100:00100000:3.0:1790771164.918852:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:12083:x1877759533496832:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771164.918864:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.918884:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f08607 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e33fcb expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.918972:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.918986:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f08463 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919001:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 4/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919017:0:13770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f08463 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919065:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.919176:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.919247:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.919288:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533497984 00000100:00100000:3.0:1790771164.919295:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533497984 00000100:00100000:3.0:1790771164.919326:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533497216 00000100:00100000:3.0:1790771164.919335:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533497216 00000100:00100000:3.0:1790771164.919391:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4914 00000100:00100000:3.0:1790771164.919418:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14156:x1877759533497216:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771164.919447:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.919469:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f08623 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e33fd9 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919600:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919644:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919703:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919765:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919775:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919813:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919904:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919952:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.919999:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.920088:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x56:0x0]: returning size 5 00000004:00200000:3.0:1790771164.920099:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.920118:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920170:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920220:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920261:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920317:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920372:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920417:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.920430:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920473:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920592:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771164.920598:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.920603:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920613:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f08631 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920664:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920719:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920758:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920791:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.920801:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920836:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920884:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc20109a00) 00010000:00010000:3.0:1790771164.920894:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.920902:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.920953:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08646 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921042:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f08623 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fd9 expref: 111 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921140:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fd9 expref: 111 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921198:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:3.0:1790771164.921221:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1790771164.921237:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1000, rc 0) 00000100:00100000:3.0:1790771164.921284:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14156:x1877759533497216:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1868us (2044us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.921318:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4914 00000100:00100000:3.0:1790771164.921355:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533507072 00000100:00100000:3.0:1790771164.921366:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533507072 00000100:00100000:3.0:1790771164.921435:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533507968 00000100:00100000:3.0:1790771164.921441:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533507968 00000100:00100000:3.0:1790771164.921536:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533508224 00000100:00100000:3.0:1790771164.921545:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533508224 00000100:00100000:3.0:1790771164.921596:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4919 00000100:00100000:3.0:1790771164.921615:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:13985:x1877759533508224:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771164.921643:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.921661:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0868c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3405e expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921892:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08693 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921904:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08693 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921912:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08693 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921937:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0869a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921962:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0869a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.921988:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0869a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.922069:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533508864 00000100:00100000:3.0:1790771164.922079:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533508864 00010000:00010000:3.0:1790771164.922107:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f080b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e43 expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.922150:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1374 00000100:00100000:3.0:1790771164.922170:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533508864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.922199:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.922213:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f080b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e43 expref: 112 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922248:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f080b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e43 expref: 112 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922301:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f080b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e43 expref: 112 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922359:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771164.922377:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f08398 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922434:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f08398 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922531:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f08398 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922574:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.922614:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2397:x1877759533508864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 443us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.922626:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1374 00000100:00100000:3.0:1790771164.922662:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533509120 00000100:00100000:3.0:1790771164.922667:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533509120 00000100:00100000:3.0:1790771164.922752:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 652 00000100:00100000:3.0:1790771164.922768:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2399:x1877759533509120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.922790:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.922812:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f08519 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fbd expref: 112 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.922936:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:3.0:1790771164.922944:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.923003:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2399:x1877759533509120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 238us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.923015:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 652 00000100:00100000:3.0:1790771164.927664:0:7434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f918700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7434:1877759539679232:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771164.927709:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.927812:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2398:x1877759533498368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 15283us (15545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.927835:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1362 00000100:00100000:3.0:1790771164.928112:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539679616:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771164.928170:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df6e0c57/0xfa0c505d97f085dd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3401f expref: 22 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.928217:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df6e0c57/0xfa0c505d97f085dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3401f expref: 22 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.928288:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82600, rc 0) 00000020:00080000:3.0:1790771164.928349:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 39 committed batchid 38 00000020:00080000:3.0:1790771164.928400:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 38 00000100:00100000:3.0:1790771164.937481:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.937667:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533504128 00000100:00100000:3.0:1790771164.937678:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533504128 00000100:00100000:3.0:1790771164.937767:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4925 00000100:00100000:3.0:1790771164.937795:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14277:x1877759533511936:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771164.937816:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.937831:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f08703 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34096 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.937956:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.937995:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938070:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938120:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938163:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938182:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.938227:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771164.938242:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938288:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938305:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938420:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.938430:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938479:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938566:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771164.938571:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.938584:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938632:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f08711 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938709:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938747:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938789:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938801:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.938808:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938843:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.938892:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc20109a00) 00010000:00010000:3.0:1790771164.938912:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.938928:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.939019:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0871f lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.939104:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f08703 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34096 expref: 110 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.939157:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771164.939173:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.939190:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f08703 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34096 expref: 110 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.939249:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56000, rc 0) 00000100:00100000:3.0:1790771164.939302:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14277:x1877759533511936:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1509us (1823us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771164.939317:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4925 00000100:00100000:3.0:1790771164.939463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.939705:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.939782:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.939884:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.939946:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.940012:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.940096:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.940152:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.940188:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533515392 00000100:00100000:3.0:1790771164.940197:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533515392 00000100:00100000:3.0:1790771164.940247:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4934 00000100:00100000:3.0:1790771164.940277:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14242:x1877759533515392:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771164.940293:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.940313:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f08788 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e340c7 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940375:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08796 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940388:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08796 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940433:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08796 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.940583:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771164.940591:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.940674:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08796 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940781:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f08788 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340c7 expref: 112 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940852:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f08796 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340c7 expref: 112 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.940872:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771164.940887:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771164.940893:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00000100:00100000:3.0:1790771164.940934:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14242:x1877759533515392:12345-192.168.204.50@tcp:101:cp.0 Request processed in 662us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.940980:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4934 00000100:00100000:3.0:1790771164.941084:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.941203:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.941327:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11377c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12083:x1877759533512576:12345-192.168.204.50@tcp:37:ls.0 Request processed in 3536us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.941337:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1233 00010000:00010000:3.0:1790771164.941473:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f08615 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.941562:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f08615 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.942003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.942046:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.942072:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533513600 00000100:00100000:3.0:1790771164.942079:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533513600 00000100:00100000:3.0:1790771164.942132:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 653 00000100:00100000:3.0:1790771164.942162:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2398:x1877759533513600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.942188:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.942283:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0864d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fe0 expref: 114 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.942323:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771164.942338:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.942377:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2398:x1877759533513600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.942390:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 653 00000100:00100000:3.0:1790771164.942809:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533511680 00000100:00100000:3.0:1790771164.942816:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533511680 00010000:00010000:3.0:1790771164.942843:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f07bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ce5 expref: 144 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.942887:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1379 00000100:00100000:3.0:1790771164.942915:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533511424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.942940:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.942956:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b01cbe37/0xfa0c505d97f076be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b95 expref: 23 pid: 13793 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943003:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b01cbe37/0xfa0c505d97f076be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b95 expref: 23 pid: 13793 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943074:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01cbe37/0xfa0c505d97f076be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b95 expref: 23 pid: 13793 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943139:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(5 1) 00010000:00010000:3.0:1790771164.943155:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(5 1) 00010000:00010000:3.0:1790771164.943181:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943252:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943320:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.943371:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03022a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9499:1877759539681152:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771164.943458:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771164.943517:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533513344 00000100:00100000:3.0:1790771164.943522:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533513344 00010000:00010000:3.0:1790771164.943549:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0852e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fb6 expref: 113 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.943599:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1382 00000100:00100000:3.0:1790771164.943626:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2398:x1877759533513344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.943640:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.943647:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0852e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fb6 expref: 115 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943661:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0852e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fb6 expref: 115 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943729:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0852e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fb6 expref: 114 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943815:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771164.943857:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f08685 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943885:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f08685 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943910:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f08685 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.943973:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.944016:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2398:x1877759533513344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 398us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.944056:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1382 00000100:00100000:3.0:1790771164.944159:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539681408:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1790771164.944226:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771164.944302:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539681408 00000100:00100000:3.0:1790771164.944311:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539681408 00000100:00100000:3.0:1790771164.944373:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1790771164.944385:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3627:x1877759539681408:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1790771164.944413:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.944442:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0809d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x391d5834 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0805e expref: 11 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.944464:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x391d5834 (ffff8bfc20109e00) 00010000:00010000:3.0:1790771164.944545:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.944664:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3627:x1877759539681408:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 274us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.944718:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1790771164.944784:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539681408:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:3.0:1790771164.946066:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968937 is committed 00000001:00080000:3.0:1790771164.946079:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968936 is committed 00000020:00080000:3.0:1790771164.946091:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 39 batchid updated 00000001:00080000:3.0:1790771164.946147:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968916 is committed 00000100:00100000:3.0:1790771164.946430:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539681792 00000100:00100000:3.0:1790771164.946442:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539681792 00000040:00080000:3.0:1790771164.946663:0:12128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].31, 552 off58056 00000004:00080000:3.0:1790771164.946681:0:12128:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb0668c300 with version 64 00000004:00010000:3.0:1790771164.947136:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024069fe2 reply state 00000000468f0fbf transno 4294968937 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0839f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947153:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0839f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947162:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f2100) 00010000:00010000:3.0:1790771164.947165:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771164.947167:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771164.947173:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c38c00/0xfa0c505d97f08654 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f08669 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947180:0:12128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c38c00/0xfa0c505d97f08654 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f08669 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771164.947188:0:12128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000004:00010000:3.0:1790771164.947195:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024069fe2 reply state 00000000468f0fbf transno 4294968937 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f08176 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947202:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f08176 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947206:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:3.0:1790771164.947207:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771164.947210:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947216:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947220:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947225:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.947229:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.947248:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1790771164.947253:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00080000:3.0:1790771164.947297:0:12128:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771164.947315:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13967:x1877759533482240:12345-192.168.204.50@tcp:36:chown.0 Request processed in 89496us (89692us total) trans 4294968937 rc 0/0 00000100:00100000:3.0:1790771164.947324:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4851 00000100:00100000:3.0:1790771164.950563:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.950798:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.950839:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.950904:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.951052:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.951246:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.951387:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.951852:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.951968:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952065:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952529:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952744:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952860:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.952957:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.953000:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533520256 00000100:00100000:3.0:1790771164.953006:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533520256 00000100:00100000:3.0:1790771164.953058:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4948 00000100:00100000:3.0:1790771164.953077:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:14090:x1877759533520256:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771164.953217:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:14090:x1877759533520256:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 144us (267us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771164.953248:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4948 00000100:00100000:3.0:1790771164.956729:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.956765:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.956808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.956878:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.956914:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533520768 00000100:00100000:3.0:1790771164.956926:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533520768 00010000:00010000:3.0:1790771164.956959:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ef2 expref: 110 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.957031:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533520896 00000100:00100000:3.0:1790771164.957040:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533520896 00000100:00100000:3.0:1790771164.957081:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1384 00000100:00100000:3.0:1790771164.957096:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2399:x1877759533520768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771164.957124:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.957142:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ef2 expref: 112 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957209:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ef2 expref: 111 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957273:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0826b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ef2 expref: 112 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957349:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:3.0:1790771164.957355:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957368:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957388:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957437:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957469:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957570:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.957630:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2399:x1877759533520768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 529us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.957670:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1384 00010000:00010000:3.0:1790771164.957781:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957811:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f08272 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957901:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f088d1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957925:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f088ae lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3410d expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957936:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f088d1 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.957998:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f088ae lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3410d expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.958032:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f088ae lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3410d expref: 107 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.958105:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539682432:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.958201:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771164.958239:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4954 00000100:00100000:3.0:1790771164.958261:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13630:x1877759533521408:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:3.0:1790771164.958308:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790771164.958342:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f07de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d78 expref: 116 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.958404:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f07db0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d71 expref: 115 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.958432:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771164.958438:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.958600:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13630:x1877759533521408:12345-192.168.204.50@tcp:36:ln.0 Request processed in 344us (1019us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771164.958615:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4954 00000100:00100000:3.0:1790771164.958711:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03022a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9499:1877759539681152:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771164.958739:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771164.958774:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2398:x1877759533511424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 15871us (16063us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.958785:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1379 00000100:00100000:3.0:1790771164.969054:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533522560 00000100:00100000:3.0:1790771164.969062:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533522560 00000100:00100000:3.0:1790771164.969099:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4955 00000100:00100000:3.0:1790771164.969106:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13269:x1877759533522560:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771164.969124:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.969136:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f088df lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34114 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.969183:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.969192:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f08845 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.969198:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.969209:0:6494:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f08845 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.969215:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.974703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.974891:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.974956:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.975008:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533522048 00000100:00100000:3.0:1790771164.975016:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533522048 00000100:00100000:3.0:1790771164.975132:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4960 00000100:00100000:3.0:1790771164.975164:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:12080:x1877759533522048:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771164.975200:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.975216:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0892c lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e340ab expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.975375:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f08933 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.975413:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f08933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.975436:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f08933 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.975472:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771164.975637:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0892c lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340ab expref: 113 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.975656:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f08933 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340ab expref: 112 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.975702:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:3.0:1790771164.975723:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771164.975742:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00000100:00100000:3.0:1790771164.975790:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:12080:x1877759533522048:12345-192.168.204.50@tcp:101:ls.0 Request processed in 633us (907us total) trans 4294968945 rc 0/0 00000100:00100000:3.0:1790771164.975833:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4960 00000100:00100000:3.0:1790771164.975871:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4964 00000100:00100000:3.0:1790771164.975891:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13057:x1877759533523456:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771164.975914:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.975941:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f08972 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34122 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976048:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976065:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976120:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976187:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976201:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976225:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976318:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f089b1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976343:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f089b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976388:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f089b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.976466:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:3.0:1790771164.976472:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.976560:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f089b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976612:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976658:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976680:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976737:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.976749:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976802:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976851:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771164.976859:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.976871:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976918:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0898e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.976968:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977023:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977070:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977096:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.977109:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977162:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977225:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf7a5b27a (ffff8bfc08974800) 00010000:00010000:3.0:1790771164.977240:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.977253:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977279:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0899c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977355:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f08972 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34122 expref: 55 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977397:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f089b1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34122 expref: 55 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977458:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771164.977476:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771164.977533:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2a00, rc 0) 00000100:00100000:3.0:1790771164.977590:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:13057:x1877759533523456:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 1700us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.977636:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4964 00000100:00100000:3.0:1790771164.977672:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4969 00000100:00100000:3.0:1790771164.977709:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:14329:x1877759533524224:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771164.977737:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.977752:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f089f7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3414c expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977838:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977889:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977912:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.977960:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978135:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978159:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978249:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978292:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978306:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.978361:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 18230 00000004:00200000:3.0:1790771164.978368:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771164.978397:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533514240 00000100:00100000:3.0:1790771164.978408:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533514240 00000100:00100000:3.0:1790771164.978541:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:3.0:1790771164.978565:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533514240:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771164.978597:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.978618:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f430b34d/0xfa0c505d97f08a44 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e340b2 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.978720:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539682944:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771164.978768:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc085653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771164.978814:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4973 00000100:00100000:3.0:1790771164.978843:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13262:x1877759533526016:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771164.978868:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.978883:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f08a4b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34199 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.978993:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979033:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979041:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771164.979112:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x59/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979159:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979199:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979230:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979245:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979267:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.979278:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979293:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979309:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771164.979318:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.979325:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979340:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f08a05 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979355:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979362:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979387:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979395:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.979399:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979409:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979423:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc08974700) 00010000:00010000:3.0:1790771164.979442:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.979448:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979462:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f08a0c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979581:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f089f7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3414c expref: 53 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979618:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x19/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3414c expref: 52 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979629:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771164.979631:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1790771164.979634:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02000, rc 0) 00000100:00100000:3.0:1790771164.979674:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:14329:x1877759533524224:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1984us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.979717:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4969 00000100:00100000:3.0:1790771164.979752:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4978 00000100:00100000:3.0:1790771164.979768:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14233:x1877759533517696:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771164.979793:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.979805:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08a91 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e340dc expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979895:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979940:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.979970:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.980018:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x56:0x0]: returning size 5 00000004:00200000:3.0:1790771164.980030:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.980053:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980093:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980113:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f08a91 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340dc expref: 115 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980172:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340dc expref: 114 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980222:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:3.0:1790771164.980239:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771164.980248:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487e600, rc 0) 00000100:00100000:3.0:1790771164.980286:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14233:x1877759533517696:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 521us (2130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.980296:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4978 00000100:00100000:3.0:1790771164.980812:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4980 00000100:00100000:3.0:1790771164.980832:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14287:x1877759533528064:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771164.980846:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771164.980867:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e400/0xfa0c505d97f08ac2 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e341df expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980921:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e400/0xfa0c505d97f08ac2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e341df expref: 106 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.980955:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e400/0xfa0c505d97f08ac2 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e341df expref: 106 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981045:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771164.981063:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771164.981080:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487e400, rc 0) 00000100:00100000:3.0:1790771164.981119:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14287:x1877759533528064:12345-192.168.204.50@tcp:101:cp.0 Request processed in 283us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.981164:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4980 00000100:00100000:3.0:1790771164.981221:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4983 00000100:00100000:3.0:1790771164.981249:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:14263:x1877759533529600:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771164.981304:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981334:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f07e6d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e35 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981407:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 105 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981453:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981569:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 105 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981632:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 105 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.981773:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539683072:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.981889:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f07e6d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e35 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.981915:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f07e6d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e35 expref: 53 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.981958:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539683328:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.981997:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d235e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771164.982072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.982090:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533530880 00000100:00100000:3.0:1790771164.982094:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533530880 00000100:00100000:3.0:1790771164.982149:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4985 00000100:00100000:3.0:1790771164.982166:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14375:x1877759533530880:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1790771164.982198:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790771164.982225:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0833d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f4d expref: 126 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982267:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f074bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a61 expref: 125 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982303:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0286e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f5d expref: 124 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982365:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:3.0:1790771164.982378:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771164.982402:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982441:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f06370 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e333a7 expref: 115 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982454:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0873b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3402d expref: 115 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982529:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.982578:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539682432:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.982612:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f088d1 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982663:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0873b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3402d expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982719:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0873b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3402d expref: 114 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.982742:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539683456:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.982846:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f06370 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e333a7 expref: 113 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.982912:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f06370 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e333a7 expref: 113 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.982956:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539683584:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.982998:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771164.983038:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533531520 00000100:00100000:3.0:1790771164.983052:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533531520 00000100:00100000:3.0:1790771164.983096:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533531776 00000100:00100000:3.0:1790771164.983107:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533531776 00000100:00100000:3.0:1790771164.983136:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533531904 00000100:00100000:3.0:1790771164.983148:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533531904 00000100:00100000:3.0:1790771164.983190:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4986 00000100:00100000:3.0:1790771164.983215:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13895:x1877759533531520:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:3.0:1790771164.983320:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13895:x1877759533531520:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 105us (669us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771164.983357:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4986 00010000:00010000:3.0:1790771164.983410:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f088d1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.983456:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f088d1 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.983566:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83800/0xfa0c505d97f08b24 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.983613:0:13767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83800/0xfa0c505d97f08b24 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x0 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.983663:0:13767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83800/0xfa0c505d97f08b24 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.983759:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000-mdtlov_UUID:13767:1877759539683840:0@lo:101:mdt00_012.0 00000100:00100000:3.0:1790771164.983818:0:13767:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771164.983863:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7780 going to sleep for 11 seconds 00010000:00010000:3.0:1790771164.983907:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.983949:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.984004:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1790771164.984017:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771164.984039:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984103:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f08a4b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34199 expref: 124 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984175:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f08a52 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34199 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984241:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc310f2a00) 00010000:00010000:3.0:1790771164.984258:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771164.984271:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0400, rc 0) 00000100:00100000:3.0:1790771164.984317:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13262:x1877759533526016:12345-192.168.204.50@tcp:101:ls.0 Request processed in 5480us (6342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771164.984354:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4973 00010000:00010000:3.0:1790771164.984404:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984482:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984594:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984640:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984686:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771164.984781:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:3.0:1790771164.984829:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984844:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984888:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984904:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984931:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.984937:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.984985:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985005:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc310f2a00) 00010000:00010000:3.0:1790771164.985020:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.985032:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985061:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f088e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985093:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985115:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985152:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985176:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.985283:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985294:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985308:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc08974800) 00010000:00010000:3.0:1790771164.985313:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.985555:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985564:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b55 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985626:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f088df lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34114 expref: 120 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985725:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc310f2a00) 00010000:00010000:3.0:1790771164.985728:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771164.985736:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f088df lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34114 expref: 120 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.985823:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56200, rc 0) 00000100:00100000:3.0:1790771164.985929:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13269:x1877759533522560:12345-192.168.204.50@tcp:101:ls.0 Request processed in 16818us (16910us total) trans 4294968949 rc 301/301 00000100:00100000:3.0:1790771164.985936:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4955 00010000:00010000:3.0:1790771164.986957:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987003:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987047:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987095:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.987104:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987163:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987230:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771164.987255:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771164.987279:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987327:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f088a7 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987377:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987426:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987475:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987545:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.987553:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987562:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987580:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x1d91fb2c (ffff8bfb03146b00) 00010000:00010000:3.0:1790771164.987585:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.987589:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987603:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f088ca lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987673:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987680:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987686:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987707:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.987711:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987717:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987760:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:3.0:1790771164.987769:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.987773:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987788:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f088d8 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987813:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987817:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987861:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987866:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.987869:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987873:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987879:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xd870248a (ffff8bfc19631400) 00010000:00010000:3.0:1790771164.987880:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.987882:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987886:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08964 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987898:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987903:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987907:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987910:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771164.987912:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987915:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987920:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771164.987921:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771164.987923:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.987928:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f08b40 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.990360:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 4994 00000100:00100000:3.0:1790771164.990587:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13858:x1877759533533440:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1790771164.990811:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771164.990833:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f08662 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fd9 expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.990855:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:3.0:1790771164.990860:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771164.990891:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.990906:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f04d6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bab expref: 119 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.990980:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0748e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a8b expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991004:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f088bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340e3 expref: 113 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991014:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f08a36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340ea expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991076:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340dc expref: 113 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991087:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 8/0,1 mode: --/PW res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991121:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340dc expref: 113 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991139:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f08a98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340dc expref: 113 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.991173:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee0000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539684224:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.991323:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f08a36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340ea expref: 114 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991347:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f08a36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340ea expref: 113 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.991405:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539684352:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.991627:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f088bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340e3 expref: 112 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991685:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f088bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340e3 expref: 112 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.991739:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539684480:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.991820:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0748e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a8b expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991837:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0748e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a8b expref: 120 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.991869:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03021180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539684608:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.991918:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f04d6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bab expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.991968:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f04d6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bab expref: 120 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.991982:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03023800 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539684736:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.992016:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7600 going to sleep for 11 seconds 00010000:00010000:3.0:1790771164.992051:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0891e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.992102:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0891e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771164.992255:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533530240:12345-192.168.204.50@tcp:4:cp.0 Request processed in 10893us (11301us total) trans 4294967550 rc 0/0 00000100:00100000:3.0:1790771164.992296:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 320 00002000:00100000:3.0:1790771164.992323:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xd:0x0] (0->38335) req@ffff8bfb029c1880 x1877759533530240/t4294967550(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:265/0 lens 488/448 e 0 to 0 dl 1790771175 ref 1 fl Complete:/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771164.992407:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb029c1880 with x1877759533530240 ext(0->38335) 00002000:00010000:3.0:1790771164.992420:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb029c1880 00000100:00100000:3.0:1790771164.994738:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533525504 00000100:00100000:3.0:1790771164.994745:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533525504 00000100:00100000:3.0:1790771164.995248:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539682944:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771164.995297:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f430b34d/0xfa0c505d97f08a44 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b2 expref: 28 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.995368:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f430b34d/0xfa0c505d97f08a44 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b2 expref: 27 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771164.995421:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02600, rc 0) 00000100:00100000:3.0:1790771164.995461:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533514240:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 16902us (17100us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771164.995534:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:3.0:1790771164.995761:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771164.996001:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539683072:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.997171:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1180 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539683456:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771164.997205:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539683584:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771164.997232:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.003879:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.010217:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.010353:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.010396:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533538432 00000100:00100000:3.0:1790771165.010412:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533538432 00010000:00010000:3.0:1790771165.010744:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 103 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.010818:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1393 00000100:00100000:3.0:1790771165.010847:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2399:x1877759533538432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.010860:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.010875:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 104 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011000:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 104 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011073:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08391 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f70 expref: 104 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011132:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771165.011150:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011203:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011249:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.011297:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:2399:x1877759533538432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 455us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.011349:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1393 00010000:00010000:3.0:1790771165.011482:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.011643:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.013078:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb029c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539683200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.013114:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f08af3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.013217:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539683328:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.013283:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.013421:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968956 is committed 00000001:00080000:3.0:1790771165.013456:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294968955 is committed 00000004:00010000:3.0:1790771165.013802:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000adafbf0a reply state 000000001ecff643 transno 4294968956 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.013861:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.013872:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:3.0:1790771165.013877:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.013881:0:13768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f08dcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.013933:0:13768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f08dcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.013973:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f08dcb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.014041:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771165.014053:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00080000:3.0:1790771165.014109:0:13768:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771165.014142:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14375:x1877759533530880:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 31975us (32063us total) trans 4294968956 rc 0/0 00000100:00100000:3.0:1790771165.014187:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 4985 00010000:00010000:3.0:1790771165.014280:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014324:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014379:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014440:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.014451:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014473:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014602:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:3.0:1790771165.014618:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.014633:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.014669:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08b01 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.014770:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533541248 00000100:00100000:3.0:1790771165.014789:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533541248 00010000:00010000:3.0:1790771165.014854:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f089f0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34145 expref: 117 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.014936:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533540224 00000100:00100000:3.0:1790771165.014942:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533540224 00010000:00010000:3.0:1790771165.014970:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f08a60 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e341a0 expref: 118 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.015050:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1399 00000100:00100000:3.0:1790771165.015075:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2397:x1877759533539968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.015195:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.015252:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f08b39 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34217 expref: 104 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015272:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f08b39 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34217 expref: 104 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015312:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f08b39 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34217 expref: 104 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015361:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc3607db00) 00010000:00010000:3.0:1790771165.015385:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015449:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015549:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.015622:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.015647:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8425:1877759539685888:0@lo:105: 00000100:00100000:3.0:1790771165.015739:0:8425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.015839:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d235e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.015879:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533537664 00000100:00100000:3.0:1790771165.015888:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533537664 00000100:00100000:3.0:1790771165.016055:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5025 00000100:00100000:3.0:1790771165.016084:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:11971:x1877759533537664:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.016097:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.016117:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f08e1f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34264 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.016236:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f08e26 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.016253:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f08e26 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.016286:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f08e26 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.016296:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.016402:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f08e1f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34264 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.016438:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f08e26 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34264 expref: 67 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.016448:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.016456:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.016466:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82e00, rc 0) 00000100:00100000:3.0:1790771165.016580:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:11971:x1877759533537664:12345-192.168.204.50@tcp:101:ls.0 Request processed in 490us (892us total) trans 4294968433 rc 0/0 00000100:00100000:3.0:1790771165.016598:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5025 00000100:00100000:3.0:1790771165.016646:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533528320 00000100:00100000:3.0:1790771165.016654:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533528320 00000100:00100000:3.0:1790771165.016703:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533543296 00000100:00100000:3.0:1790771165.016710:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533543296 00000100:00100000:3.0:1790771165.016777:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533544192 00000100:00100000:3.0:1790771165.016783:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533544192 00000100:00100000:3.0:1790771165.016898:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533544448 00000100:00100000:3.0:1790771165.016903:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533544448 00000100:00100000:3.0:1790771165.016941:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533544960 00000100:00100000:3.0:1790771165.016946:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533544960 00000100:00100000:3.0:1790771165.016998:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533534080 00000100:00100000:3.0:1790771165.017005:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533534080 00000100:00100000:3.0:1790771165.017053:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533536768 00000100:00100000:3.0:1790771165.017063:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533536768 00000100:00100000:3.0:1790771165.017114:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533545984 00000100:00100000:3.0:1790771165.017121:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533545984 00000100:00100000:3.0:1790771165.017216:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5028 00000100:00100000:3.0:1790771165.017244:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14330:x1877759533544192:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:3.0:1790771165.017338:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14330:x1877759533544192:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 103us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.017379:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5028 00000100:00100000:3.0:1790771165.017419:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5029 00000100:00100000:3.0:1790771165.017447:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:10945:x1877759533544448:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771165.017478:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.017530:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83a00/0xfa0c505d97f08e57 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3431a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.017577:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83a00/0xfa0c505d97f08e57 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x50:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3431a expref: 105 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.017597:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83a00/0xfa0c505d97f08e57 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x50:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3431a expref: 105 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.017643:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x50:0x0].0x0 (ffff8bfc36078b00) 00010000:00010000:3.0:1790771165.017653:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771165.017663:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83a00, rc 0) 00000100:00100000:3.0:1790771165.017728:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:10945:x1877759533544448:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 286us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.017834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5029 00000100:00100000:3.0:1790771165.018021:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533539584 00000100:00100000:3.0:1790771165.018030:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533539584 00000100:00100000:3.0:1790771165.018064:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533546880 00000100:00100000:3.0:1790771165.018069:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533546880 00000100:00100000:3.0:1790771165.018098:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533547136 00000100:00100000:3.0:1790771165.018107:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533547136 00000100:00100000:3.0:1790771165.018150:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533544320 00000100:00100000:3.0:1790771165.018158:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533544320 00000100:00100000:3.0:1790771165.018273:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5032 00000100:00100000:3.0:1790771165.018292:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:13057:x1877759533534080:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771165.018363:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.018379:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f08e81 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34248 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.018412:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08e8f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.018430:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.018479:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08e8f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.018957:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f08e81 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34248 expref: 77 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.019025:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f08e8f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34248 expref: 76 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.019101:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.019109:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.019119:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aee00, rc 0) 00000100:00100000:3.0:1790771165.019163:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:13057:x1877759533534080:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 874us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.019184:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5032 00000100:00100000:3.0:1790771165.019209:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533544576 00000100:00100000:3.0:1790771165.019214:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533544576 00000100:00100000:3.0:1790771165.019248:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533547904 00000100:00100000:3.0:1790771165.019252:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533547904 00000100:00100000:3.0:1790771165.019266:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533548032 00000100:00100000:3.0:1790771165.019270:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533548032 00000100:00100000:3.0:1790771165.019283:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533548288 00000100:00100000:3.0:1790771165.019289:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533548288 00000100:00100000:3.0:1790771165.019308:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533538560 00000100:00100000:3.0:1790771165.019314:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533538560 00000100:00100000:3.0:1790771165.019338:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533534464 00000100:00100000:3.0:1790771165.019344:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533534464 00000100:00100000:3.0:1790771165.019395:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5034 00000100:00100000:3.0:1790771165.019425:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13551:x1877759533545984:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.019456:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.019474:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f08e9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3432f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.019602:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001_UUID:8425:1877759539685888:0@lo:105: 00010000:00010000:3.0:1790771165.019659:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.019714:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2397:x1877759533539968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 4620us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.019760:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1399 00010000:00010000:3.0:1790771165.019971:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.019985:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.019996:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.020070:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5037 00000100:00100000:3.0:1790771165.020094:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13969:x1877759533547136:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1790771165.020134:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.020167:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f997e00/0xfa0c505d97f089e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3413e expref: 72 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020289:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771165.020302:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.020325:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020446:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f08c4a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34192 expref: 74 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020557:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f08e73 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342a3 expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020608:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 5/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.020709:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5042 00000100:00100000:3.0:1790771165.020735:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13677:x1877759533548288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.020761:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.020775:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38200/0xfa0c505d97f08f1b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34359 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020864:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020956:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.020997:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.021054:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.021062:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.021087:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021159:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38200/0xfa0c505d97f08f1b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 108 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021225:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 107 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021291:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb0321e000) 00010000:00010000:3.0:1790771165.021309:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.021317:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00000100:00100000:3.0:1790771165.021358:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13677:x1877759533548288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 625us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.021400:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5042 00000100:00100000:3.0:1790771165.021443:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5044 00000100:00100000:3.0:1790771165.021467:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:11335:x1877759533534464:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771165.021527:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.021543:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f08f3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34256 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021606:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021642:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021653:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021752:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f08f3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 127 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021789:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 125 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.021838:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:3.0:1790771165.021853:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.021860:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39e00, rc 0) 00000100:00100000:3.0:1790771165.021893:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:11335:x1877759533534464:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 430us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.021936:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5044 00010000:00010000:3.0:1790771165.021983:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f08e73 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342a3 expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022041:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f08e73 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342a3 expref: 74 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.022173:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539686016:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.022378:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f08c4a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34192 expref: 74 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022411:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f08c4a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34192 expref: 74 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.022470:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539686272:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.022603:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc192d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.022625:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533548800 00000100:00100000:3.0:1790771165.022630:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533548800 00000100:00100000:3.0:1790771165.022666:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5045 00000100:00100000:3.0:1790771165.022711:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:11011:x1877759533548800:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771165.022743:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.022764:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0400/0xfa0c505d97f08f53 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34360 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022811:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08f5a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022846:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08f5a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022878:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08f5a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.022996:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0400/0xfa0c505d97f08f53 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34360 expref: 109 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.023036:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f08f5a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34360 expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.023060:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771165.023066:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.023075:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1c00, rc 0) 00000100:00100000:3.0:1790771165.023112:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:11011:x1877759533548800:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 421us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.023151:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5045 00010000:00080000:3.0:1790771165.023305:0:13764:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771165.023325:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13580:x1877759533542656:12345-192.168.204.50@tcp:36:cp.0 Request processed in 7400us (8706us total) trans 4294968959 rc 0/0 00000100:00100000:3.0:1790771165.023337:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5024 00000100:00100000:3.0:1790771165.029106:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533546624 00000100:00100000:3.0:1790771165.029115:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533546624 00000100:00100000:3.0:1790771165.029183:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5047 00000100:00100000:3.0:1790771165.029206:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14323:x1877759533546624:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.029232:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.029248:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f08f76 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34272 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.029351:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f08f84 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.029372:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.029422:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f08f84 lrc: 4/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.029472:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f08b4e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa0c505d97f08b24 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.029565:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539686784:0@lo:104: 00000100:00100000:3.0:1790771165.029623:0:12128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.029685:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc105a7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.029788:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.029928:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539686784:0@lo:104: 00010000:00010000:3.0:1790771165.030000:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f08f84 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.030801:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533546752 00000100:00100000:3.0:1790771165.030809:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533546752 00000100:00100000:3.0:1790771165.030951:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.031877:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.031920:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.031964:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032012:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.032015:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032022:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032034:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:3.0:1790771165.032040:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.032050:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032090:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f08b9b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x56:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.032281:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533550976 00000100:00100000:3.0:1790771165.032291:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533550976 00010000:00010000:3.0:1790771165.032311:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032324:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032331:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032338:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.032344:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032350:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032373:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771165.032376:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.032380:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032385:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f08ae5 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032455:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032473:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032548:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032583:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ac00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.032591:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032640:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032707:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x50:0x0].0x0 (ffff8bfc36078b00) 00010000:00010000:3.0:1790771165.032712:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.032717:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032730:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ac00/0xfa0c505d97f08c66 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x50:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032825:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032869:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032897:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032909:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.032916:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032928:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.032956:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x1d91fb2c (ffff8bfc310f1f00) 00010000:00010000:3.0:1790771165.032960:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.032964:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.033001:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f08c9e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.043736:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.043953:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.044070:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533555712 00000100:00100000:3.0:1790771165.044083:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533555712 00000100:00100000:3.0:1790771165.044917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045169:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045238:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045321:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045443:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045630:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.045718:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046123:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046157:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046203:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046259:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539686016:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.046343:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539686272:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.046369:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.046443:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046610:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.046633:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533554176 00000100:00100000:3.0:1790771165.046639:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533554176 00000100:00100000:3.0:1790771165.046669:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533555200 00000100:00100000:3.0:1790771165.046672:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533555200 00000100:00100000:3.0:1790771165.046719:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5063 00000100:00100000:3.0:1790771165.046780:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13992:x1877759533554176:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:3.0:1790771165.046795:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.046809:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09087 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e343a6 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.046873:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.046896:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.046939:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047000:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047050:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047102:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047188:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047198:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047206:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.047253:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 22378 00000004:00200000:3.0:1790771165.047267:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.047290:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047301:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047323:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047333:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047354:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047396:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.047406:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047433:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047476:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.047516:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.047521:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047562:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0908e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047594:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047635:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047683:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047713:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.047720:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047729:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047775:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc2008df00) 00010000:00010000:3.0:1790771165.047783:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.047792:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047835:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0909c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047931:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09087 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e343a6 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.047961:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f090b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e343a6 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.048025:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:3.0:1790771165.048044:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.048057:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00000100:00100000:3.0:1790771165.048153:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533554816 00000100:00100000:3.0:1790771165.048159:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533554816 00010000:00010000:3.0:1790771165.048195:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f08c4a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34192 expref: 77 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.048283:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533554944 00000100:00100000:3.0:1790771165.048293:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533554944 00000100:00100000:3.0:1790771165.048460:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533555968 00000100:00100000:3.0:1790771165.048466:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533555968 00010000:00010000:3.0:1790771165.048590:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083c84111/0xfa0c505d97f08dfc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342b8 expref: 25 pid: 13782 timeout: 265 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.048726:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 673 00000100:00100000:3.0:1790771165.048762:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:2398:x1877759533555840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.048788:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.048811:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f08fca lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34287 expref: 75 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.048827:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.048834:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.048904:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2398:x1877759533555840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.048951:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 673 00000100:00100000:3.0:1790771165.049008:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533552000 00000100:00100000:3.0:1790771165.049017:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533552000 00002000:00010000:3.0:1790771165.049054:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/15 (0->18446744073709551615) 00002000:00100000:3.0:1790771165.049064:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aa300 with x1877759533552000 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771165.049076:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d8aa300. 00000100:00100000:3.0:1790771165.049114:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 324 00000100:00100000:3.0:1790771165.049128:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533552000:12345-192.168.204.50@tcp:10:dir_create.sh.0 00002000:00010000:3.0:1790771165.049296:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790771165.049309:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb mtime from disk: 0 -> 1790771165 00002000:00010000:3.0:1790771165.049317:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771165.049331:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb ctime from disk: 0 -> 1790771165 00002000:00010000:3.0:1790771165.049341:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xf:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790771165.049383:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533552000:12345-192.168.204.50@tcp:10:dir_create.sh.0 Request processed in 256us (1479us total) trans 4294967547 rc 0/0 00000100:00100000:3.0:1790771165.049427:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 324 00002000:00010000:3.0:1790771165.049440:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/15 (0->18446744073709551615) 00002000:00100000:3.0:1790771165.049454:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aa300 with x1877759533552000 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771165.049472:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d8aa300. 00000100:00100000:3.0:1790771165.049636:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533556736 00000100:00100000:3.0:1790771165.049643:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533556736 00000100:00100000:3.0:1790771165.049723:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5069 00000100:00100000:3.0:1790771165.049751:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14207:x1877759533556736:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1790771165.049807:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.049827:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f089c6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34129 expref: 72 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050024:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8bfc113f3e00) 00010000:00010000:3.0:1790771165.050033:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.050126:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38200/0xfa0c505d97f090f7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050139:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f07fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e6d expref: 106 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050160:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f09033 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3437c expref: 106 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050208:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38200/0xfa0c505d97f090f7 lrc: 5/0,1 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050272:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f09033 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3437c expref: 106 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050321:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f09033 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3437c expref: 106 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.050375:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04879880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539687808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.050479:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f07fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e6d expref: 106 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050604:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f07fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e6d expref: 106 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.050656:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04879f80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539688064:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.050742:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc105a7540 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.050803:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.050828:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.051017:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000034b40bd0 reply state 0000000009a46249 transno 4294968453 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.051053:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f08edc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.051073:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771165.051084:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.051094:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.051159:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:13969:x1877759533547136:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 31070us (33402us total) trans 4294968453 rc 0/0 00000100:00100000:3.0:1790771165.051202:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5037 00000100:00100000:3.0:1790771165.051250:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13992:x1877759533554176:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 4464us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.051290:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5063 00000100:00100000:3.0:1790771165.051403:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.051560:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.051656:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.051747:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.051809:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.051844:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533559552 00000100:00100000:3.0:1790771165.051855:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533559552 00000100:00100000:3.0:1790771165.051913:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5077 00000100:00100000:3.0:1790771165.051940:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13592:x1877759533559552:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771165.051978:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.052005:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f08f37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342d4 expref: 116 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.052038:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771165.052044:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.052079:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0914b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.052098:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0914b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.052109:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0914b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.052189:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000976849c2 reply state 000000000191f35d transno 4294968975 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0914b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.052205:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0914b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.052214:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771165.052217:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.052220:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.052279:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13592:x1877759533559552:12345-192.168.204.50@tcp:36:cp.0 Request processed in 348us (481us total) trans 4294968975 rc 0/0 00000100:00100000:3.0:1790771165.052292:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5077 00000100:00100000:3.0:1790771165.052539:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.053273:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533561088 00000100:00100000:3.0:1790771165.053281:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533561088 00000100:00100000:3.0:1790771165.053327:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533560960 00000100:00100000:3.0:1790771165.053333:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533560960 00010000:00010000:3.0:1790771165.053395:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7ab6876/0xfa0c505d97f00735 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31378 expref: 20 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.053448:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1410 00000100:00100000:3.0:1790771165.053465:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759533560960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.053476:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.053563:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7ab6876/0xfa0c505d97f00735 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31378 expref: 20 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.053579:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7ab6876/0xfa0c505d97f00735 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31378 expref: 20 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.053607:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7ab6876/0xfa0c505d97f00735 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31378 expref: 20 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.053628:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771165.053633:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771165.053639:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 19 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.053702:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 19 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.053817:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 19 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.053831:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1877759539688448:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771165.053911:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.053974:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 677 00000100:00100000:3.0:1790771165.053989:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2398:x1877759533561088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.054005:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.054029:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0905d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34391 expref: 107 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.054051:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb0321e000) 00010000:00010000:3.0:1790771165.054056:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.054086:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:2398:x1877759533561088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.054097:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 677 00000100:00100000:3.0:1790771165.054255:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533561472 00000100:00100000:3.0:1790771165.054262:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533561472 00000100:00100000:3.0:1790771165.054306:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1283 00000100:00100000:3.0:1790771165.054323:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11375c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:12076:x1877759533561472:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771165.054593:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11375c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:12076:x1877759533561472:12345-192.168.204.50@tcp:35:ls.0 Request processed in 271us (1465us total) trans 4294968978 rc 0/0 00000100:00100000:3.0:1790771165.054614:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1283 00000100:00100000:3.0:1790771165.054728:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533561984 00000100:00100000:3.0:1790771165.054736:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533561984 00000100:00100000:3.0:1790771165.054803:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533562368 00000100:00100000:3.0:1790771165.054812:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533562368 00010000:00010000:3.0:1790771165.055006:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771165.055020:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.055103:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:3.0:1790771165.055119:0:10373:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.055169:0:10373:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.055214:0:10373:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.055240:0:10373:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790771165.055281:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.055289:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb03c79400/0xfa0c505d97f09183 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f09191 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.055355:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.055360:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.055368:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790771165.055748:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533562496 00000100:00100000:3.0:1790771165.055754:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533562496 00000100:00100000:3.0:1790771165.055894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.056121:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.059551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.059576:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.059605:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.059678:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.059743:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533563648 00000100:00100000:3.0:1790771165.059755:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533563648 00000100:00100000:3.0:1790771165.059797:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5090 00000100:00100000:3.0:1790771165.059826:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14034:x1877759533563648:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.059952:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f09224 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.059970:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f09208 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3440f expref: 100 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.060015:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f09224 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.060047:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f09208 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3440f expref: 100 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.060139:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f09208 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3440f expref: 100 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.060173:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a10700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539688704:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.064125:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533564928 00000100:00100000:3.0:1790771165.064132:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533564928 00000100:00100000:3.0:1790771165.064203:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5093 00000100:00100000:3.0:1790771165.064228:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14323:x1877759533564928:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.064244:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.064256:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f09247 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e343d0 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.064328:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0925c lrc: 3/0,1 mode: --/EX res: [0x240000403:0x62:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.064340:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f08fd8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34272 expref: 77 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.064346:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0925c lrc: 4/0,1 mode: --/EX res: [0x240000403:0x62:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.064368:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f08fd8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34272 expref: 77 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.064375:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f08fd8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34272 expref: 77 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.064384:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539688832:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.064438:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.065780:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.065912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.066076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.066269:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.066396:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533565440 00000100:00100000:3.0:1790771165.066409:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533565440 00000100:00100000:3.0:1790771165.066464:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533565696 00000100:00100000:3.0:1790771165.066472:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533565696 00000100:00100000:3.0:1790771165.066612:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1286 00000100:00100000:3.0:1790771165.066634:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13580:x1877759533565440:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:3.0:1790771165.066910:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13580:x1877759533565440:12345-192.168.204.50@tcp:35:cp.0 Request processed in 275us (560us total) trans 4294968981 rc 0/0 00000100:00100000:3.0:1790771165.066960:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1286 00000100:00100000:3.0:1790771165.067004:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1287 00000100:00100000:3.0:1790771165.067025:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14287:x1877759533565696:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:3.0:1790771165.067196:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14287:x1877759533565696:12345-192.168.204.50@tcp:35:cp.0 Request processed in 174us (790us total) trans 4294968460 rc 0/0 00000100:00100000:3.0:1790771165.067232:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1287 00000100:00100000:3.0:1790771165.067391:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539687936:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.067429:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,1 mode: --/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.067566:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533566336 00000100:00100000:3.0:1790771165.067572:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533566336 00000100:00100000:3.0:1790771165.067749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.067790:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.067955:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.068026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.068204:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.068309:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.068385:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.068554:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.068635:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068644:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068816:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068834:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068893:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068903:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.068912:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068961:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068985:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4a:0x0].0x0 (ffff8bfc310f2200) 00010000:00010000:3.0:1790771165.068987:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.068991:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 2/0,0 mode: --/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.068997:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f090fe lrc: 0/0,0 mode: --/EX res: [0x240000403:0x4a:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.069051:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14343:x1877759533557632:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 18954us (19089us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771165.069060:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5071 00000100:00100000:3.0:1790771165.069561:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a10700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539688704:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.069602:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f09224 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.077763:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.077942:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5101 00000100:00100000:3.0:1790771165.077971:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13968:x1877759533568768:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771165.077986:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.078001:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f092f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34440 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078043:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078055:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078065:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078095:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078105:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078145:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078229:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078277:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078287:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.078328:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 5844 00000004:00200000:3.0:1790771165.078336:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.078357:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078401:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078445:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078475:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078539:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078568:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078638:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.078649:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078705:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078773:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.078788:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.078796:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078843:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f09304 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078927:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.078978:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079040:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079088:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.079111:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079155:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079246:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfc2008df00) 00010000:00010000:3.0:1790771165.079262:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.079274:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079320:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09319 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079471:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f092f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34440 expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079582:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0932e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34440 expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079630:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771165.079648:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.079655:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5a00, rc 0) 00000100:00100000:3.0:1790771165.079718:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13968:x1877759533568768:12345-192.168.204.50@tcp:101:rm.0 Request processed in 1753us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.079765:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5101 00000100:00100000:3.0:1790771165.079792:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5108 00000100:00100000:3.0:1790771165.079816:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14050:x1877759533570048:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.079834:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.079848:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f09389 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34471 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079894:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079945:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.079993:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080045:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080091:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080135:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080228:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080289:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080331:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.080398:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.080411:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.080435:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080707:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080749:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080764:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080839:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080921:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.080929:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.080980:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081029:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.081035:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.081043:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081085:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0939e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081152:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081199:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081245:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081295:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.081301:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081338:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081396:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc2008d000) 00010000:00010000:3.0:1790771165.081411:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.081418:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081430:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f093a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081523:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f09389 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081544:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081600:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771165.081619:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.081623:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4000, rc 0) 00000100:00100000:3.0:1790771165.081668:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533571328 00000100:00100000:3.0:1790771165.081678:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533571328 00000100:00100000:3.0:1790771165.081747:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5111 00000100:00100000:3.0:1790771165.081766:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14029:x1877759533571328:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.081827:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.081937:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.082003:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.082078:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.082140:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 120 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.082213:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539689088:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.082296:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94600 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.082330:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533568128 00000100:00100000:3.0:1790771165.082340:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533568128 00000100:00100000:3.0:1790771165.082392:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 804 00000100:00100000:3.0:1790771165.082417:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759533568128:12345-192.168.204.50@tcp:2:cp.0 00002000:00010000:3.0:1790771165.082596:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790771165.082600:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime from disk: 1790771165 -> 1674053537 00002000:00010000:3.0:1790771165.082610:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime from disk: 1790771163 -> 1752421453 00002000:00010000:3.0:1790771165.082613:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771165.082616:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1790771165.082656:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2398:x1877759533568128:12345-192.168.204.50@tcp:2:cp.0 Request processed in 242us (872us total) trans 4294967553 rc 0/0 00000100:00100000:3.0:1790771165.082707:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 804 00000100:00100000:3.0:1790771165.082786:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14050:x1877759533570048:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 2972us (3489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.082799:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5108 00000100:00100000:3.0:1790771165.082932:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.083052:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.083201:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.083271:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.083329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.084315:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14008:x1877759533566336:12345-192.168.204.50@tcp:37:ls.0 Request processed in 16633us (16836us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.084351:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1288 00000100:00100000:3.0:1790771165.084481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.084606:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.084636:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533575424 00000100:00100000:3.0:1790771165.084642:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533575424 00000100:00100000:3.0:1790771165.084704:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533575552 00000100:00100000:3.0:1790771165.084715:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533575552 00000100:00100000:3.0:1790771165.084758:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5115 00000100:00100000:3.0:1790771165.084783:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14271:x1877759533575424:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.084814:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.084833:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34519 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.084890:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.084951:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.084971:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085031:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085082:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085136:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085185:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085194:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085203:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.085278:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x85:0x0]: returning size 14756 00000004:00200000:3.0:1790771165.085289:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.085311:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085345:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085364:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085373:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085383:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085412:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085419:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.085423:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085437:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085617:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.085627:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.085633:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085679:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0944d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085719:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085768:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085813:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085857:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.085870:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085951:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.085998:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.086005:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.086010:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086050:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086140:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34519 expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086209:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f09469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34519 expref: 132 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086270:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfc0786ee00) 00010000:00010000:3.0:1790771165.086286:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.086294:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78e00, rc 0) 00000100:00100000:3.0:1790771165.086331:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14271:x1877759533575424:12345-192.168.204.50@tcp:101:ln.0 Request processed in 1552us (1860us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.086376:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5115 00000100:00100000:3.0:1790771165.086425:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5120 00000100:00100000:3.0:1790771165.086454:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14275:x1877759533576448:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.086525:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.086547:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f094af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34543 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086632:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086717:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086730:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086782:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086820:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086882:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086959:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f094cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.086994:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f094cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087091:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f094cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.087205:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.087220:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1790771165.087242:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f094cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087303:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087343:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087381:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087405:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087433:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.087445:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087466:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087518:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.087523:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.087528:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087566:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f094bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087614:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087633:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087673:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087718:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.087729:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087773:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087819:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc2008d000) 00010000:00010000:3.0:1790771165.087823:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.087831:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087870:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f094c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.087963:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f094af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34543 expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088025:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f094cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34543 expref: 132 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088067:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc19631400) 00010000:00010000:3.0:1790771165.088074:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.088082:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5c00, rc 0) 00000100:00100000:3.0:1790771165.088122:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533577984 00000100:00100000:3.0:1790771165.088128:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533577984 00000100:00100000:3.0:1790771165.088181:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533579904 00000100:00100000:3.0:1790771165.088193:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533579904 00000100:00100000:3.0:1790771165.088239:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1297 00000100:00100000:3.0:1790771165.088256:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:12083:x1877759533579904:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771165.088414:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12083:x1877759533579904:12345-192.168.204.50@tcp:35:ls.0 Request processed in 157us (634us total) trans 4294968987 rc 0/0 00000100:00100000:3.0:1790771165.088429:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1297 00000100:00100000:3.0:1790771165.088520:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14275:x1877759533576448:12345-192.168.204.50@tcp:101:ln.0 Request processed in 2040us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.088560:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5120 00000004:00080000:3.0:1790771165.088660:0:13764:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000403:0x45:0x0] 00010000:00010000:3.0:1790771165.088676:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb0533fc00/0xfa0c505d97f09407 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x45:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f09415 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088737:0:13764:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb0533fc00/0xfa0c505d97f09407 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x45:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f09415 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088797:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088844:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 2/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088865:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.088880:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.088888:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.089146:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.089160:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc3da48800) 00010000:00010000:3.0:1790771165.089169:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.089174:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 2/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.089180:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0910c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.089241:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d7d12e08 reply state 00000000a90fc595 transno 4294968986 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09400 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.089250:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09400 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.089256:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x18618557 (ffff8bfc36078700) 00010000:00010000:3.0:1790771165.089258:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.089261:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.089362:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13551:x1877759533557376:12345-192.168.204.50@tcp:36:ln.0 Request processed in 39379us (39454us total) trans 4294968986 rc 0/0 00000100:00100000:3.0:1790771165.089397:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5070 00000100:00100000:3.0:1790771165.091668:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533580544 00000100:00100000:3.0:1790771165.091676:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533580544 00000100:00100000:3.0:1790771165.091758:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 810 00000100:00100000:3.0:1790771165.091779:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533580544:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.091791:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.091808:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f09534 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e345ac expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.091912:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539691136:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.092015:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94780 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.093171:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5132 00000100:00100000:3.0:1790771165.093186:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14203:x1877759533571584:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771165.093199:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.093213:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0959d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e344a2 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093284:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f095b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093332:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f095b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093343:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f095b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093356:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f095c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093365:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f095c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093396:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f095c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093443:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f095ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093455:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f095ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.093465:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f095ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.097373:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5137 00000100:00100000:3.0:1790771165.097396:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13195:x1877759533577600:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.097410:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.097426:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f095ea lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3449b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.097564:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0960d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.097600:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0960d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.097624:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0960d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.097669:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.097775:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f095ea lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3449b expref: 127 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.097857:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0960d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3449b expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.097871:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.097886:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.097892:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b000, rc 0) 00000100:00100000:3.0:1790771165.097947:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13195:x1877759533577600:12345-192.168.204.50@tcp:101:ls.0 Request processed in 555us (669us total) trans 4294968991 rc 0/0 00000100:00100000:3.0:1790771165.098004:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5137 00000100:00100000:3.0:1790771165.098173:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a10a80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539689088:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.098356:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.098528:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533584512 00000100:00100000:3.0:1790771165.098535:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533584512 00010000:00010000:3.0:1790771165.098568:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 133 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.098608:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1419 00000100:00100000:3.0:1790771165.098622:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2396:x1877759533584512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.098631:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.098636:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 133 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098647:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 133 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098663:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f06990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33789 expref: 133 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098683:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771165.098708:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098729:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098734:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f093eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.098763:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.098808:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2396:x1877759533584512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.098822:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1419 00000100:00100000:3.0:1790771165.099644:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533585280 00000100:00100000:3.0:1790771165.099653:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533585280 00000100:00100000:3.0:1790771165.099738:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5140 00000100:00100000:3.0:1790771165.099763:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14040:x1877759533585280:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.099789:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.099811:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533585792 00000100:00100000:3.0:1790771165.099816:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533585792 00000100:00100000:3.0:1790771165.099897:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1299 00000100:00100000:3.0:1790771165.099919:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14323:x1877759533585792:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:3.0:1790771165.100193:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14323:x1877759533585792:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 283us (417us total) trans 4294968477 rc 0/0 00000100:00100000:3.0:1790771165.100204:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1299 00010000:00010000:3.0:1790771165.100334:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09637 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3464d expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.102700:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533586560 00000100:00100000:3.0:1790771165.102706:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533586560 00000100:00100000:3.0:1790771165.102761:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1300 00000100:00100000:3.0:1790771165.102778:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11376c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14292:x1877759533586560:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771165.104592:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539689984:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.105207:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.105263:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.105970:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.106165:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533588480 00000100:00100000:3.0:1790771165.106171:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533588480 00000100:00100000:3.0:1790771165.106207:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533579648 00000100:00100000:3.0:1790771165.106213:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533579648 00000100:00100000:3.0:1790771165.106268:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5151 00000100:00100000:3.0:1790771165.106285:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14210:x1877759533579648:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.106313:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.106324:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f096fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34597 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106401:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106431:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106442:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106556:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106572:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106581:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106622:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106631:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106640:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.106663:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 16580608 00000004:00200000:3.0:1790771165.106666:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.106678:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106703:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106711:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106716:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106725:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106729:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.106732:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106775:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106782:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.106784:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.106787:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106792:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09702 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106799:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106803:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106807:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106811:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.106813:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106821:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106825:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc2008df00) 00010000:00010000:3.0:1790771165.106827:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.106828:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106832:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f09709 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106852:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f096fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 144 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106862:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 143 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.106869:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771165.106871:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.106873:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00000100:00100000:3.0:1790771165.106917:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14210:x1877759533579648:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 639us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.106925:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5151 00000100:00100000:3.0:1790771165.135621:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533580672 00000100:00100000:3.0:1790771165.135633:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533580672 00000100:00100000:3.0:1790771165.135781:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5153 00000100:00100000:3.0:1790771165.135803:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14290:x1877759533580672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.135823:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.135845:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0972c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e345b3 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.135932:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0972c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e345b3 expref: 143 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.135954:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0972c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e345b3 expref: 143 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.135997:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.136002:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.136010:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79400, rc 0) 00000100:00100000:3.0:1790771165.136061:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:14290:x1877759533580672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 258us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.136084:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5153 00000100:00100000:3.0:1790771165.136125:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533592320 00000100:00100000:3.0:1790771165.136132:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533592320 00000100:00100000:3.0:1790771165.136192:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5154 00000100:00100000:3.0:1790771165.136233:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14277:x1877759533592320:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.136275:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.136291:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f09733 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e346b6 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136480:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136550:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136570:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136590:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136628:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136650:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.136733:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.136752:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136798:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136823:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136829:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.136836:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136889:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136908:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.136919:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.136928:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136949:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0973a lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136968:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136974:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136980:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136983:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.136985:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136989:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.136996:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc2008df00) 00010000:00010000:3.0:1790771165.136998:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.137000:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.137009:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09741 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.137047:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f09733 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346b6 expref: 111 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.137134:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.137140:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.137156:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f09733 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346b6 expref: 111 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.137173:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00000100:00100000:3.0:1790771165.137205:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14277:x1877759533592320:12345-192.168.204.50@tcp:101:touch.0 Request processed in 994us (1330us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.137221:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5154 00000100:00100000:3.0:1790771165.137465:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.137798:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.137874:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.138001:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.138083:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.138169:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.138204:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533590272 00000100:00100000:3.0:1790771165.138210:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533590272 00000100:00100000:3.0:1790771165.138260:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533582592 00000100:00100000:3.0:1790771165.138268:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533582592 00000100:00100000:3.0:1790771165.138325:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5159 00000100:00100000:3.0:1790771165.138341:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14395:x1877759533590528:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771165.138368:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.138386:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f09764 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34685 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138473:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0976b lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138585:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0976b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138628:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0976b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.138764:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.138780:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.138796:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0976b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138869:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f09764 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34685 expref: 80 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138918:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0976b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34685 expref: 79 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.138939:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:3.0:1790771165.138955:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.138965:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104000, rc 0) 00000100:00100000:3.0:1790771165.139004:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14395:x1877759533590528:12345-192.168.204.50@tcp:101:rm.0 Request processed in 664us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.139015:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5159 00000100:00100000:3.0:1790771165.139066:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5163 00000100:00100000:3.0:1790771165.139089:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13190:x1877759533591168:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.139099:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.139115:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae000/0xfa0c505d97f09787 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e346a1 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.139173:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.139183:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.139194:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.139231:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x1b:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.139234:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.139265:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae000/0xfa0c505d97f09787 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 112 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.139291:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 111 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.139298:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:3.0:1790771165.139301:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1790771165.139305:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aee00, rc 0) 00000100:00100000:3.0:1790771165.139327:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13190:x1877759533591168:12345-192.168.204.50@tcp:101:ls.0 Request processed in 246us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.139331:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5163 00000100:00100000:3.0:1790771165.139738:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533582848 00000100:00100000:3.0:1790771165.139745:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533582848 00000100:00100000:3.0:1790771165.139786:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533582976 00000100:00100000:3.0:1790771165.139792:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533582976 00000100:00100000:3.0:1790771165.234543:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533593856 00000100:00100000:3.0:1790771165.234557:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533593856 00000100:00100000:3.0:1790771165.234704:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5168 00000100:00100000:3.0:1790771165.234726:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13566:x1877759533589120:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.234768:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.234789:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f097b1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e344b7 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.234940:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f097c6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.234985:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f097c6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.235032:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f097c6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.235053:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x31:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.235210:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f097b1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344b7 expref: 135 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.235311:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f097c6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344b7 expref: 135 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.235324:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.235337:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.235347:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2600, rc 0) 00000100:00100000:3.0:1790771165.235551:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13566:x1877759533589120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 766us (944us total) trans 4294969001 rc 0/0 00000100:00100000:3.0:1790771165.235580:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5168 00000100:00100000:3.0:1790771165.235728:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.235896:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.236423:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533593344 00000100:00100000:3.0:1790771165.236429:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533593344 00000100:00100000:3.0:1790771165.236595:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5171 00000100:00100000:3.0:1790771165.236626:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14323:x1877759533593344:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.236655:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.236675:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae000/0xfa0c505d97f097f0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e346c4 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.236729:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae000/0xfa0c505d97f097f0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346c4 expref: 80 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.236753:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae000/0xfa0c505d97f097f0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346c4 expref: 80 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.236771:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x62:0x0].0x0 (ffff8bfc2008df00) 00010000:00010000:3.0:1790771165.236784:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771165.236792:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058ae000, rc 0) 00000100:00100000:3.0:1790771165.236848:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:14323:x1877759533593344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 229us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.236868:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5171 00000100:00100000:3.0:1790771165.236901:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533594240 00000100:00100000:3.0:1790771165.236907:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533594240 00000100:00100000:3.0:1790771165.236954:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5172 00000100:00100000:3.0:1790771165.236972:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:14184:x1877759533594240:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771165.236980:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.236993:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f097fe lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e346e0 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237055:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237065:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237072:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237113:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237273:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237285:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237462:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237469:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237476:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237522:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.237528:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237580:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237597:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.237601:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.237604:0:13762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f097b8 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237611:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237616:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f09805 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237706:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237713:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237733:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237746:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.237750:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237756:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237767:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xd870248a (ffff8bfc2008d000) 00010000:00010000:3.0:1790771165.237771:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.237774:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237779:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0980c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237858:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f097fe lrc: 1/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346e0 expref: 80 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237871:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.237881:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.237890:0:13762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f097b8 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237902:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f097fe lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346e0 expref: 80 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.237918:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105600, rc 0) 00000100:00100000:3.0:1790771165.237953:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14184:x1877759533594240:12345-192.168.204.50@tcp:101:cp.0 Request processed in 988us (1077us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.237963:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5172 00000100:00100000:3.0:1790771165.238005:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533581056 00000100:00100000:3.0:1790771165.238014:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533581056 00000100:00100000:3.0:1790771165.238081:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533583616 00000100:00100000:3.0:1790771165.238088:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533583616 00000100:00100000:3.0:1790771165.238137:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533581568 00000100:00100000:3.0:1790771165.238143:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533581568 00000100:00100000:3.0:1790771165.238241:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5175 00000100:00100000:3.0:1790771165.238264:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533600896:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.238291:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.238308:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f09828 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34750 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238435:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238459:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238551:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238590:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238622:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238671:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.238725:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.238742:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238759:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238796:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238869:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.238878:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238911:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.238959:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.238964:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.238980:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239029:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0982f lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239082:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239130:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239174:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239223:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.239229:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239267:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239328:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfb02b20000) 00010000:00010000:3.0:1790771165.239333:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.239341:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239355:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f09844 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239432:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f09828 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34750 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239446:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.239450:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.239460:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f09828 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34750 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.239538:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78000, rc 0) 00000100:00100000:3.0:1790771165.239596:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533600896:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1336us (2297us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.239635:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5175 00000100:00100000:3.0:1790771165.239732:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.239789:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.239817:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533597568 00000100:00100000:3.0:1790771165.239825:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533597568 00000100:00100000:3.0:1790771165.239879:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 686 00000100:00100000:3.0:1790771165.239902:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2398:x1877759533597568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.239924:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.239948:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0971e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344a9 expref: 136 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240010:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.240024:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.240055:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2398:x1877759533597568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.240067:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 686 00000100:00100000:3.0:1790771165.240139:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.240211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.240274:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.240329:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.240375:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533582336 00000100:00100000:3.0:1790771165.240382:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533582336 00000100:00100000:3.0:1790771165.240436:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5184 00000100:00100000:3.0:1790771165.240461:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14381:x1877759533582336:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:3.0:1790771165.240551:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.240567:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595800/0xfa0c505d97f09891 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e345f2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240618:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 23 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240646:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240703:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240768:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240812:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240857:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240933:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.240978:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241022:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.241047:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.241058:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.241073:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241083:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241092:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241099:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241137:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241184:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.241197:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241213:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241266:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.241283:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.241293:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241303:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f09898 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241326:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241341:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241371:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241377:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.241381:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241393:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241434:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfb02b20300) 00010000:00010000:3.0:1790771165.241445:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.241449:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241455:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0989f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241576:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595800/0xfa0c505d97f09891 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 150 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241596:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 149 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.241648:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771165.241657:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.241663:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00000100:00100000:3.0:1790771165.241712:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14381:x1877759533582336:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 1258us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.241757:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5184 00000100:00100000:3.0:1790771165.241789:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5187 00000100:00100000:3.0:1790771165.241817:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:14353:x1877759533598848:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:3.0:1790771165.242113:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:14353:x1877759533598848:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 252us (783us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771165.242150:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5187 00000100:00100000:3.0:1790771165.242205:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 687 00000100:00100000:3.0:1790771165.242231:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:2397:x1877759533596928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.242257:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.242285:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f096d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34670 expref: 83 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242316:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.242323:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.242353:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:2397:x1877759533596928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 132us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.242382:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 687 00000100:00100000:3.0:1790771165.242437:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533598720 00000100:00100000:3.0:1790771165.242443:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533598720 00000100:00100000:3.0:1790771165.242554:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1790771165.242576:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14165:x1877759533598720:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:3.0:1790771165.242621:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790771165.242644:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f08c2e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342aa expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242713:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02200/0xfa0c505d97f07b80 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33cd7 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242740:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f06434 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3349c expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242785:0:6506:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f08abb) 00010000:00010000:3.0:1790771165.242790:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb0321e000) 00010000:00010000:3.0:1790771165.242794:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.242811:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242855:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242871:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242884:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242891:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242905:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242942:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.242989:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243006:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243115:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243127:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 113 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243134:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243168:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 113 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243183:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 113 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.243207:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6506:1877759539693056:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.243260:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.243377:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5191 00000100:00100000:3.0:1790771165.243399:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14403:x1877759533600000:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.243456:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243549:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f094fc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34566 expref: 83 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243604:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243671:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f094fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34566 expref: 82 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.243770:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f094fc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34566 expref: 82 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.243889:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539693312:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.243935:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.244101:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.244918:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.245839:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533602304 00000100:00100000:3.0:1790771165.245846:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533602304 00000100:00100000:3.0:1790771165.245912:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 334 00000100:00100000:3.0:1790771165.246091:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533602304:12345-192.168.204.50@tcp:22:fallocate.0 00002000:00010000:3.0:1790771165.246348:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 26344 -> 26344 00002000:00010000:3.0:1790771165.246362:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:3.0:1790771165.246367:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771165.246376:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771164 -> 1790771164 00002000:00010000:3.0:1790771165.246387:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 0 -> 64 00000100:00100000:3.0:1790771165.246417:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533602304:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 495us (757us total) trans 4294967552 rc 0/0 00000100:00100000:3.0:1790771165.246436:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 334 00000100:00100000:3.0:1790771165.247601:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.247636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.247702:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.247774:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.247820:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533603328 00000100:00100000:3.0:1790771165.247828:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533603328 00000100:00100000:3.0:1790771165.247879:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1316 00000100:00100000:3.0:1790771165.247901:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14155:x1877759533603328:12345-192.168.204.50@tcp:49:setfattr.0 00000100:00100000:3.0:1790771165.247984:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14155:x1877759533603328:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 86us (212us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771165.248013:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1316 00000100:00100000:3.0:1790771165.250922:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.250947:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.251015:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.251079:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.251161:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5206 00000100:00100000:3.0:1790771165.251186:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533604352:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.251217:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.251234:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f099be lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3476c expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251351:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251395:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251412:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251472:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251563:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251605:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.251668:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.251678:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251703:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251709:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251714:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.251720:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251725:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251734:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.251736:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.251739:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251743:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f099e1 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251795:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251804:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251808:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251811:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.251813:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251817:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251822:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfb02b20300) 00010000:00010000:3.0:1790771165.251824:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.251826:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251831:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f099ef lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251856:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f099be lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3476c expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251862:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.251864:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.251866:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f099be lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3476c expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.251877:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5200, rc 0) 00000100:00100000:3.0:1790771165.251909:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533604352:12345-192.168.204.50@tcp:101:touch.0 Request processed in 733us (841us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.251959:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5206 00000100:00100000:3.0:1790771165.252055:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533603200 00000100:00100000:3.0:1790771165.252061:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533603200 00000100:00100000:3.0:1790771165.252099:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533595648 00000100:00100000:3.0:1790771165.252104:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533595648 00000100:00100000:3.0:1790771165.252166:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533603584 00000100:00100000:3.0:1790771165.252171:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533603584 00000100:00100000:3.0:1790771165.252225:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5210 00000100:00100000:3.0:1790771165.252244:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:13693:x1877759533603584:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771165.252273:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.252288:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09a12 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34765 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252342:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252398:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252459:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252594:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09a12 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 87 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252647:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 87 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.252664:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771165.252667:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.252671:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4400, rc 0) 00000100:00100000:3.0:1790771165.252781:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:13693:x1877759533603584:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 538us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.252802:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5210 00000001:00080000:3.0:1790771165.254666:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968486 is committed 00000001:00080000:3.0:1790771165.254700:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968483 is committed 00000001:00080000:3.0:1790771165.254743:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968470 is committed 00000004:00080000:3.0:1790771165.254756:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 8 committed 00000100:00100000:3.0:1790771165.254891:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790771165.254918:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03c6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539694464:0@lo:6:osp-syn-0-1.0 00000100:00100000:3.0:1790771165.254982:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.255030:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790771165.255052:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539694592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1790771165.255113:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1790771165.255189:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070718c96 reply state 000000006ac4b703 transno 4294968486 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f09a27 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.255243:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f09a27 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.255293:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771165.255310:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.255320:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771165.255328:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00080000:3.0:1790771165.255387:0:6493:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771165.255411:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:13904:x1877759533603968:12345-192.168.204.50@tcp:36:chown.0 Request processed in 2688us (2853us total) trans 4294968486 rc 0/0 00000100:00100000:3.0:1790771165.255451:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5211 00000004:00080000:3.0:1790771165.255868:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa94000/2, rc 0, transno 4294967553 00000100:00100000:3.0:1790771165.255874:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539694592:0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1790771165.268774:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5215 00000100:00100000:3.0:1790771165.268848:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:13742:x1877759533607296:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.268887:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.268910:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f09a66 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34796 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.269446:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533605248 00000100:00100000:3.0:1790771165.269459:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533605248 00010000:00010000:3.0:1790771165.269545:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 164 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.269714:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1433 00000100:00100000:3.0:1790771165.269736:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+165:2399:x1877759533605248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.269756:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.269777:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 164 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.269808:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 164 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.269926:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f09710 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34597 expref: 164 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.269998:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771165.270004:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f098c2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.270071:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f098c2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.270127:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f098c2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.270175:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.270262:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.270543:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+165:2399:x1877759533605248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 713us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.270573:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1433 00000100:00100000:3.0:1790771165.270649:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533605504 00000100:00100000:3.0:1790771165.270655:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533605504 00010000:00010000:3.0:1790771165.270742:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0917c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343e5 expref: 164 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.270812:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533605888 00000100:00100000:3.0:1790771165.270823:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533605888 00010000:00010000:3.0:1790771165.270846:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f09056 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3438a expref: 94 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.270970:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1434 00000100:00100000:3.0:1790771165.270999:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+166:2398:x1877759533605504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.271031:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.271052:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0917c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343e5 expref: 166 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271120:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0917c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343e5 expref: 166 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271151:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0917c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343e5 expref: 166 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271201:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc0ab7e300) 00010000:00010000:3.0:1790771165.271224:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f098ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f098d0 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271281:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f098ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f098d0 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271331:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f098ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f098d0 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271362:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f098ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f098d0 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.271426:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d60a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6479:1877759539695232:0@lo:105: 00000100:00100000:3.0:1790771165.271549:0:6479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.271609:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5480 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.271658:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f08f29 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34359 expref: 93 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.271745:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6506:1877759539693056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.271798:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271811:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271851:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271920:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.271967:0:6506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 91 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272028:0:6506:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 4/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272103:0:6506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 91 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272163:0:6506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 91 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.272238:0:6506:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d60e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6506:1877759539695488:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.272297:0:6506:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.272361:0:13772:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000010595a53 x1877759539693312) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f094fc lrc: 1/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34566 expref: 54 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272423:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f400/0xfa0c505d97f094fc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34566 expref: 54 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.272553:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539693312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.272590:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.272610:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f099e8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272663:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272732:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272773:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.272933:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001f4d10b4 reply state 000000009e92f2e0 transno 4294968487 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272986:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f09916 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.272996:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.273002:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.273007:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f099e8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.273032:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f099e8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.273078:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f099e8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.273135:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.273195:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14403:x1877759533600000:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 29799us (29970us total) trans 4294968487 rc 0/0 00000100:00100000:3.0:1790771165.273229:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5191 00000100:00100000:3.0:1790771165.273262:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5228 00000100:00100000:3.0:1790771165.273273:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:14040:x1877759533606656:12345-192.168.204.50@tcp:36:touch.0 00010000:00010000:3.0:1790771165.273298:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.273322:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73600/0xfa0c505d97f09947 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346cb expref: 92 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.273367:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a:0x0].0x0 (ffff8bfc3607af00) 00010000:00010000:3.0:1790771165.273381:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.273428:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.273464:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.273618:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.273889:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d60a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6479:1877759539695232:0@lo:105: 00010000:00010000:3.0:1790771165.274141:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.274184:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+161:2398:x1877759533605504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 3188us (3584us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.274276:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1434 00000004:00010000:3.0:1790771165.274372:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dd8d7bd2 reply state 000000009b80670f transno 4294968489 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.274391:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.274437:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a:0x0].0x0 (ffff8bfc20109d00) 00010000:00010000:3.0:1790771165.274454:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.274463:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.274589:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:14040:x1877759533606656:12345-192.168.204.50@tcp:36:touch.0 Request processed in 1313us (1836us total) trans 4294968489 rc 0/0 00000100:00100000:3.0:1790771165.274636:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5228 00000004:00200000:3.0:1790771165.274699:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x67:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.274788:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f09a66 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34796 expref: 91 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.274804:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:3.0:1790771165.274814:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.274821:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f09a66 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34796 expref: 91 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.274841:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00000100:00100000:3.0:1790771165.274877:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13742:x1877759533607296:12345-192.168.204.50@tcp:101:ls.0 Request processed in 6081us (6248us total) trans 4294968491 rc 301/301 00000100:00100000:3.0:1790771165.274894:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5215 00000100:00100000:3.0:1790771165.274938:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533600128 00000100:00100000:3.0:1790771165.274946:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533600128 00000100:00100000:3.0:1790771165.275369:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.275644:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.275676:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533609344 00000100:00100000:3.0:1790771165.275701:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533609344 00000100:00100000:3.0:1790771165.275754:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5234 00000100:00100000:3.0:1790771165.275778:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:14155:x1877759533609344:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.275841:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.275880:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.275922:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.276002:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 34 rpc_version 34 00000020:00100000:3.0:1790771165.276034:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790771165.276051:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05d61880 x1877759539696128/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771165.276081:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d61880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539696128:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1790771165.276151:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.276188:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ccc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.276280:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276305:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276317:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276323:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.276329:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276342:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276367:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.276380:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.276388:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.276432:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f09b8c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.276536:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14155:x1877759533609344:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 719us (856us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771165.276548:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5234 00000100:00100000:3.0:1790771165.276703:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d61880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539696128:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1790771165.276725:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 35 rpc_version 35 00000020:00100000:3.0:1790771165.276750:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790771165.276769:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05d63100 x1877759539696384/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771165.276830:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d63100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539696384:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1790771165.276895:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.276943:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.276982:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533609472 00000100:00100000:3.0:1790771165.276989:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533609472 00000100:00100000:3.0:1790771165.277054:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533609984 00000100:00100000:3.0:1790771165.277060:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533609984 00010000:00010000:3.0:1790771165.277091:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b74b13e/0xfa0c505d97f098c9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x21:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346ee expref: 32 pid: 13796 timeout: 265 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.277166:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 690 00000100:00100000:3.0:1790771165.277189:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:2396:x1877759533609472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.277213:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.277236:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f09986 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344be expref: 154 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277262:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.277274:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.277313:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:2396:x1877759533609472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.277350:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 690 00000100:00100000:3.0:1790771165.277383:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611520 00000100:00100000:3.0:1790771165.277389:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611520 00000100:00100000:3.0:1790771165.277430:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611008 00000100:00100000:3.0:1790771165.277442:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611008 00010000:00010000:3.0:1790771165.277471:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f092a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3442b expref: 158 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.277546:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611392 00000100:00100000:3.0:1790771165.277555:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611392 00000100:00100000:3.0:1790771165.277588:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611264 00000100:00100000:3.0:1790771165.277599:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611264 00000100:00100000:3.0:1790771165.277642:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1445 00000100:00100000:3.0:1790771165.277663:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+158:2398:x1877759533611008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.277707:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.277718:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f092a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3442b expref: 158 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277742:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f092a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3442b expref: 158 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277771:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f092a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3442b expref: 158 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277800:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfc19631900) 00010000:00010000:3.0:1790771165.277819:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f09a04 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277872:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f09a04 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277906:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f09a04 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.277952:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.277987:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+158:2398:x1877759533611008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 328us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.278031:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1445 00000100:00100000:3.0:1790771165.278078:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 693 00000100:00100000:3.0:1790771165.278091:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:2398:x1877759533611264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.278105:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.278128:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09a35 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344d3 expref: 155 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.278195:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.278205:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.278243:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:2398:x1877759533611264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.278285:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 693 00000100:00100000:3.0:1790771165.278326:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533610368 00000100:00100000:3.0:1790771165.278330:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533610368 00000100:00100000:3.0:1790771165.278364:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533610624 00000100:00100000:3.0:1790771165.278370:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533610624 00000100:00100000:3.0:1790771165.278415:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611648 00000100:00100000:3.0:1790771165.278420:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611648 00000100:00100000:3.0:1790771165.278465:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1318 00000100:00100000:3.0:1790771165.278555:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:13193:x1877759533610368:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771165.278813:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:13193:x1877759533610368:12345-192.168.204.50@tcp:35:ls.0 Request processed in 325us (1787us total) trans 4294969020 rc 0/0 00000100:00100000:3.0:1790771165.278830:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1318 00000100:00100000:3.0:1790771165.279024:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533611904 00000100:00100000:3.0:1790771165.279030:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533611904 00000100:00100000:3.0:1790771165.279078:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533612032 00000100:00100000:3.0:1790771165.279084:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533612032 00000100:00100000:3.0:1790771165.279137:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533612160 00000100:00100000:3.0:1790771165.279142:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533612160 00000100:00100000:3.0:1790771165.279209:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 824 00000100:00100000:3.0:1790771165.279228:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2399:x1877759533612032:12345-192.168.204.50@tcp:2:chmod.0 00002000:00010000:3.0:1790771165.279327:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb size from disk: 18111 -> 18111 00002000:00010000:3.0:1790771165.279335:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:3.0:1790771165.279340:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771165.279342:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:3.0:1790771165.279345:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1790771165.279375:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2399:x1877759533612032:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 148us (386us total) trans 4294967557 rc 0/0 00000100:00100000:3.0:1790771165.279392:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 824 00000100:00100000:3.0:1790771165.279420:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 826 00000100:00100000:3.0:1790771165.279448:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2399:x1877759533612160:12345-192.168.204.50@tcp:2:chmod.0 00002000:00010000:3.0:1790771165.279624:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb size from disk: 10485760 -> 0 00002000:00010000:3.0:1790771165.279636:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1790771165 -> 1790771164 00002000:00010000:3.0:1790771165.279650:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb atime from disk: 1790771161 -> 1790771161 00002000:00010000:3.0:1790771165.279659:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771165.279676:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:3.0:1790771165.279737:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759533612160:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 294us (681us total) trans 4294967557 rc 0/0 00000100:00100000:3.0:1790771165.279782:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 826 00000100:00100000:3.0:1790771165.279893:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5240 00000100:00100000:3.0:1790771165.279920:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:14360:x1877759533612416:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1790771165.279995:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f400/0xfa0c505d97f09bd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.280043:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f400/0xfa0c505d97f09bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.280059:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f400/0xfa0c505d97f09bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.280120:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539697152:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1790771165.280200:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771165.280283:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539697152 00000100:00100000:3.0:1790771165.280289:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539697152 00000100:00100000:3.0:1790771165.280335:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1790771165.280347:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1877759539697152:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1790771165.280359:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.280376:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f09415 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x45:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f09407 expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.280417:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x45:0x0].0x0 (ffff8bfb03146900) 00010000:00010000:3.0:1790771165.280440:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.280602:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1877759539697152:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 249us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.280640:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:3.0:1790771165.280727:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0644f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539697152:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1790771165.281042:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.281224:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.281275:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5241 00000100:00100000:3.0:1790771165.281291:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:13261:x1877759533598464:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.281305:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.281319:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3473b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281344:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 139 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281366:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 139 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281376:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.281389:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.281398:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00000100:00100000:3.0:1790771165.281426:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:13261:x1877759533598464:12345-192.168.204.50@tcp:101:ls.0 Request processed in 134us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.281460:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5241 00000100:00100000:3.0:1790771165.281551:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533612672 00000100:00100000:3.0:1790771165.281561:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533612672 00000100:00100000:3.0:1790771165.281607:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5243 00000100:00100000:3.0:1790771165.281630:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14089:x1877759533612672:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771165.281651:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.281670:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09be7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e347ea expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281777:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09bee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281865:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09bee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.281908:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09bee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.281940:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.281956:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.281979:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09bee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282023:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f09be7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ea expref: 93 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282096:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f09bee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ea expref: 92 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282151:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.282164:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.282171:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4bc00, rc 0) 00000100:00100000:3.0:1790771165.282209:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:14089:x1877759533612672:12345-192.168.204.50@tcp:101:cp.0 Request processed in 582us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.282228:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5243 00000100:00100000:3.0:1790771165.282327:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.282391:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.282442:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533612800 00000100:00100000:3.0:1790771165.282450:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533612800 00010000:00010000:3.0:1790771165.282480:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f096a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3456d expref: 134 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.282603:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1447 00000100:00100000:3.0:1790771165.282626:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2398:x1877759533612800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.282638:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.282644:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f096a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3456d expref: 134 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282677:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f096a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3456d expref: 134 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282765:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f096a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3456d expref: 134 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282786:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:3.0:1790771165.282802:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282818:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.282827:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.282867:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2398:x1877759533612800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 248us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.282879:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1447 00000100:00100000:3.0:1790771165.283149:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.283195:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533613056 00000100:00100000:3.0:1790771165.283202:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533613056 00010000:00010000:3.0:1790771165.283225:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0951f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34478 expref: 123 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.283286:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1448 00000100:00100000:3.0:1790771165.283308:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2398:x1877759533613056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.283324:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.283340:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0951f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34478 expref: 123 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283387:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0951f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34478 expref: 123 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283410:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0951f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34478 expref: 123 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283429:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:3.0:1790771165.283435:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283463:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283588:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283621:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.283658:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2398:x1877759533613056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 351us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.283708:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1448 00000100:00100000:3.0:1790771165.283792:0:6506:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d60e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_000:lustre-MDT0001_UUID:6506:1877759539695488:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.283825:0:6506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283863:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.283882:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.284013:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004d2077c4 reply state 000000000a1c5105 transno 4294969026 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284074:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f09a90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa2:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284085:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:3.0:1790771165.284088:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771165.284092:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.284135:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14175:x1877759533605120:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 14449us (15172us total) trans 4294969026 rc 0/0 00000100:00100000:3.0:1790771165.284160:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5221 00000004:00010000:3.0:1790771165.284237:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005af80444 reply state 00000000e9d08b97 transno 4294969023 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f400/0xfa0c505d97f09bd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284278:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f400/0xfa0c505d97f09bd9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284311:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc20109f00) 00010000:00010000:3.0:1790771165.284324:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.284335:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771165.284347:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00010000:00080000:3.0:1790771165.284390:0:13772:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771165.284418:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14360:x1877759533612416:12345-192.168.204.50@tcp:36:chown.0 Request processed in 4506us (5317us total) trans 4294969023 rc 0/0 00000100:00100000:3.0:1790771165.284437:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5240 00000100:00100000:3.0:1790771165.284537:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533614080 00000100:00100000:3.0:1790771165.284543:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533614080 00000100:00100000:3.0:1790771165.284580:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533614208 00000100:00100000:3.0:1790771165.284588:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533614208 00010000:00010000:3.0:1790771165.284615:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 93 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.284702:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1450 00000100:00100000:3.0:1790771165.284729:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:2399:x1877759533614208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.284754:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.284779:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 93 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284848:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 93 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284892:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f03ad5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x36:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32576 expref: 93 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284950:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfc310f2b00) 00010000:00010000:3.0:1790771165.284962:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.284975:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285008:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285072:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.285112:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:2399:x1877759533614208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 382us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.285151:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1450 00010000:00010000:3.0:1790771165.285250:0:6506:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285291:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285390:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285432:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285587:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285629:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.285647:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285705:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285728:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb0321e000) 00010000:00010000:3.0:1790771165.285741:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771165.285750:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285796:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02600/0xfa0c505d97f09901 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285849:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285871:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285883:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285913:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.285928:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285970:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.285986:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfc310f2b00) 00010000:00010000:3.0:1790771165.285990:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771165.285997:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 2/0,0 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286003:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f09aeb lrc: 0/0,0 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286142:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286178:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286222:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286229:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.286235:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286353:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286372:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.286458:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.286464:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286626:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f098e5 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286712:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286719:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286726:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286732:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.286736:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286827:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286842:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfb02b20a00) 00010000:00010000:3.0:1790771165.286845:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.286848:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286857:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f098f3 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286918:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286923:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286928:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286931:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.286933:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.286972:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287037:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd6e9df9d (ffff8bfb02b20b00) 00010000:00010000:3.0:1790771165.287039:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.287042:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287047:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f098fa lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.287290:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:14165:x1877759533598720:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 44717us (46062us total) trans 0 rc -39/-39 00000100:00100000:3.0:1790771165.287297:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 29 00000100:00100000:3.0:1790771165.287368:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533615744 00000100:00100000:3.0:1790771165.287374:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533615744 00000100:00100000:3.0:1790771165.287456:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5254 00000100:00100000:3.0:1790771165.287515:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:14436:x1877759533615744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.287526:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.287537:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09c96 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34829 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287647:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09c9d lrc: 3/1,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287658:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09c9d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287762:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09c9d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.287804:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00010000:00010000:3.0:1790771165.287898:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09c96 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34829 expref: 58 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.287963:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09c9d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34829 expref: 56 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.288004:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771165.288022:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790771165.288031:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00000100:00100000:3.0:1790771165.288073:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14436:x1877759533615744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 605us (757us total) trans 4294968495 rc 0/0 00000100:00100000:3.0:1790771165.288120:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5254 00000100:00100000:3.0:1790771165.288222:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.288298:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.288641:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.288663:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533616128 00000100:00100000:3.0:1790771165.288670:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533616128 00002000:00100000:3.0:1790771165.288730:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (397312->401407) req@ffff8bfb069e8000 x1877759533616128/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771165.288754:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8000 with x1877759533616128 ext(397312->401407) 00002000:00010000:3.0:1790771165.288761:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8000 00000100:00100000:3.0:1790771165.288793:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 338 00000100:00100000:3.0:1790771165.288808:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533616128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.288971:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533616128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 163us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.289005:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 338 00002000:00100000:3.0:1790771165.289020:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (397312->401407) req@ffff8bfb069e8000 x1877759533616128/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771165.289056:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8000 with x1877759533616128 ext(397312->401407) 00002000:00010000:3.0:1790771165.289069:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8000 00000100:00100000:3.0:1790771165.289314:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5262 00000100:00100000:3.0:1790771165.289329:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14154:x1877759533617024:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:3.0:1790771165.289343:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.289355:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f09cff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34504 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.289551:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533617280 00000100:00100000:3.0:1790771165.289556:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533617280 00000100:00100000:3.0:1790771165.289701:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5263 00000100:00100000:3.0:1790771165.289715:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:13742:x1877759533617280:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.289761:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.289774:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09d14 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3483e expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.289840:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.289850:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.289861:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.289923:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x67:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.289928:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.289942:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.289963:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09d14 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 94 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.289998:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 93 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.290023:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:3.0:1790771165.290036:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.290045:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5800, rc 0) 00000100:00100000:3.0:1790771165.290088:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:13742:x1877759533617280:12345-192.168.204.50@tcp:101:ls.0 Request processed in 376us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.290113:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5263 00000100:00100000:3.0:1790771165.291844:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533617408 00000100:00100000:3.0:1790771165.291856:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533617408 00000100:00100000:3.0:1790771165.291929:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 696 00000100:00100000:3.0:1790771165.291946:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2397:x1877759533617408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.291967:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.291999:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f09a51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344da expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.292033:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:3.0:1790771165.292082:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.292137:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533617408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 190us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.292205:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 696 00000100:00100000:3.0:1790771165.292717:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.296776:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.296839:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.296933:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5269 00000100:00100000:3.0:1790771165.296955:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13763:x1877759533618432:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771165.296984:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.297008:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09d68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34582 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297062:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297074:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297173:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297198:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297237:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297280:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297382:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f09d8b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297418:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f09d8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297475:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f09d8b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.297556:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 21450 00010000:00010000:3.0:1790771165.297632:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297697:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297726:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297777:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297809:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.297819:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.297859:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298010:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.298025:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.298034:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298081:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09d6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298095:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298138:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298151:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298163:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.298180:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298188:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298378:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc20109800) 00010000:00010000:3.0:1790771165.298385:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.298390:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298433:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09d84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298641:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09d68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34582 expref: 125 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298669:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f09d8b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34582 expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.298695:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771165.298698:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.298702:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391600, rc 0) 00000100:00100000:3.0:1790771165.298733:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13763:x1877759533618432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1790us (1961us total) trans 4294969031 rc 0/0 00000100:00100000:3.0:1790771165.298740:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5269 00000100:00100000:3.0:1790771165.301651:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.301693:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.302576:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533620480 00000100:00100000:3.0:1790771165.302583:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533620480 00000100:00100000:3.0:1790771165.302615:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 831 00000100:00100000:3.0:1790771165.302623:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+20:2397:x1877759533620480:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771165.302633:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.302642:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007896a65a/0xfa0c505d97f09ddf lrc: 2/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34884 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.302677:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539699328:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.302739:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.303649:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.303673:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.303716:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.303812:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.303861:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533620992 00000100:00100000:3.0:1790771165.303872:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533620992 00010000:00010000:3.0:1790771165.303904:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f09ba1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347b9 expref: 124 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.303953:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1452 00000100:00100000:3.0:1790771165.303980:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2396:x1877759533620992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.304006:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.304014:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f09ba1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347b9 expref: 124 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304025:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f09ba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347b9 expref: 124 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304068:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771165.304089:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304158:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304167:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304173:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304180:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304186:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304284:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304295:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.304409:0:13770:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969025 00000004:00010000:3.0:1790771165.304435:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c43ae329 reply state 000000007290b6f8 transno 4294969034 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304445:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f09c3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304451:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771165.304453:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.304455:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304459:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304463:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304467:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304471:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.304476:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.304555:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.305193:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533621248 00000100:00100000:3.0:1790771165.305200:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533621248 00000100:00100000:3.0:1790771165.305253:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1325 00000100:00100000:3.0:1790771165.305282:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13332:x1877759533621248:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790771165.305326:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533621632 00000100:00100000:3.0:1790771165.305331:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533621632 00010000:00010000:3.0:1790771165.305356:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f098de lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3468c expref: 121 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.305390:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1453 00000100:00100000:3.0:1790771165.305411:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2397:x1877759533621632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.305438:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.305452:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f098de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3468c expref: 121 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.305464:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f098de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3468c expref: 121 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.305550:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f098de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3468c expref: 121 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.305628:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.305636:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f09c81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.305647:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f09c81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.305655:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.308272:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533621888 00000100:00100000:3.0:1790771165.308283:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533621888 00000100:00100000:3.0:1790771165.308352:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533622144 00000100:00100000:3.0:1790771165.308370:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533622144 00000100:00100000:3.0:1790771165.308469:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533622528 00000100:00100000:3.0:1790771165.308476:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533622528 00000100:00100000:3.0:1790771165.308578:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533623680 00000100:00100000:3.0:1790771165.308584:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533623680 00000100:00100000:3.0:1790771165.308651:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5280 00000100:00100000:3.0:1790771165.308675:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14535:x1877759533622144:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.308739:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f09e10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.308813:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f09df4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.308861:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f09e10 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.308908:0:7771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f09df4 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.308947:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f09e10 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.309009:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5283 00000100:00100000:3.0:1790771165.309030:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13293:x1877759533623680:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.309063:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.309078:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e348df expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.309148:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 122 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.309175:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 122 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.309232:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.309249:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.309257:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4e00, rc 0) 00000100:00100000:3.0:1790771165.309299:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13293:x1877759533623680:12345-192.168.204.50@tcp:101:ls.0 Request processed in 278us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.309308:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5283 00000100:00100000:3.0:1790771165.309351:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533623808 00000100:00100000:3.0:1790771165.309359:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533623808 00000100:00100000:3.0:1790771165.310479:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.310774:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5286 00000100:00100000:3.0:1790771165.310806:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:13678:x1877759533622656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.310831:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.310846:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e348ae expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.310907:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 103 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.310947:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 103 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.310969:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.310985:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.310989:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4600, rc 0) 00000100:00100000:3.0:1790771165.311024:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13678:x1877759533622656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 230us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.311060:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5286 00000100:00100000:3.0:1790771165.311101:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5288 00000100:00100000:3.0:1790771165.311115:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:11972:x1877759533624448:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.311147:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.311160:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e348f4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311191:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311207:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311215:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.311219:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.311225:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f09cea lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34830 expref: 63 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311233:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03800, rc 0) 00000100:00100000:3.0:1790771165.311264:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:11972:x1877759533624448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 151us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.311272:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5288 00000100:00100000:3.0:1790771165.311300:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5289 00000100:00100000:3.0:1790771165.311313:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13733:x1877759533622784:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.311321:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.311333:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e348b5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311356:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 104 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311414:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 104 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311420:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.311423:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.311427:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03a00, rc 0) 00000100:00100000:3.0:1790771165.311629:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13733:x1877759533622784:12345-192.168.204.50@tcp:101:ls.0 Request processed in 320us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.311641:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5289 00000100:00100000:3.0:1790771165.311817:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5290 00000100:00100000:3.0:1790771165.311836:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:13788:x1877759533624832:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1790771165.311911:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f09e72 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311946:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f09e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.311973:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f09e72 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312374:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312384:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312402:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312420:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312434:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312474:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312481:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312556:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312561:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312566:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.312569:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312575:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312582:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.312584:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.312586:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312590:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09dd8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312600:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312604:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312609:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312612:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.312614:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312617:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312621:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xd870248a (ffff8bfc20109800) 00010000:00010000:3.0:1790771165.312623:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.312624:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312632:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09e80 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312655:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09dd1 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3487d expref: 102 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312661:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.312662:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.312665:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09dd1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3487d expref: 102 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.312672:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4800, rc 0) 00000100:00100000:3.0:1790771165.313240:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533625728 00000100:00100000:3.0:1790771165.313249:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533625728 00000100:00100000:3.0:1790771165.313312:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5292 00000100:00100000:3.0:1790771165.313338:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14436:x1877759533625728:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.313368:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.313379:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f09e8e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34902 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.313420:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f09e8e lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34902 expref: 65 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.313480:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f09e8e lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34902 expref: 65 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.313543:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.313548:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.313554:0:13766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f09cea lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34830 expref: 65 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.313587:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00000100:00100000:3.0:1790771165.315148:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562e300 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539698944:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.315171:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d500 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539699072:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.315250:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f09da0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.315626:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533626368 00000100:00100000:3.0:1790771165.315631:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533626368 00010000:00010000:3.0:1790771165.315662:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f068fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3354b expref: 140 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.315792:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1458 00000100:00100000:3.0:1790771165.315808:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2397:x1877759533626368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.315820:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.315831:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f068fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3354b expref: 140 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.315915:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f068fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3354b expref: 140 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.315937:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f068fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3354b expref: 140 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.315967:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771165.315981:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f09da0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.315994:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f09da0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.316004:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f09da0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.316058:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.316110:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2397:x1877759533626368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 300us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.316145:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1458 00000100:00100000:3.0:1790771165.316252:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533626496 00000100:00100000:3.0:1790771165.316259:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533626496 00000100:00100000:3.0:1790771165.316310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5296 00000100:00100000:3.0:1790771165.316334:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13208:x1877759533626496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.316352:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.316370:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09ecd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34917 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.316410:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09ecd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34917 expref: 127 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.316429:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09ecd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34917 expref: 127 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.316453:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.316456:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.316459:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00000100:00100000:3.0:1790771165.316573:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13208:x1877759533626496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 245us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.316584:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5296 00000100:00100000:3.0:1790771165.316842:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533626624 00000100:00100000:3.0:1790771165.316847:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533626624 00000100:00100000:3.0:1790771165.316884:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5297 00000100:00100000:3.0:1790771165.316891:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14030:x1877759533626624:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:3.0:1790771165.316951:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.316964:0:13771:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0955e) 00010000:00010000:3.0:1790771165.316972:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.317158:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09ed4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.317174:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.317201:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.317298:0:13771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969041 00000004:00010000:3.0:1790771165.317323:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000012427507 reply state 00000000968da449 transno 4294969043 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09ed4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.317332:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f09ed4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.317382:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x25:0x0].0x0 (ffff8bfc1040f400) 00010000:00010000:3.0:1790771165.317386:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.317398:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.317532:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14030:x1877759533626624:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 637us (745us total) trans 4294969043 rc 0/0 00000100:00100000:3.0:1790771165.317543:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5297 00000020:00080000:3.0:1790771165.317549:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00010000:3.0:1790771165.358173:0:13793:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime: 0 -> 1790771161 00000100:00100000:3.0:1790771165.358285:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539699328:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.358343:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007896a65a/0xfa0c505d97f09ddf lrc: 1/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34884 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.358481:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007896a65a/0xfa0c505d97f09ddf lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34884 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.358630:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5000, rc 0) 00000100:00100000:3.0:1790771165.358707:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2397:x1877759533620480:12345-192.168.204.50@tcp:101:chown.0 Request processed in 56075us (56157us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.358722:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 831 00000100:00100000:3.0:1790771165.358792:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5302 00000100:00100000:3.0:1790771165.358821:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14089:x1877759533631360:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771165.358852:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.358883:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09f28 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34964 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359128:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359167:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359200:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359253:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3b:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359278:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359330:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.359551:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5307 00000100:00100000:3.0:1790771165.359569:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13789:x1877759533628032:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771165.359586:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.359600:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f09f75 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34933 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359636:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359647:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359715:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359893:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f09f75 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 136 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.359969:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 135 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.360028:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771165.360045:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.360051:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2800, rc 0) 00000100:00100000:3.0:1790771165.360097:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13789:x1877759533628032:12345-192.168.204.50@tcp:101:chown.0 Request processed in 532us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.360105:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5307 00000004:00080000:3.0:1790771165.360545:0:6493:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x15:0x0], index 1: 0 00000100:00100000:3.0:1790771165.360700:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533629440 00000100:00100000:3.0:1790771165.360713:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533629440 00000100:00100000:3.0:1790771165.360792:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 697 00000100:00100000:3.0:1790771165.360811:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2397:x1877759533629440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.360835:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.360856:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f09c50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c0 expref: 135 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.360890:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771165.360896:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.360929:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2397:x1877759533629440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 124us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.360953:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 697 00010000:00010000:3.0:1790771165.361039:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09fa6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361052:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361062:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09fa6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361106:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361116:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361123:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361131:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361143:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.361149:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361158:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361179:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.361195:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.361201:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361246:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f09f2f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.361289:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001030d39d reply state 00000000833bf8fc transno 4294968503 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361321:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361368:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xd870248a (ffff8bfc20109800) 00010000:00010000:3.0:1790771165.361375:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.361379:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.361419:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f09f28 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34964 expref: 105 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361532:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f09fa6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34964 expref: 104 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.361576:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfc20109500) 00010000:00010000:3.0:1790771165.361584:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.361595:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2e00, rc 0) 00000100:00100000:3.0:1790771165.361650:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14089:x1877759533631360:12345-192.168.204.50@tcp:101:cp.0 Request processed in 2832us (3565us total) trans 4294968503 rc 0/0 00000100:00100000:3.0:1790771165.361712:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5302 00000100:00100000:3.0:1790771165.361758:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5312 00000100:00100000:3.0:1790771165.361788:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14287:x1877759533623936:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771165.361824:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.361933:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f09fd7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e348ed expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362010:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362062:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362103:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362210:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f09fd7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ed expref: 110 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362268:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ed expref: 109 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362277:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771165.362286:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.362291:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339a00, rc 0) 00000100:00100000:3.0:1790771165.362326:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14287:x1877759533623936:12345-192.168.204.50@tcp:101:cp.0 Request processed in 552us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.362363:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5312 00000100:00100000:3.0:1790771165.362552:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.362621:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.362716:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.362740:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533630592 00000100:00100000:3.0:1790771165.362746:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533630592 00010000:00010000:3.0:1790771165.362768:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 145 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.362794:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1462 00000100:00100000:3.0:1790771165.362803:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:2397:x1877759533630592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.362812:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.362818:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 145 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362865:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 145 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362912:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771165.362920:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362930:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.362935:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.362968:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:2397:x1877759533630592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 164us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.363001:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1462 00000100:00100000:3.0:1790771165.363191:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363221:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533630976 00000100:00100000:3.0:1790771165.363228:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533630976 00010000:00010000:3.0:1790771165.363252:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 136 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.363313:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1463 00000100:00100000:3.0:1790771165.363330:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2398:x1877759533630976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.363349:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.363360:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 135 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.363390:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 135 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.363410:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771165.363415:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.363423:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.363446:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.363474:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.363527:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2398:x1877759533630976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 200us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.363546:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1463 00000100:00100000:3.0:1790771165.363647:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363674:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533631104 00000100:00100000:3.0:1790771165.363679:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533631104 00010000:00010000:3.0:1790771165.363713:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f09e25 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348d8 expref: 146 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.363807:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363853:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363890:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.363941:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533632640 00000100:00100000:3.0:1790771165.363946:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533632640 00000100:00100000:3.0:1790771165.363980:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5314 00000100:00100000:3.0:1790771165.363994:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14483:x1877759533632640:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:3.0:1790771165.364078:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14483:x1877759533632640:12345-192.168.204.50@tcp:36:ln.0 Request processed in 84us (158us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771165.364090:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5314 00000100:00100000:3.0:1790771165.364135:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364168:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364204:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364233:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364267:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364292:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364315:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533633408 00000100:00100000:3.0:1790771165.364321:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533633408 00000100:00100000:3.0:1790771165.364347:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5315 00000100:00100000:3.0:1790771165.364358:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14497:x1877759533633408:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.364394:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0a016 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364411:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 147 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364433:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0a016 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364468:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 146 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364516:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 146 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.364542:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01180 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539701632:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.364579:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c000 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.364624:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364668:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364783:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.364819:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5316 00000100:00100000:3.0:1790771165.364832:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14397:x1877759533633536:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.364863:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a024 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364885:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fcb expref: 138 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364894:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34742 expref: 145 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364933:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a024 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364978:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34742 expref: 145 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.364994:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34742 expref: 145 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.365015:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d17800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539701888:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.365060:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fcb expref: 138 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365081:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0860e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fcb expref: 138 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.365111:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d15c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539702016:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.365150:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ca80 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.365202:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f098a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f2 expref: 146 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.365221:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a12300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539699712:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.365248:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f093ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34471 expref: 138 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.365287:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539699840:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.365320:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365328:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365333:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365863:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365871:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365877:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365920:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05e85800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.365927:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365934:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.365952:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771165.365959:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.366010:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.366019:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f09e5d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.366122:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14050:x1877759533624192:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 55298us (55477us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771165.366128:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5287 00000100:00100000:3.0:1790771165.368424:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533634944 00000100:00100000:3.0:1790771165.368430:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533634944 00000100:00100000:3.0:1790771165.368635:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5319 00000100:00100000:3.0:1790771165.368645:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14287:x1877759533634944:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771165.368668:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.368695:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f09c8f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34806 expref: 109 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.368707:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771165.368710:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.368735:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.368744:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.368750:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.368803:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e21ce67c reply state 00000000dccb0417 transno 4294968509 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.368815:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.368820:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771165.368823:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.368825:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.368878:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14287:x1877759533634944:12345-192.168.204.50@tcp:36:cp.0 Request processed in 235us (490us total) trans 4294968509 rc 0/0 00000100:00100000:3.0:1790771165.368884:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5319 00000100:00100000:3.0:1790771165.369973:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14395:x1877759533633280:12345-192.168.204.50@tcp:37:rm.0 Request processed in 5329us (5706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.369979:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1337 00000100:00100000:3.0:1790771165.373197:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533635840 00000100:00100000:3.0:1790771165.373204:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533635840 00000100:00100000:3.0:1790771165.373238:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533636224 00000100:00100000:3.0:1790771165.373241:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533636224 00000100:00100000:3.0:1790771165.373267:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533637120 00000100:00100000:3.0:1790771165.373270:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533637120 00000100:00100000:3.0:1790771165.374294:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.374317:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.374341:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.374370:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.374403:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.374445:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533636736 00000100:00100000:3.0:1790771165.374452:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533636736 00000100:00100000:3.0:1790771165.374522:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5325 00000100:00100000:3.0:1790771165.374535:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:13592:x1877759533636736:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771165.374560:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.374578:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f09c42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e347f8 expref: 148 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.374609:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771165.374618:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.374633:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a0a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.374651:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.374671:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.374786:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006ed148cf reply state 00000000627c950d transno 4294969056 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.374799:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a0a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.374817:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771165.374821:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.374825:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.374863:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:13592:x1877759533636736:12345-192.168.204.50@tcp:36:cp.0 Request processed in 329us (458us total) trans 4294969056 rc 0/0 00000100:00100000:3.0:1790771165.374880:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5325 00000100:00100000:3.0:1790771165.382597:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06739c00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539700352:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.382633:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533637632 00000100:00100000:3.0:1790771165.382640:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533637632 00000100:00100000:3.0:1790771165.382679:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5327 00000100:00100000:3.0:1790771165.382705:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14425:x1877759533637632:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1790771165.382732:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790771165.382745:0:7771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f09cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34742 expref: 149 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.382774:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f00790 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3135c expref: 149 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.382805:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771165.382815:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a024 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.382826:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a024 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.382847:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.382880:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673b480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539700480:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.382896:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673b800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539700736:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.382932:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.383021:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533637888 00000100:00100000:3.0:1790771165.383028:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533637888 00010000:00010000:3.0:1790771165.383101:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f05b74 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e330dd expref: 110 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.383143:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533637760 00000100:00100000:3.0:1790771165.383148:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533637760 00010000:00010000:3.0:1790771165.383168:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f09630 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34654 expref: 111 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.383215:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1466 00000100:00100000:3.0:1790771165.383233:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533637888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.383250:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.383259:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f05b74 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e330dd expref: 111 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383273:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f05b74 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e330dd expref: 111 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383297:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f05b74 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e330dd expref: 111 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383310:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:3.0:1790771165.383316:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383340:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383364:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.383397:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2396:x1877759533637888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 170us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.383410:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1466 00000100:00100000:3.0:1790771165.383438:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1467 00000100:00100000:3.0:1790771165.383451:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2398:x1877759533637760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.383466:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.383475:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f09630 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34654 expref: 109 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383511:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f09630 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34654 expref: 109 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383532:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f09630 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34654 expref: 109 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383544:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:3.0:1790771165.383547:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383554:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383559:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383579:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.383605:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2398:x1877759533637760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 158us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.383640:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1467 00010000:00010000:3.0:1790771165.383751:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383761:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.383847:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dce890d1 reply state 00000000b81d28fe transno 4294968513 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383860:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.383869:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:3.0:1790771165.383871:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771165.383874:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.383912:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14469:x1877759533629056:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 23307us (23366us total) trans 4294968513 rc 0/0 00000100:00100000:3.0:1790771165.383926:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5308 00000100:00100000:3.0:1790771165.384019:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.384043:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533639040 00000100:00100000:3.0:1790771165.384047:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533639040 00010000:00010000:3.0:1790771165.384066:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 149 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.384099:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1468 00000100:00100000:3.0:1790771165.384108:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:2396:x1877759533639040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.384119:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.384131:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 149 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384154:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 149 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384182:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f09a0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346fc expref: 149 pid: 13767 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384196:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771165.384202:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0a016 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384212:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0a016 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384220:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0a016 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.384238:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.384263:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:2396:x1877759533639040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 156us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.384279:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1468 00000100:00100000:3.0:1790771165.384795:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533639424 00000100:00100000:3.0:1790771165.384801:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533639424 00000100:00100000:3.0:1790771165.384843:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5329 00000100:00100000:3.0:1790771165.384870:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14151:x1877759533639424:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771165.384997:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14151:x1877759533639424:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 139us (286us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771165.385011:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5329 00000100:00100000:3.0:1790771165.385049:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1470 00000100:00100000:3.0:1790771165.385146:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533639680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.385168:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.385190:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a0aac8e/0xfa0c505d97eff920 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30df9 expref: 24 pid: 8406 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.385213:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a0aac8e/0xfa0c505d97eff920 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30df9 expref: 24 pid: 8406 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.385246:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a0aac8e/0xfa0c505d97eff920 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->28671) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30df9 expref: 23 pid: 8406 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.385275:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1790771165.385286:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1790771165.385301:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 24 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.385334:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 24 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.385384:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 24 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.385440:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8425:1877759539703168:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771165.385471:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5240 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.386631:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.392109:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533640704 00000100:00100000:3.0:1790771165.392115:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533640704 00000100:00100000:3.0:1790771165.392148:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533640832 00000100:00100000:3.0:1790771165.392153:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533640832 00000100:00100000:3.0:1790771165.392183:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5332 00000100:00100000:3.0:1790771165.392195:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:14528:x1877759533640704:12345-192.168.204.50@tcp:36:touch.0 00010000:00010000:3.0:1790771165.392225:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.392244:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0a001 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34979 expref: 145 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.392258:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc19631f00) 00010000:00010000:3.0:1790771165.392266:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.392306:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0a104 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.392316:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0a104 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.392328:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0a104 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.392470:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bfbefdda reply state 00000000bde742ca transno 4294969059 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0a104 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.392595:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0a104 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.392605:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc20109a00) 00010000:00010000:3.0:1790771165.392609:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.392612:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.392737:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14528:x1877759533640704:12345-192.168.204.50@tcp:36:touch.0 Request processed in 544us (682us total) trans 4294969059 rc 0/0 00000100:00100000:3.0:1790771165.392754:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5332 00000100:00100000:3.0:1790771165.392771:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533641088 00000100:00100000:3.0:1790771165.392776:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533641088 00000100:00100000:3.0:1790771165.393151:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533641856 00000100:00100000:3.0:1790771165.393155:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533641856 00000100:00100000:3.0:1790771165.393179:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5335 00000100:00100000:3.0:1790771165.393186:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14277:x1877759533641856:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.393199:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.393211:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a12e lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e349c6 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393279:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393291:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393313:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393337:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393348:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393358:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.393386:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.393397:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393404:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393409:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393413:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393420:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.393425:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393434:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393443:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.393446:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.393449:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393453:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a135 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393461:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393530:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393535:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393543:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.393548:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393557:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393572:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.393577:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.393581:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393589:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a13c lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393617:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a12e lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349c6 expref: 112 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.393620:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x1b:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.393625:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000004:00200000:2.0:1790771165.393626:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.393628:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.393634:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a12e lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349c6 expref: 112 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.393642:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00000004:00010000:2.0:1790771165.393645:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a14a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.393674:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caf600/0xfa0c505d97f0a143 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349bf expref: 112 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.393713:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a14a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349bf expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.393723:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:2.0:1790771165.393726:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.393729:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caee00, rc 0) 00000100:00100000:2.0:1790771165.393760:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14557:x1877759533641472:12345-192.168.204.50@tcp:101:ln.0 Request processed in 332us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.393769:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5336 00000100:00100000:3.0:1790771165.393774:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14277:x1877759533641856:12345-192.168.204.50@tcp:101:touch.0 Request processed in 586us (690us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.393782:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5335 00000100:00100000:2.0:1790771165.393803:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533641728 00000100:00100000:2.0:1790771165.393808:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533641728 00010000:00010000:2.0:1790771165.393827:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b2c6f9c/0xfa0c505d97f09ef7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->28671) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34925 expref: 26 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.393859:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533641984 00000100:00100000:2.0:1790771165.393862:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533641984 00010000:00010000:2.0:1790771165.393879:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f09c0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ce expref: 144 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.393920:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1472 00000100:00100000:2.0:1790771165.393930:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2396:x1877759533641984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.393946:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.393955:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f09c0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ce expref: 144 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.393978:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f09c0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ce expref: 144 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.393998:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f09c0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347ce expref: 144 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.394023:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:2.0:1790771165.394033:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0a0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.394055:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.394092:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533641984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.394103:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1472 00000100:00100000:2.0:1790771165.403796:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533642240 00000100:00100000:2.0:1790771165.403804:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533642240 00000100:00100000:3.0:1790771165.403819:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533642496 00000100:00100000:2.0:1790771165.403825:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533642368 00000100:00100000:3.0:1790771165.403826:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533642496 00000100:00100000:2.0:1790771165.403830:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533642368 00010000:00010000:2.0:1790771165.403852:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f079c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33bcd expref: 146 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.403890:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533642624 00000100:00100000:2.0:1790771165.403893:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533642624 00000100:00100000:3.0:1790771165.403928:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 698 00000100:00100000:2.0:1790771165.403936:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1473 00000100:00100000:3.0:1790771165.403945:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2396:x1877759533642624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.403954:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:2396:x1877759533642368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.403963:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.403964:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.403973:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f079c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33bcd expref: 146 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.403982:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0a05c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34788 expref: 144 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.403994:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f079c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33bcd expref: 146 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404011:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:3.0:1790771165.404021:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.404031:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f079c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33bcd expref: 146 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.404050:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00000100:00100000:3.0:1790771165.404053:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533642624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (201us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.404055:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0a0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.404067:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 698 00010000:00010000:2.0:1790771165.404075:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0a0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.404084:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0a0a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.404092:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533642752 00000100:00100000:3.0:1790771165.404099:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533642752 00010000:00010000:2.0:1790771165.404116:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.404131:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5337 00000100:00100000:3.0:1790771165.404143:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14516:x1877759533642752:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:2.0:1790771165.404151:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:2396:x1877759533642368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.404164:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1473 00010000:00010000:3.0:1790771165.404192:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a158 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404210:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a158 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404229:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a158 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.404306:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000743d486e reply state 0000000036a5356e transno 4294969062 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a158 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.404317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.404351:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.404371:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0a158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404381:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771165.404388:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.404393:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771165.404396:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.404448:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:14516:x1877759533642752:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 307us (549us total) trans 4294969062 rc 0/0 00000100:00100000:3.0:1790771165.404457:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5337 00000100:00100000:2.0:1790771165.404481:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.404547:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1346 00000100:00100000:2.0:1790771165.404562:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:14203:x1877759533643648:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:3.0:1790771165.404583:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5340 00000100:00100000:3.0:1790771165.404592:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13293:x1877759533642240:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.404604:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.404615:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a17b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e349cd expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404667:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404699:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404712:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.404730:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.404736:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.404748:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404765:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a17b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 153 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404779:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 152 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.404785:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:3.0:1790771165.404787:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.404790:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594e00, rc 0) 00000100:00100000:2.0:1790771165.404816:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:14203:x1877759533643648:12345-192.168.204.50@tcp:35:cp.0 Request processed in 255us (422us total) trans 4294969063 rc 0/0 00000100:00100000:3.0:1790771165.404820:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:13293:x1877759533642240:12345-192.168.204.50@tcp:101:ls.0 Request processed in 228us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.404837:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5340 00000100:00100000:2.0:1790771165.404842:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1346 00000100:00100000:2.0:1790771165.404876:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533643776 00000100:00100000:2.0:1790771165.404883:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533643776 00000100:00100000:3.0:1790771165.404918:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.404925:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 848 00000100:00100000:2.0:1790771165.404941:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14084:x1877759533643776:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771165.404951:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.404958:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.404970:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e349e9 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.404989:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.405006:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790771165.405027:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=165s v=(0 0) 00010000:00010000:2.0:1790771165.405038:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790771165.405049:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.405059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.405080:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.405106:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1000, rc 0) 00000100:00100000:3.0:1790771165.405119:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533644032 00000100:00100000:3.0:1790771165.405125:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533644032 00000100:00100000:2.0:1790771165.405141:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:14084:x1877759533643776:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 201us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.405154:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533644416 00000100:00100000:2.0:1790771165.405158:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 848 00000100:00100000:3.0:1790771165.405160:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533644416 00000100:00100000:3.0:1790771165.405187:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5341 00000100:00100000:3.0:1790771165.405199:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:14426:x1877759533644032:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:2.0:1790771165.405209:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5342 00000100:00100000:2.0:1790771165.405231:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:14154:x1877759533644416:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:3.0:1790771165.405292:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0a19e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.405312:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:14154:x1877759533644416:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 88us (255us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.405314:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0a19e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.405329:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5342 00010000:00010000:3.0:1790771165.405334:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0a19e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.405358:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533644672 00000100:00100000:2.0:1790771165.405363:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533644672 00000001:00080000:3.0:1790771165.405388:0:13762:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969064 00000100:00100000:2.0:1790771165.405401:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1348 00000100:00100000:2.0:1790771165.405414:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:13135:x1877759533644672:12345-192.168.204.50@tcp:35:rm.0 00000004:00010000:3.0:1790771165.405417:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019b51b6e reply state 00000000e503534f transno 4294969066 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0a19e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.405438:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0a19e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.405449:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.405454:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.405460:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.405538:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:14426:x1877759533644032:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 340us (580us total) trans 4294969066 rc 0/0 00000100:00100000:3.0:1790771165.405556:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5341 00000100:00100000:2.0:1790771165.405558:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:13135:x1877759533644672:12345-192.168.204.50@tcp:35:rm.0 Request processed in 143us (214us total) trans 4294969067 rc 0/0 00000020:00080000:3.0:1790771165.405562:0:13762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771165.405576:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1348 00002000:00010000:2.0:1790771165.405619:0:13796:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime: 0 -> 1790771160 00002000:00010000:2.0:1790771165.405623:0:13796:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime: 1790771164 -> 1790771165 00000100:00100000:2.0:1790771165.405633:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06374380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539702784:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.405658:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000061240d/0xfa0c505d97f0a0da lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349b1 expref: 27 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.405674:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000061240d/0xfa0c505d97f0a0da lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349b1 expref: 27 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.405698:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:2.0:1790771165.405725:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533638528:12345-192.168.204.50@tcp:101:cat.0 Request processed in 22304us (22585us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.405730:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 844 00000100:00100000:2.0:1790771165.407612:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.407644:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533645824 00000100:00100000:3.0:1790771165.407648:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533645824 00000100:00100000:3.0:1790771165.407727:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5343 00000100:00100000:3.0:1790771165.407736:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:14562:x1877759533645824:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.407743:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.407751:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0a1ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e349f7 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.407795:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0a1b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x42:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.407803:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0a1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.407808:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0a1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.407814:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x42:0x0]: returning size 6971 00010000:00010000:3.0:1790771165.407855:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0a1ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 22 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349f7 expref: 150 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.407865:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0a1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349f7 expref: 149 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.407870:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00010000:00010000:3.0:1790771165.407872:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.407874:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595000, rc 0) 00000100:00100000:3.0:1790771165.407899:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14562:x1877759533645824:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 167us (290us total) trans 4294969068 rc 0/0 00000100:00100000:3.0:1790771165.407904:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5343 00000100:00100000:2.0:1790771165.434007:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.434101:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06376680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539702912:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.434148:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.434181:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533648512 00000100:00100000:3.0:1790771165.434189:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533648512 00000100:00100000:2.0:1790771165.434191:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.434225:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533649280 00000100:00100000:3.0:1790771165.434230:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533649280 00000100:00100000:3.0:1790771165.434261:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533650816 00000100:00100000:3.0:1790771165.434264:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533650816 00000100:00100000:2.0:1790771165.434276:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06375880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539703040:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.434282:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533645312 00000100:00100000:3.0:1790771165.434287:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533645312 00000100:00100000:3.0:1790771165.434315:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5344 00000100:00100000:3.0:1790771165.434328:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14017:x1877759533648512:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771165.434360:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a0cc lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434409:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.434414:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.434428:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0a1c8 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a1a expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.434471:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.434542:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533645568 00000100:00100000:2.0:1790771165.434548:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533645568 00002000:00100000:2.0:1790771165.434581:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (413696->417791) req@ffff8bfb06376680 x1877759533645568/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.434604:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06376680 with x1877759533645568 ext(413696->417791) 00002000:00010000:2.0:1790771165.434612:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06376680 00000100:00100000:2.0:1790771165.434638:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 348 00000100:00100000:2.0:1790771165.434650:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759533645568:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1790771165.434677:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434717:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434726:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434739:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434747:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434766:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.434790:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2f:0x0]: returning size 2 00010000:00010000:3.0:1790771165.434802:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.434810:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759533645568:12345-192.168.204.50@tcp:3:cat.0 Request processed in 158us (334us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.434813:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.434824:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 348 00010000:00010000:3.0:1790771165.434834:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.434844:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (413696->417791) req@ffff8bfb06376680 x1877759533645568/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.434855:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594200 already unused, calling callback (ffffffffc18aa4f0) 00002000:00100000:2.0:1790771165.434862:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06376680 with x1877759533645568 ext(413696->417791) 00010000:00010000:3.0:1790771165.434862:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.434870:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06376680 00010000:00010000:3.0:1790771165.434889:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.434900:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a0cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434901:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.434908:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.434914:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.434918:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a0cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434935:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0a1dd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434959:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434969:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434978:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434985:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.434991:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.434998:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435012:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.435019:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.435024:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435029:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0a1e4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435060:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0a1c8 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a1a expref: 71 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435074:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.435080:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.435087:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0a1c8 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a1a expref: 71 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435102:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595a00, rc 0) 00000100:00100000:3.0:1790771165.435137:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14017:x1877759533648512:12345-192.168.204.50@tcp:101:dd.0 Request processed in 810us (1143us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.435146:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5344 00000100:00100000:3.0:1790771165.435170:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5346 00000100:00100000:3.0:1790771165.435180:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14395:x1877759533650816:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771165.435189:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.435200:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0a1eb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a4b expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435258:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0a1f2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435267:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0a1f2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435277:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0a1f2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.435283:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x67:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.435346:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0a1eb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a4b expref: 73 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435360:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0a1f2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x67:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a4b expref: 72 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.435366:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:3.0:1790771165.435369:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.435371:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:3.0:1790771165.435395:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14395:x1877759533650816:12345-192.168.204.50@tcp:101:rm.0 Request processed in 218us (1253us total) trans 4294968516 rc 0/0 00000100:00100000:3.0:1790771165.435415:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5346 00000100:00100000:3.0:1790771165.435612:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.435643:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b01180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703296:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.435727:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533646336 00000100:00100000:3.0:1790771165.435732:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533646336 00000100:00100000:2.0:1790771165.435785:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5349 00000100:00100000:2.0:1790771165.435794:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14151:x1877759533646336:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1790771165.435802:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.435813:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a207 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e349fe expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.435859:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.435869:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.435875:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533646464 00010000:00010000:2.0:1790771165.435877:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.435880:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533646464 00010000:00010000:2.0:1790771165.435899:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.435910:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.435918:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436014:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f09f21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3492c expref: 151 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436077:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436089:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1476 00010000:00010000:2.0:1790771165.436093:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436104:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:2396:x1877759533646464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.436112:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436121:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:2.0:1790771165.436130:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x4d:0x0]: returning size 8 00010000:00010000:3.0:1790771165.436130:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f09f21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3492c expref: 151 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436146:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f09f21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3492c expref: 151 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.436150:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436160:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436163:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f09f21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3492c expref: 151 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436172:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436179:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436181:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.436184:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.436188:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436189:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436207:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.436211:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436228:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.436233:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.436237:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:2396:x1877759533646464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 136us (469us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.436238:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a200 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436254:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1476 00010000:00010000:2.0:1790771165.436260:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436266:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a20e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436280:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436290:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436302:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436315:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d15c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8425:1877759539703168:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771165.436318:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.436325:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436330:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436337:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x391d5834 (ffff8bfc2900aa00) 00010000:00010000:3.0:1790771165.436339:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.436340:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.436344:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436348:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a215 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436362:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2396:x1877759533639680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51302us (51495us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.436370:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1470 00010000:00010000:2.0:1790771165.436388:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a207 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436413:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533647104 00010000:00010000:2.0:1790771165.436417:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 111 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436419:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533647104 00010000:00010000:2.0:1790771165.436429:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4d:0x0].0x0 (ffff8bfc2900ac00) 00010000:00010000:2.0:1790771165.436434:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.436438:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 151 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436439:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56000, rc 0) 00000100:00100000:2.0:1790771165.436469:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14151:x1877759533646336:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 676us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.436475:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1478 00000100:00100000:3.0:1790771165.436522:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:2397:x1877759533647104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.436531:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5349 00010000:00010000:3.0:1790771165.436538:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.436545:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 151 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.436554:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533647232 00000100:00100000:2.0:1790771165.436563:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533647232 00010000:00010000:3.0:1790771165.436575:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 152 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436589:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.436593:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.436597:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533647488 00010000:00010000:3.0:1790771165.436599:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50290000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.436603:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533647488 00010000:00010000:3.0:1790771165.436614:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50290000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436634:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.436639:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5351 00000100:00100000:2.0:1790771165.436656:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13789:x1877759533647232:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:3.0:1790771165.436659:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:2397:x1877759533647104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 172us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.436670:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1478 00010000:00010000:2.0:1790771165.436707:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.436726:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f09d8b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34582 expref: 150 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436745:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0a22a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436749:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:2.0:1790771165.436760:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.436763:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0a22a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436771:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0a22a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436784:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436805:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 149 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.436806:0:13769:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969070 00010000:00010000:2.0:1790771165.436818:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.436827:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006765d92c reply state 000000000e9b4617 transno 4294969072 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0a22a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436841:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0a22a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.436844:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 149 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.436852:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:3.0:1790771165.436856:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.436859:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 149 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.436860:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771165.436871:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06375880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539706112:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.436911:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+152:14561:x1877759533645312:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 1707us (2725us total) trans 4294969072 rc 0/0 00000100:00100000:2.0:1790771165.436914:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.436986:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5347 00000020:00080000:3.0:1790771165.436990:0:13769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771165.437010:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533647872 00000100:00100000:3.0:1790771165.437013:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533647872 00000100:00100000:3.0:1790771165.437099:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5353 00010000:00010000:2.0:1790771165.437101:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f09ecd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34917 expref: 149 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.437111:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:11972:x1877759533648000:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.437120:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.437131:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0a23f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a05 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437146:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cdf80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703424:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.437182:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437183:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f09e2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348df expref: 148 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437210:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437218:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cce00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703552:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.437234:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437242:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000003514e9e1 x1877759539703680) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f09a7b lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346d9 expref: 147 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.437263:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.437269:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.437282:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437302:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f09a7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346d9 expref: 147 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437318:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0a23f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a05 expref: 75 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437320:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703680:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437339:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000007b626db7 x1877759539703808) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f09a74 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346d2 expref: 146 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437342:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a05 expref: 74 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437363:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.437364:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f09a74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346d2 expref: 146 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437368:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.437374:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81800, rc 0) 00000100:00100000:2.0:1790771165.437384:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f6300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437404:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000006201a36c x1877759539703936) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f09963 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a8 expref: 145 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.437406:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:11972:x1877759533648000:12345-192.168.204.50@tcp:101:ls.0 Request processed in 297us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.437426:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5353 00010000:00010000:2.0:1790771165.437427:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f09963 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a8 expref: 145 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437443:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f5880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539703936:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437455:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000a9602e23 x1877759539704064) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09955 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3469a expref: 144 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437464:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f09955 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3469a expref: 144 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437481:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f6680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704064:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437525:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000023b7cd43 x1877759539704192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f098bb lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34638 expref: 143 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437534:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f098bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34638 expref: 143 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437552:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704192:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437571:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000ceef5526 x1877759539704320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f098ad lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34631 expref: 142 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437587:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f098ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34631 expref: 142 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437599:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704320:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437621:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000008e688dd6 x1877759539704448) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0986e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3462a expref: 141 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437630:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0986e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3462a expref: 141 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437641:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b2300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704448:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437658:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000171d5685 x1877759539704576) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f097db lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34615 expref: 140 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437668:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f097db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34615 expref: 140 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437677:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704576:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437707:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000271324fa x1877759539704704) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0979c lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3460e expref: 139 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437722:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0979c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3460e expref: 139 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437732:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704704:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437747:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000002da0655d x1877759539704832) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f09795 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34607 expref: 138 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437755:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f09795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34607 expref: 138 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437764:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704832:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437782:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000a2dcb06e x1877759539704960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f09779 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34600 expref: 137 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437795:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f09779 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34600 expref: 137 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437803:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539704960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.437818:0:13785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000013643871 x1877759539705088) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f09772 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f9 expref: 136 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437827:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f09772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345f9 expref: 136 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.437838:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539705088:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.437863:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533649024 00000100:00100000:3.0:1790771165.437868:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533649024 00000100:00100000:3.0:1790771165.437913:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5357 00000100:00100000:3.0:1790771165.437924:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14436:x1877759533648640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771165.437930:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771165.437933:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.437944:0:13785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437944:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a269 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a21 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437972:0:13785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.437988:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.437995:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438010:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438027:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438030:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438049:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438055:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.438082:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000004:00200000:3.0:1790771165.438088:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.438090:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438100:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.438103:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438112:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438128:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438186:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a269 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a21 expref: 78 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438188:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438215:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0990f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e345eb expref: 153 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438222:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a21 expref: 77 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438225:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f09b62 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34749 expref: 136 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438238:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771165.438246:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.438250:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 136 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438252:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cae600, rc 0) 00010000:00010000:2.0:1790771165.438266:0:13785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 6/0,1 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.438284:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14436:x1877759533648640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 361us (520us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.438289:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 136 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.438302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5357 00010000:00010000:2.0:1790771165.438317:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 136 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.438327:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06376d80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539706496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.438336:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1350 00000100:00100000:3.0:1790771165.438354:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14380:x1877759533649664:12345-192.168.204.50@tcp:35:timeout.0 00010000:00010000:2.0:1790771165.438368:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f09b62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34749 expref: 136 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438378:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f09b62 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34749 expref: 136 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.438392:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3e8f5500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539706624:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.438429:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0990f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345eb expref: 154 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.438443:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0990f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e345eb expref: 154 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.438452:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3e8f4700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539706752:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.438458:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14380:x1877759533649664:12345-192.168.204.50@tcp:35:timeout.0 Request processed in 108us (346us total) trans 4294969074 rc 0/0 00000100:00100000:2.0:1790771165.438474:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.438477:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1350 00000100:00100000:3.0:1790771165.438553:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.438625:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.438649:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533649792 00000100:00100000:3.0:1790771165.438655:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533649792 00000100:00100000:2.0:1790771165.438705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.438712:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:3.0:1790771165.438729:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:13210:x1877759533649792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771165.438736:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.438748:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a36 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438771:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 27 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438780:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x14:0x0].0x0 since=1s v=(12 1) 00010000:00010000:3.0:1790771165.438784:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(13 1) 00010000:00010000:3.0:1790771165.438789:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a36 expref: 21 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.438814:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 27 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.438822:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969069 is committed 00010000:00010000:3.0:1790771165.438825:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 27 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.438839:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969066 is committed 00000020:00080000:2.0:1790771165.438861:0:6473:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc05653cc0 refcount 2 committed 0 result -61 batchid 45 00000020:00080000:2.0:1790771165.438869:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4cc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -61 sub_th ffff8bfc1af8db40 00000020:00080000:2.0:1790771165.438881:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05d94000 00000100:00100000:3.0:1790771165.438881:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05796680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12031:1877759539706880:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.438934:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.438953:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533650304 00000100:00100000:3.0:1790771165.438960:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533650304 00000020:00080000:2.0:1790771165.438991:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 42 00000100:00100000:3.0:1790771165.438995:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5359 00000100:00100000:3.0:1790771165.439011:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14516:x1877759533650304:12345-192.168.204.50@tcp:101:chmod.0 00000004:00010000:2.0:1790771165.439012:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eca81e15 reply state 00000000d48c8e85 transno 4294969069 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a0cc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.439027:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.439037:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caf600/0xfa0c505d97f0a2a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a44 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439039:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a0cc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439066:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:2.0:1790771165.439069:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.439074:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771165.439080:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.439083:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caf600/0xfa0c505d97f0a2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a44 expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.439098:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caf600/0xfa0c505d97f0a2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a44 expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790771165.439112:0:7771:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771165.439123:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14425:x1877759533637632:12345-192.168.204.50@tcp:36:chown.0 Request processed in 56418us (56549us total) trans 4294969069 rc 0/0 00010000:00010000:3.0:1790771165.439127:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771165.439136:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771165.439143:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caf600, rc 0) 00000100:00100000:2.0:1790771165.439145:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5327 00000100:00100000:3.0:1790771165.439168:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14516:x1877759533650304:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 161us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.439181:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5359 00000100:00100000:2.0:1790771165.439372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.439408:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.439428:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533650944 00000100:00100000:2.0:1790771165.439434:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533650944 00000100:00100000:3.0:1790771165.439445:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533650560 00000100:00100000:3.0:1790771165.439451:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533650560 00000100:00100000:2.0:1790771165.439466:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:2.0:1790771165.439479:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:13763:x1877759533650944:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1790771165.439509:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.439521:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a52 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.439534:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1351 00000100:00100000:3.0:1790771165.439552:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13566:x1877759533650560:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771165.439554:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439581:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xe:0x0].0x0 since=2s v=(4 0) 00010000:00010000:2.0:1790771165.439590:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(1 4) 00010000:00010000:2.0:1790771165.439601:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439636:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439656:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 21 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.439669:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13566:x1877759533650560:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (294us total) trans 4294969075 rc 0/0 00000100:00100000:2.0:1790771165.439673:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539707008:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.439708:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1351 00000100:00100000:2.0:1790771165.439732:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.439756:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.439799:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533650176 00000100:00100000:3.0:1790771165.439805:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533650176 00000100:00100000:2.0:1790771165.439841:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.439862:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533651072 00000100:00100000:2.0:1790771165.439869:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533651072 00000100:00100000:3.0:1790771165.439881:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 351 00000100:00100000:3.0:1790771165.439898:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533650176:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:2.0:1790771165.439900:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 855 00000100:00100000:2.0:1790771165.439916:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:14010:x1877759533651072:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771165.439928:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.439939:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a59 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.439975:0:13796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 21 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440006:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x13:0x0].0x0 since=1s v=(0 2) 00010000:00010000:2.0:1790771165.440014:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 2) 00010000:00010000:2.0:1790771165.440024:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 25 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.440030:0:13795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 38336 -> 4232640 00002000:00010000:3.0:1790771165.440039:0:13795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1674053537 -> 1790771165 00002000:00010000:3.0:1790771165.440047:0:13795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771163 -> 1752421453 00002000:00010000:3.0:1790771165.440056:0:13795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:3.0:1790771165.440064:0:13795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 80 -> 8272 00010000:00010000:2.0:1790771165.440065:0:13796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 21 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440088:0:13796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 21 pid: 13787 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440100:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533650176:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 205us (341us total) trans 4294967566 rc 0/0 00000100:00100000:2.0:1790771165.440125:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539707136:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.440125:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 351 00000100:00100000:2.0:1790771165.440157:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.440196:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.440234:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533651200 00000100:00100000:2.0:1790771165.440241:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533651200 00000100:00100000:2.0:1790771165.440277:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5360 00000100:00100000:2.0:1790771165.440290:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14203:x1877759533651200:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771165.440303:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.440317:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0a2bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a60 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440322:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.440342:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533651328 00000100:00100000:3.0:1790771165.440348:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533651328 00010000:00010000:2.0:1790771165.440355:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440376:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5361 00000100:00100000:3.0:1790771165.440391:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14186:x1877759533651328:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771165.440400:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440407:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.440418:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0a2cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a67 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440422:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440509:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440532:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440539:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0a2bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 107 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440553:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440571:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 106 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440580:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:3.0:1790771165.440582:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440587:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.440592:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104e00, rc 0) 00010000:00010000:3.0:1790771165.440602:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440620:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.440626:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14203:x1877759533651200:12345-192.168.204.50@tcp:101:cp.0 Request processed in 338us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.440641:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5360 00010000:00010000:3.0:1790771165.440659:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440712:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440722:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440770:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533651840 00000100:00100000:3.0:1790771165.440776:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533651840 00000004:00200000:2.0:1790771165.440779:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.440782:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.440795:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440807:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440813:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440823:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440828:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440838:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.440843:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440847:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5363 00010000:00010000:2.0:1790771165.440856:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.440864:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14507:x1877759533651968:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.440870:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.440874:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.440875:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.440881:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440887:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a2d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440887:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a2e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a75 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440913:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440920:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440925:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440931:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.440934:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440940:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440949:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfc20109b00) 00010000:00010000:3.0:1790771165.440949:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440956:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.440961:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440976:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.440977:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a2d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.440999:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.441014:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.441018:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.441022:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0a2cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a67 expref: 108 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.441030:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441054:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a67 expref: 107 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441065:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a2e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a75 expref: 122 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441073:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:2.0:1790771165.441081:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.441086:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0c00, rc 0) 00010000:00010000:3.0:1790771165.441099:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a75 expref: 121 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.441117:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14186:x1877759533651328:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 726us (797us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.441127:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771165.441136:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.441139:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5361 00010000:00010000:3.0:1790771165.441142:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668600, rc 0) 00000100:00100000:3.0:1790771165.441173:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14507:x1877759533651968:12345-192.168.204.50@tcp:101:chown.0 Request processed in 314us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.441185:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5363 00000100:00100000:2.0:1790771165.441192:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5365 00000100:00100000:2.0:1790771165.441201:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13293:x1877759533651840:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.441208:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.441219:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0a311 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a6e expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.441235:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.441244:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 2/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441253:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0a311 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a6e expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441265:0:13764:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441277:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0a311 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a6e expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.441291:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.441292:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.441300:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.441309:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0a311 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a6e expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441330:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105e00, rc 0) 00000100:00100000:3.0:1790771165.441330:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.441351:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533652224 00000100:00100000:2.0:1790771165.441357:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533652224 00000100:00100000:3.0:1790771165.441375:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.441395:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 352 00000100:00100000:3.0:1790771165.441397:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533652480 00000100:00100000:3.0:1790771165.441403:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533652480 00000100:00100000:2.0:1790771165.441411:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533652224:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:3.0:1790771165.441433:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5366 00000100:00100000:3.0:1790771165.441448:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13989:x1877759533652480:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771165.441505:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441514:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441527:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441583:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.441588:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 0 -> 37366 00010000:00010000:3.0:1790771165.441590:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.441592:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1790771165.441597:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771165.441604:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1790771165.441606:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.441608:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 0 -> 32 00010000:00010000:3.0:1790771165.441620:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.441626:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441632:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441643:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771165.441646:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759533652224:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 235us (355us total) trans 4294967568 rc 0/0 00010000:00010000:3.0:1790771165.441651:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.441656:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441666:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0a318 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.441671:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 352 00000100:00100000:3.0:1790771165.441720:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1479 00000100:00100000:2.0:1790771165.441728:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533652736 00000100:00100000:2.0:1790771165.441736:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533652736 00000100:00100000:3.0:1790771165.441736:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533651456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.441749:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790771165.441758:0:13784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb size from disk: 0 -> 10485760 00002000:00010000:3.0:1790771165.441764:0:13784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1790771164 -> 1790771165 00002000:00010000:3.0:1790771165.441767:0:13784:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb blocks from disk: 0 -> 1152 00010000:00010000:3.0:1790771165.441776:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2be602f/0xfa0c505d97f06d10 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9895936->9961471) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3393b expref: 28 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.441779:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533652864 00000100:00100000:2.0:1790771165.441787:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533652864 00010000:00010000:3.0:1790771165.441799:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2be602f/0xfa0c505d97f06d10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9895936->9961471) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3393b expref: 28 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.441822:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5367 00010000:00010000:3.0:1790771165.441827:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2be602f/0xfa0c505d97f06d10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 9895936->9961471) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3393b expref: 28 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.441836:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14026:x1877759533652736:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:3.0:1790771165.441848:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(4 2) 00010000:00010000:3.0:1790771165.441856:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(4 2) 00010000:00010000:3.0:1790771165.441865:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 22 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441878:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 22 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.441911:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 22 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441936:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0a326 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.441937:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29015180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539707264:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771165.441952:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0a326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.441960:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0a326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.441974:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06cd5600 going to sleep for 11 seconds 00000001:00080000:2.0:1790771165.441995:0:12128:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969077 00000100:00100000:3.0:1790771165.442000:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5368 00000100:00100000:3.0:1790771165.442011:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13135:x1877759533652864:12345-192.168.204.50@tcp:36:rm.0 00000004:00010000:2.0:1790771165.442016:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dc254de8 reply state 000000000191f35d transno 4294969078 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0a326 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442029:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0a326 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442031:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790771165.442046:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.442047:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f073d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a45 expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442052:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.442057:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.442071:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f05500 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32d17 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442084:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc113f3900) 00010000:00010000:3.0:1790771165.442095:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.442102:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14026:x1877759533652736:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 270us (482us total) trans 4294969078 rc 0/0 00010000:00010000:3.0:1790771165.442106:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442126:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.442127:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5367 00000020:00080000:2.0:1790771165.442135:0:12128:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790771165.442156:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.442161:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5369 00000100:00100000:2.0:1790771165.442176:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14548:x1877759533653248:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771165.442178:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442187:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.442188:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442201:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0a33b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a83 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442207:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442239:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442249:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442256:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442261:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442269:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442275:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442324:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0a33b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442335:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442340:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 109 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442349:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442351:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.442358:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.442361:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.442362:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3a00, rc 0) 00010000:00010000:3.0:1790771165.442370:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.442373:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442378:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442386:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc20109000) 00010000:00010000:3.0:1790771165.442388:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771165.442390:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442394:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0a349 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.442398:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14548:x1877759533653248:12345-192.168.204.50@tcp:101:chown.0 Request processed in 225us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.442410:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5369 00010000:00010000:3.0:1790771165.442446:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442453:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442458:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442462:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442465:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.442467:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442471:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442523:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.442526:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.442529:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442534:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0a32d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442542:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442546:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442555:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442559:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.442561:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442566:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442570:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfc20109e00) 00010000:00010000:3.0:1790771165.442571:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.442573:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.442576:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0a334 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.442636:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13135:x1877759533652864:12345-192.168.204.50@tcp:36:rm.0 Request processed in 629us (930us total) trans 0 rc -39/-39 00000100:00100000:2.0:1790771165.442641:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5368 00000100:00100000:3.0:1790771165.445614:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533654016 00000100:00100000:3.0:1790771165.445620:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533654016 00000100:00100000:3.0:1790771165.445647:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5370 00000100:00100000:3.0:1790771165.445654:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14277:x1877759533654016:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.445662:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.445671:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0a350 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34a8a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445737:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445746:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445752:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445759:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445764:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445769:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.445783:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.445790:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445794:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445801:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445806:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445809:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.445811:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445815:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445820:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.445822:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.445825:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445828:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391600/0xfa0c505d97f0a357 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445835:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445839:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445843:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445846:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.445849:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445853:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445857:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.445858:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.445860:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445863:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a35e lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445881:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0a350 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a8a expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445887:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.445888:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.445891:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0a350 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a8a expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.445896:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00000100:00100000:3.0:1790771165.445922:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14277:x1877759533654016:12345-192.168.204.50@tcp:101:touch.0 Request processed in 269us (340us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.445927:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5370 00000100:00100000:3.0:1790771165.452384:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533653376 00000100:00100000:3.0:1790771165.452390:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533653376 00010000:00010000:3.0:1790771165.452410:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0a039 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34987 expref: 76 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.452422:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:13763:1877759539705472:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.452452:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:13763:1877759539705600:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.452456:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1481 00000100:00100000:3.0:1790771165.452475:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:2397:x1877759533653376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.452508:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.452517:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0a039 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34987 expref: 76 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.452534:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0a039 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34987 expref: 76 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.452549:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0a039 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34987 expref: 76 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.452561:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.452569:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a200 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.452577:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.452603:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:2397:x1877759533653376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 134us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.452616:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1481 00000100:00100000:2.0:1790771165.452763:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.452815:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533654144 00000100:00100000:3.0:1790771165.452820:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533654144 00000100:00100000:2.0:1790771165.452828:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.452837:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f09e8e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34902 expref: 75 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.452874:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533654272 00000100:00100000:3.0:1790771165.452878:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533654272 00000100:00100000:2.0:1790771165.452934:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.452985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.453023:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.453035:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 76 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453091:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1485 00000100:00100000:2.0:1790771165.453127:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.453148:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:2397:x1877759533654272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.453160:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.453166:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.453176:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 75 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.453185:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.453209:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 75 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.453222:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.453238:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f09e64 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348f4 expref: 75 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453256:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.453261:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a200 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453268:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a200 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453276:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a200 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453294:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.453304:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06375880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539706112:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.453327:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453400:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:2397:x1877759533654272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 297us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.453452:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1485 00000100:00100000:2.0:1790771165.453466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.453519:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533655552 00000100:00100000:2.0:1790771165.453525:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.453526:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533655552 00000100:00100000:2.0:1790771165.453546:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533655424 00010000:00010000:3.0:1790771165.453547:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a14a lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349bf expref: 115 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.453553:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533655424 00010000:00010000:2.0:1790771165.453576:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453579:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1486 00000100:00100000:3.0:1790771165.453594:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533655552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.453612:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.453620:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a14a lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349bf expref: 115 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453630:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a14a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349bf expref: 115 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.453634:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1487 00000100:00100000:2.0:1790771165.453650:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533655424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.453650:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:3.0:1790771165.453659:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.453662:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.453666:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.453669:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453678:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.453701:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.453716:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.453724:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a174 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e2 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453740:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533655552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 148us (274us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.453745:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:2.0:1790771165.453757:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453768:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1486 00010000:00010000:2.0:1790771165.453784:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.453799:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.453822:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.453840:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.453871:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759533655424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.453891:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1487 00000100:00100000:3.0:1790771165.453915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.453931:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533655808 00000100:00100000:2.0:1790771165.453939:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533655808 00010000:00010000:2.0:1790771165.453964:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ed expref: 116 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.454006:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1488 00000100:00100000:2.0:1790771165.454020:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759533655808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.454036:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.454043:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ed expref: 117 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.454056:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f09fde lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ed expref: 117 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.454082:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.454084:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771165.454095:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0a246 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x37:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.454106:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0a246 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.454124:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0a246 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.454157:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.454185:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.454195:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759533655808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.454219:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1488 00000100:00100000:2.0:1790771165.454285:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.454349:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.454376:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533654784 00000100:00100000:2.0:1790771165.454382:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533654784 00000100:00100000:2.0:1790771165.454418:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533655936 00000100:00100000:2.0:1790771165.454425:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533655936 00000040:00080000:3.0:1790771165.454431:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 88 off10568 00000100:00100000:2.0:1790771165.454448:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656064 00000100:00100000:2.0:1790771165.454453:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656064 00000004:00010000:3.0:1790771165.454467:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ccfa32a reply state 0000000089b99f96 transno 4294969081 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.454482:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 858 00010000:00010000:3.0:1790771165.454513:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.454531:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2398:x1877759533654784:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:3.0:1790771165.454536:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771165.454544:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.454548:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.454598:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13789:x1877759533647232:12345-192.168.204.50@tcp:36:chown.0 Request processed in 17946us (18155us total) trans 4294969081 rc 0/0 00002000:00010000:2.0:1790771165.454612:0:13781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4232640 -> 4232640 00000100:00100000:3.0:1790771165.454619:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5351 00002000:00010000:2.0:1790771165.454620:0:13781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.454626:0:13781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771165.454628:0:13781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.454630:0:13781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8272 -> 8272 00000100:00100000:2.0:1790771165.454660:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2398:x1877759533654784:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 132us (1639us total) trans 4294967567 rc 0/0 00000100:00100000:3.0:1790771165.454664:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 859 00000100:00100000:2.0:1790771165.454696:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 858 00000100:00100000:3.0:1790771165.454697:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533655936:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:3.0:1790771165.454711:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.454720:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 860 00010000:00010000:3.0:1790771165.454723:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b60bcbf/0xfa0c505d97f0a3b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34aa6 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.454734:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533656064:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771165.454750:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.454760:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000906829fe/0xfa0c505d97f0a3c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34aad expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.454784:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539707776:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.454809:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539707904:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.454835:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa636c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.454846:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.454886:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.454909:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656192 00000100:00100000:3.0:1790771165.454913:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656192 00000100:00100000:3.0:1790771165.454947:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 701 00000100:00100000:3.0:1790771165.454962:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533656192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.454976:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.454993:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0a277 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a21 expref: 74 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.455012:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771165.455017:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.455025:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455047:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455051:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.455054:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455059:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455066:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc3da48d00) 00010000:00010000:0.0:1790771165.455068:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.455070:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455071:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455088:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0a3b9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455102:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455110:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533656192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 148us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.455114:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455119:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a3a4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a9f expref: 74 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455132:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a3c7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a9f expref: 73 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455138:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2f:0x0].0x0 (ffff8bfc3da48a00) 00010000:00010000:0.0:1790771165.455140:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.455142:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00010000:00010000:2.0:1790771165.455157:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455166:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455171:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 701 00010000:00010000:2.0:1790771165.455174:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.455180:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13894:x1877759533655296:12345-192.168.204.50@tcp:101:rm.0 Request processed in 586us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.455191:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5376 00000004:00200000:2.0:1790771165.455200:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 0 00000004:00200000:2.0:1790771165.455205:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.455214:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455222:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455228:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455234:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455238:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455246:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455251:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.455253:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455258:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455266:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:2.0:1790771165.455268:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.455271:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455276:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a381 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455285:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.455293:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.455298:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455304:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455308:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.455311:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455315:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656320 00000100:00100000:3.0:1790771165.455320:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656320 00010000:00010000:2.0:1790771165.455323:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455337:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0xcdd6ff3 (ffff8bfc2900aa00) 00010000:00010000:2.0:1790771165.455343:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.455344:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.455350:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455359:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656448 00010000:00010000:2.0:1790771165.455363:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a3ce lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455363:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656448 00010000:00010000:3.0:1790771165.455380:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455407:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1489 00010000:00010000:2.0:1790771165.455415:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a37a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.455421:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533656448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.455425:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 702 00000100:00100000:0.0:1790771165.455442:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:2397:x1877759533656320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.455444:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.455451:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 113 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.455453:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.455457:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.455473:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0a25b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a0c expref: 72 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455479:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:0.0:1790771165.455510:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.455510:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.455514:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.455517:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.455519:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00010000:00010000:3.0:1790771165.455533:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f09c5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e347c7 expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.455544:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533656320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.455545:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771165.455553:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.455556:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14151:x1877759533655040:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 1844us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.455559:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 702 00010000:00010000:3.0:1790771165.455572:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.455579:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5374 00010000:00010000:3.0:1790771165.455581:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.455614:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759533656448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 200us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.455620:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1489 00000100:00100000:0.0:1790771165.463529:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.463609:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.463631:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.463665:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.463693:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05796680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12031:1877759539706880:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.463704:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539707008:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.463707:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656960 00000100:00100000:0.0:1790771165.463713:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656960 00002000:00010000:0.0:1790771165.463732:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/19 (3866624->18446744073709551615) 00010000:00010000:2.0:1790771165.463734:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 25 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.463736:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04971880 with x1877759533656960 ext(3866624->18446744073709551615) 00002000:00010000:0.0:1790771165.463749:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb04971880. 00010000:00010000:3.0:1790771165.463755:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a36 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.463780:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 353 00010000:00010000:3.0:1790771165.463786:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caf000, rc 0) 00010000:00010000:2.0:1790771165.463787:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105200, rc 0) 00000100:00100000:0.0:1790771165.463797:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533656960:12345-192.168.204.50@tcp:10:dd.0 00000100:00100000:3.0:1790771165.463820:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:13210:x1877759533649792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 25095us (25266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.463829:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:13763:x1877759533650944:12345-192.168.204.50@tcp:101:cat.0 Request processed in 24354us (24424us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.463830:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:2.0:1790771165.463841:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:3.0:1790771165.463874:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657344 00000100:00100000:3.0:1790771165.463880:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657344 00002000:00010000:0.0:1790771165.463914:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb size from disk: 0 -> 3866624 00000100:00100000:2.0:1790771165.463915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771165.463921:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb mtime from disk: 0 -> 1790771165 00000100:00100000:3.0:1790771165.463922:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5377 00002000:00010000:0.0:1790771165.463928:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.463931:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb ctime from disk: 0 -> 1790771165 00002000:00010000:0.0:1790771165.463933:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771165.463962:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533656960:12345-192.168.204.50@tcp:10:dd.0 Request processed in 169us (296us total) trans 4294967570 rc 0/0 00000100:00100000:2.0:1790771165.463977:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.463982:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 353 00002000:00010000:0.0:1790771165.463986:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/19 (3866624->18446744073709551615) 00002000:00100000:0.0:1790771165.463991:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04971880 with x1877759533656960 ext(3866624->18446744073709551615) 00002000:00010000:0.0:1790771165.463999:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb04971880. 00000100:00100000:3.0:1790771165.464007:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657088 00000100:00100000:3.0:1790771165.464012:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657088 00000100:00100000:0.0:1790771165.464028:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533656832 00000100:00100000:2.0:1790771165.464030:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:3.0:1790771165.464033:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/20 (3145728->18446744073709551615) 00000100:00100000:0.0:1790771165.464035:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533656832 00002000:00100000:3.0:1790771165.464041:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05d66680 with x1877759533657088 ext(3145728->18446744073709551615) 00002000:00010000:3.0:1790771165.464049:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05d66680. 00000100:00100000:0.0:1790771165.464071:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657472 00000100:00100000:0.0:1790771165.464075:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657472 00000100:00100000:2.0:1790771165.464080:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.464081:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 354 00000100:00100000:3.0:1790771165.464097:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533657088:12345-192.168.204.50@tcp:10:dd.0 00000100:00100000:0.0:1790771165.464106:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 861 00000100:00100000:0.0:1790771165.464117:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533656832:12345-192.168.204.50@tcp:2:touch.0 00000100:00100000:2.0:1790771165.464127:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.464158:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657728 00000100:00100000:2.0:1790771165.464164:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657728 00002000:00100000:2.0:1790771165.464197:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x14:0x0] (6225920->9240575) req@ffff8bfb05d65500 x1877759533657728/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.464210:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05d65500 with x1877759533657728 ext(6225920->9240575) 00000100:00100000:0.0:1790771165.464213:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2399:x1877759533656832:12345-192.168.204.50@tcp:2:touch.0 Request processed in 97us (298us total) trans 4294967568 rc 0/0 00002000:00010000:3.0:1790771165.464214:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x14:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1790771165.464221:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x14:0x0] updating lvb mtime from disk: 0 -> 1790771165 00010000:00010000:2.0:1790771165.464222:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 29 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.464225:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x14:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1790771165.464228:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 861 00002000:00010000:3.0:1790771165.464232:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x14:0x0] updating lvb ctime from disk: 0 -> 1790771165 00002000:00010000:3.0:1790771165.464238:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x14:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771165.464246:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 862 00010000:00010000:2.0:1790771165.464253:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 29 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.464255:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2397:x1877759533657472:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:3.0:1790771165.464270:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533657088:12345-192.168.204.50@tcp:10:dd.0 Request processed in 177us (296us total) trans 4294967569 rc 0/0 00002000:00010000:2.0:1790771165.464273:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb05d65500 00000100:00100000:3.0:1790771165.464280:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 354 00002000:00010000:3.0:1790771165.464284:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/20 (3145728->18446744073709551615) 00002000:00100000:3.0:1790771165.464287:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05d66680 with x1877759533657088 ext(3145728->18446744073709551615) 00002000:00010000:3.0:1790771165.464291:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05d66680. 00000100:00100000:2.0:1790771165.464306:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 77 00000100:00100000:2.0:1790771165.464321:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2397:x1877759533657728:12345-192.168.204.50@tcp:4:dd.0 00002000:00010000:0.0:1790771165.464325:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb size from disk: 5844 -> 5844 00002000:00010000:0.0:1790771165.464329:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:0.0:1790771165.464332:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb atime from disk: 1790771159 -> 0 00000100:00100000:3.0:1790771165.464336:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13959:x1877759533657344:12345-192.168.204.50@tcp:36:mcreate.0 00002000:00010000:0.0:1790771165.464337:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:0.0:1790771165.464343:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771165.464367:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2397:x1877759533657472:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 114us (340us total) trans 4294967570 rc 0/0 00000100:00100000:0.0:1790771165.464373:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 862 00000100:00100000:0.0:1790771165.464400:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657984 00000100:00100000:0.0:1790771165.464404:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657984 00000100:00100000:3.0:1790771165.464426:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13959:x1877759533657344:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 438us (816us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771165.464431:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1352 00000100:00100000:3.0:1790771165.464443:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5377 00000100:00100000:0.0:1790771165.464445:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11371c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13196:x1877759533657984:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771165.464554:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.464573:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11371c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13196:x1877759533657984:12345-192.168.204.50@tcp:35:ls.0 Request processed in 129us (494us total) trans 4294969083 rc 0/0 00000100:00100000:3.0:1790771165.464579:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533658368 00000100:00100000:3.0:1790771165.464584:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533658368 00000100:00100000:0.0:1790771165.464586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1352 00000100:00100000:3.0:1790771165.464620:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1353 00000100:00100000:3.0:1790771165.464633:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14217:x1877759533658368:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:0.0:1790771165.464661:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.464694:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533658496 00000100:00100000:0.0:1790771165.464700:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533658496 00000100:00100000:0.0:1790771165.464734:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5378 00000100:00100000:0.0:1790771165.464744:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14110:x1877759533658496:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771165.464754:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.464767:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a3e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ab4 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.464786:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14217:x1877759533658368:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 154us (236us total) trans 4294969084 rc 0/0 00000100:00100000:3.0:1790771165.464792:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1353 00010000:00010000:0.0:1790771165.464807:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x85:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ab4 expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.464827:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x85:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ab4 expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.464846:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771165.464849:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771165.464852:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:0.0:1790771165.464886:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14110:x1877759533658496:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 143us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.464894:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5378 00000100:00100000:0.0:1790771165.464913:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533658752 00000100:00100000:0.0:1790771165.464917:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533658752 00000100:00100000:0.0:1790771165.464951:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5379 00000100:00100000:0.0:1790771165.464964:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14043:x1877759533658752:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:0.0:1790771165.465258:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533657600 00000100:00100000:0.0:1790771165.465262:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533657600 00010000:00010000:0.0:1790771165.465281:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 27 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.465311:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1493 00000100:00100000:3.0:1790771165.465315:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533659136 00000100:00100000:0.0:1790771165.465320:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2398:x1877759533657600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.465321:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533659136 00010000:00010000:0.0:1790771165.465332:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790771165.465341:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 64 -> 72 00010000:00010000:0.0:1790771165.465347:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 27 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465356:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 27 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465375:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f03985 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32592 expref: 27 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465387:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(1 4) 00010000:00010000:0.0:1790771165.465390:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(1 4) 00000100:00100000:3.0:1790771165.465394:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1354 00010000:00010000:0.0:1790771165.465399:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.465406:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13208:x1877759533659136:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771165.465409:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465435:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.465444:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539708288:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771165.465527:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.465530:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29015180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539707264:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771165.465547:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1790771165.465560:0:13787:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x15:0x0] updating lvb atime: 0 -> 1790771161 00000100:00100000:3.0:1790771165.465574:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533651456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 23842us (24342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.465581:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1479 00000100:00100000:0.0:1790771165.465662:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13787:1877759539707392:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.465702:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001aa462e7/0xfa0c505d97f0a31f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a7c expref: 26 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465716:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aa462e7/0xfa0c505d97f0a31f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a7c expref: 26 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465730:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592a00, rc 0) 00000100:00100000:3.0:1790771165.465745:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533659264 00000100:00100000:3.0:1790771165.465750:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533659264 00000100:00100000:0.0:1790771165.465764:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533653120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 23905us (23990us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.465773:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 857 00000100:00100000:0.0:1790771165.465802:0:13792:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533659520 00000100:00100000:0.0:1790771165.465807:0:13792:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533659520 00000100:00100000:3.0:1790771165.465824:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 863 00000100:00100000:3.0:1790771165.465835:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14346:x1877759533659264:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:3.0:1790771165.465843:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.465848:0:13792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 32 00010000:00010000:3.0:1790771165.465852:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34abb expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.465860:0:13792:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14186:x1877759533659520:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:3.0:1790771165.465880:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 23 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465889:0:13792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771165.465906:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a2e0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a67 expref: 113 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.465910:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x19:0x0].0x0 since=0s v=(2 2) 00010000:00010000:3.0:1790771165.465920:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(3 2) 00010000:00010000:3.0:1790771165.465927:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 4/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 26 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465934:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f00b8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e314a5 expref: 112 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465955:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:3.0:1790771165.465965:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 23 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465966:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0a190 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349db expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465988:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.465993:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 23 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.465994:0:13792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.466007:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539708416:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.466009:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466019:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466026:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.466036:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63300 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.466039:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466049:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466059:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466070:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466081:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466087:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466138:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466158:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466167:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 123 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466173:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466178:0:13792:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 6/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466198:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466206:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 123 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.466229:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708544:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.466273:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 123 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466281:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 123 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.466289:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708672:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.466317:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.466326:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 123 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.466333:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03023b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708800:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.466352:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94180 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.466574:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.466652:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.466705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.466771:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533660288 00000100:00100000:0.0:1790771165.466773:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.466814:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.466844:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533660288 00000100:00100000:0.0:1790771165.466854:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533660544 00000100:00100000:0.0:1790771165.466861:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533660544 00000100:00100000:3.0:1790771165.466898:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533660672 00000100:00100000:0.0:1790771165.466900:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533660928 00000100:00100000:3.0:1790771165.466903:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533660672 00000100:00100000:0.0:1790771165.466906:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533660928 00000100:00100000:0.0:1790771165.466946:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5383 00000100:00100000:0.0:1790771165.466959:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14065:x1877759533660544:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:3.0:1790771165.466964:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5384 00000100:00100000:3.0:1790771165.466980:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14138:x1877759533660928:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:3.0:1790771165.467059:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14138:x1877759533660928:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 82us (247us total) trans 0 rc -17/-17 00010000:00010000:0.0:1790771165.467061:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467075:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5384 00010000:00010000:0.0:1790771165.467084:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467095:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.467128:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969084 is committed 00000001:00080000:0.0:1790771165.467133:0:13765:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969086 00000001:00080000:3.0:1790771165.467141:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969083 is committed 00000004:00010000:0.0:1790771165.467165:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d7b22be9 reply state 00000000fae99e44 transno 4294969087 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467179:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467188:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.467191:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.467195:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771165.467209:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5386 00000100:00100000:2.0:1790771165.467225:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13353:x1877759533660288:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771165.467237:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.467251:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14065:x1877759533660544:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 295us (579us total) trans 4294969087 rc 0/0 00010000:00010000:2.0:1790771165.467253:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a44c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ac9 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.467280:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5383 00000020:00080000:0.0:1790771165.467287:0:13765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771165.467311:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467319:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467332:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467338:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c72800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.467343:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467345:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467367:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467372:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467378:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.467386:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.467397:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467399:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467399:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14043:x1877759533658752:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 2431us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.467422:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5379 00010000:00010000:0.0:1790771165.467427:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0a21c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467428:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467453:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467458:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467467:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467501:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467523:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467536:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78c00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771165.467538:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00010000:00010000:0.0:1790771165.467540:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467551:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467553:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467574:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467575:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0xea196397 (ffff8bfb03188900) 00010000:00010000:0.0:1790771165.467582:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.467587:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467597:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467598:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a303 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467615:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.467629:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467632:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467635:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533661184 00000100:00100000:3.0:1790771165.467641:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533661184 00010000:00010000:0.0:1790771165.467649:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467653:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.467660:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467661:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467670:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5387 00010000:00010000:2.0:1790771165.467693:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467696:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.467702:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14287:x1877759533661184:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:0.0:1790771165.467703:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467720:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.467723:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467726:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.467733:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.467740:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467747:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00010000:00010000:2.0:1790771165.467754:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a453 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467757:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.467766:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.467769:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467772:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467787:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a30a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467794:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.467796:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467816:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467817:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.467832:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467836:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467837:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.467844:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.467849:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 114 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467851:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467876:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.467885:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539708928:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.467888:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467888:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467912:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03188600) 00010000:00010000:0.0:1790771165.467915:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467916:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.467923:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.467924:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63d80 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.467928:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771165.467934:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.467939:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467945:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a45a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467965:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78e00/0xfa0c505d97f0a365 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.467982:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.467989:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a44c lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ac9 expref: 73 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.468001:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468010:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.468017:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.468022:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468024:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a44c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ac9 expref: 73 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.468035:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.468041:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468047:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2c00, rc 0) 00010000:00010000:0.0:1790771165.468059:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.468080:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:2.0:1790771165.468080:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13353:x1877759533660288:12345-192.168.204.50@tcp:101:cp.0 Request processed in 859us (1428us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.468088:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.468093:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.468098:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5386 00010000:00010000:0.0:1790771165.468109:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a231 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.468231:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.468253:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.468267:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533661440 00000100:00100000:2.0:1790771165.468272:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533661440 00000100:00100000:0.0:1790771165.468286:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533661568 00000100:00100000:0.0:1790771165.468291:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533661568 00000100:00100000:2.0:1790771165.468304:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5388 00000100:00100000:2.0:1790771165.468313:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14145:x1877759533661440:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:2.0:1790771165.468398:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468415:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468426:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.468450:0:6495:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969088 00000004:00010000:2.0:1790771165.468466:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000062e37dee reply state 00000000a03035aa transno 4294969089 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468479:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.468518:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771165.468521:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.468524:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771165.468576:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14145:x1877759533661440:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 263us (343us total) trans 4294969089 rc 0/0 00000100:00100000:2.0:1790771165.468586:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5388 00000020:00080000:2.0:1790771165.468592:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771165.473849:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.473875:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.473881:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04973b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539707648:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.473904:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.473912:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533661696 00000100:00100000:2.0:1790771165.473919:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533661696 00002000:00010000:3.0:1790771165.473932:0:8406:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime: 0 -> 1790771159 00010000:00010000:2.0:1790771165.473939:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f09f6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3496b expref: 119 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.473946:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539707776:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.473972:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b60bcbf/0xfa0c505d97f0a3b2 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aa6 expref: 27 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.473983:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1494 00010000:00010000:3.0:1790771165.473995:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b60bcbf/0xfa0c505d97f0a3b2 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aa6 expref: 27 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.473997:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2397:x1877759533661696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.474021:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.474021:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81600, rc 0) 00010000:00010000:2.0:1790771165.474030:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f09f6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3496b expref: 119 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474046:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f09f6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3496b expref: 119 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.474059:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533655936:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 19381us (19775us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.474070:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f09f6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3496b expref: 119 pid: 13764 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.474076:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 859 00010000:00010000:2.0:1790771165.474095:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.474102:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474112:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.474118:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.474127:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474156:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.474166:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533662080 00000100:00100000:3.0:1790771165.474171:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533662080 00000100:00100000:0.0:1790771165.474196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.474203:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2397:x1877759533661696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 207us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.474215:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1494 00010000:00010000:3.0:1790771165.474252:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 27 pid: 13787 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.474264:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.474271:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539707904:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.474281:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1495 00000100:00100000:0.0:1790771165.474302:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.474304:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000906829fe/0xfa0c505d97f0a3c0 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aad expref: 25 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.474323:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533662080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.474334:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533662336 00010000:00010000:2.0:1790771165.474335:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000906829fe/0xfa0c505d97f0a3c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aad expref: 25 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474335:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.474340:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533662336 00010000:00010000:3.0:1790771165.474350:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 27 pid: 13787 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474357:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2600, rc 0) 00010000:00010000:3.0:1790771165.474363:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 27 pid: 13787 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.474368:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533662720 00000100:00100000:0.0:1790771165.474373:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533662720 00010000:00010000:3.0:1790771165.474378:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000855564e/0xfa0c505d97f079dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c52 expref: 27 pid: 13787 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474390:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1790771165.474393:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1790771165.474399:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.474407:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533656064:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 19671us (20059us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.474408:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5391 00010000:00010000:3.0:1790771165.474420:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.474424:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14557:x1877759533662336:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:2.0:1790771165.474429:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 860 00000100:00100000:2.0:1790771165.474455:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533662464 00010000:00010000:3.0:1790771165.474458:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.474463:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533662464 00000100:00100000:3.0:1790771165.474504:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539709056:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771165.474522:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 864 00000100:00100000:2.0:1790771165.474535:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14026:x1877759533662464:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:3.0:1790771165.474547:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa636c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.474548:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.474549:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14557:x1877759533662336:12345-192.168.204.50@tcp:36:ln.0 Request processed in 127us (351us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771165.474562:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ade expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.474564:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5391 00000100:00100000:3.0:1790771165.474580:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5392 00000100:00100000:3.0:1790771165.474595:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13894:x1877759533662720:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:2.0:1790771165.474602:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 28 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474617:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(2 1) 00010000:00010000:3.0:1790771165.474619:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790771165.474627:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(3 1) 00010000:00010000:3.0:1790771165.474636:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a3c7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a9f expref: 72 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474638:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474664:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2f:0x0].0x0 (ffff8bfc3da48a00) 00010000:00010000:0.0:1790771165.474665:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771165.474673:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a48b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474699:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a24d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a05 expref: 71 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474703:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 28 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.474710:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:0.0:1790771165.474716:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a48b lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.474737:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a48b lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474741:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 28 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474760:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771165.474765:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff8bfc113f3e00) 00010000:00010000:3.0:1790771165.474767:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.474772:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1790771165.474775:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539709184:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.474779:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a48b lrc: 1/0,0 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474782:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.474808:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a48b lrc: 0/0,0 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474809:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.474814:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a29c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.474834:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474839:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.474841:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.474845:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.474849:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.474851:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.474863:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474870:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474883:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474958:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474966:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.474972:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.475108:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2f:0x0]: returning size 2 00000040:00080000:2.0:1790771165.475111:0:13766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 88 off10592 00010000:00010000:3.0:1790771165.475116:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475123:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475128:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475131:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.475134:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475139:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.475142:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090608bb9 reply state 00000000bd73aabb transno 4294969090 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475147:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2f:0x0].0x0 (ffff8bfc20109e00) 00010000:00010000:3.0:1790771165.475153:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771165.475156:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475156:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475176:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0a4a7 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.475177:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.475183:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.475187:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.475197:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475203:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475209:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475214:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475218:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.475220:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475224:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475230:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.475232:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.475234:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.475240:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14548:x1877759533654912:12345-192.168.204.50@tcp:36:chown.0 Request processed in 21840us (22115us total) trans 4294969090 rc 0/0 00010000:00010000:3.0:1790771165.475242:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a499 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.475253:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5373 00000004:00010000:3.0:1790771165.475255:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000426e865c reply state 000000004149e34f transno 4294968521 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475262:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.475268:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.475269:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.475271:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.475299:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13894:x1877759533662720:12345-192.168.204.50@tcp:36:rm.0 Request processed in 709us (1001us total) trans 4294968521 rc 0/0 00000100:00100000:3.0:1790771165.475305:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5392 00000100:00100000:0.0:1790771165.476131:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533663360 00000100:00100000:0.0:1790771165.476138:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533663360 00000100:00100000:0.0:1790771165.476175:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5393 00000100:00100000:0.0:1790771165.476185:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13972:x1877759533663360:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:0.0:1790771165.476196:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.476207:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a4ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ae5 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476279:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476292:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476301:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476316:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476324:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476332:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476363:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476370:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476376:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.476382:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x85:0x0]: returning size 14756 00010000:00010000:0.0:1790771165.476414:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476419:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476424:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476427:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.476430:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476433:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476439:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.476442:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.476444:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476452:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a4b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476459:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476463:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476467:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476470:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.476472:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476476:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476480:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc13348f00) 00010000:00010000:0.0:1790771165.476481:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.476534:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476539:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a4bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476568:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a4ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 102 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476582:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 101 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.476587:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771165.476589:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.476591:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1be00, rc 0) 00000100:00100000:0.0:1790771165.476619:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:13972:x1877759533663360:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 437us (556us total) trans 4294969091 rc 0/0 00000100:00100000:0.0:1790771165.476624:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5393 00000100:00100000:0.0:1790771165.477501:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.477528:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.477545:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533662976 00000100:00100000:2.0:1790771165.477552:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533662976 00000100:00100000:0.0:1790771165.477578:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.477593:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1f80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000_UUID:13785:1877759539708032:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771165.477594:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533663616 00000100:00100000:2.0:1790771165.477602:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533663616 00010000:00010000:3.0:1790771165.477618:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.477630:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.477634:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a0e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.477642:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1355 00000004:00010000:3.0:1790771165.477660:0:13785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d069d936 reply state 00000000f0d95fb7 transno 4294969082 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.477661:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14528:x1877759533662976:12345-192.168.204.50@tcp:35:touch.0 00010000:00010000:3.0:1790771165.477677:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477702:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc2900a500) 00010000:00010000:3.0:1790771165.477705:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.477709:0:13785:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00010000:3.0:1790771165.477714:0:13785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d069d936 reply state 00000000f0d95fb7 transno 4294969082 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477722:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477728:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc2900ab00) 00000100:00100000:0.0:1790771165.477729:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533663744 00010000:00010000:3.0:1790771165.477730:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.477734:0:13785:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1790771165.477737:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533663744 00010000:00010000:3.0:1790771165.477744:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477750:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477757:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477763:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477768:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.477775:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1356 00010000:00010000:3.0:1790771165.477777:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.477791:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13569:x1877759533663616:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771165.477793:0:13785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1790771165.477836:0:13785:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771165.477850:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14528:x1877759533662976:12345-192.168.204.50@tcp:35:touch.0 Request processed in 194us (363us total) trans 4294969092 rc 0/0 00000100:00100000:3.0:1790771165.477855:0:13785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14103:x1877759533639552:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 92997us (93117us total) trans 4294969082 rc 0/0 00000100:00100000:2.0:1790771165.477873:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1355 00000100:00100000:3.0:1790771165.477874:0:13785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 31 00000100:00100000:0.0:1790771165.477893:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13569:x1877759533663616:12345-192.168.204.50@tcp:35:ls.0 Request processed in 107us (313us total) trans 4294969093 rc 0/0 00000100:00100000:0.0:1790771165.477901:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1356 00010000:00010000:2.0:1790771165.477901:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771165.477908:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477915:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.477919:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477923:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477927:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477932:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477938:0:8424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x25:0x0].0x0 (ffff8bfc1040f400) 00010000:00010000:3.0:1790771165.477939:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477944:0:8424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790771165.477949:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.477950:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477954:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477957:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a4d1 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477976:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.477978:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.477982:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.477986:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.477989:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc2900ab00) 00010000:00010000:3.0:1790771165.477992:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.477995:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.477999:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a285 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478010:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478014:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478018:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478022:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.478058:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478063:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478068:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc2900a500) 00010000:00010000:3.0:1790771165.478070:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.478072:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478077:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a27e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478086:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478090:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478094:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478098:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.478099:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478103:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478107:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771165.478108:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771165.478110:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.478114:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0a28c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.479059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.479100:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.479110:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533663872 00000100:00100000:2.0:1790771165.479117:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539708288:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771165.479123:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533663872 00010000:00010000:2.0:1790771165.479134:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.479150:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533664000 00000100:00100000:3.0:1790771165.479157:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533664000 00000100:00100000:2.0:1790771165.479164:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533657600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13845us (13928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.479172:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1493 00002000:00100000:3.0:1790771165.479196:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0xe:0x0] (24576->28671) req@ffff8bfc3d804700 x1877759533664000/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771165.479254:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5394 00000100:00100000:2.0:1790771165.479263:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14110:x1877759533663872:12345-192.168.204.50@tcp:44:fallocate.0 00002000:00100000:3.0:1790771165.479322:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d804700 with x1877759533664000 ext(24576->28671) 00000100:00100000:2.0:1790771165.479325:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14110:x1877759533663872:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.479334:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5394 00002000:00010000:3.0:1790771165.479395:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d804700 00000100:00100000:2.0:1790771165.479444:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 356 00000100:00100000:2.0:1790771165.479452:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533664000:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771165.479570:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533664000:12345-192.168.204.50@tcp:3:cat.0 Request processed in 119us (475us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790771165.479576:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 356 00002000:00100000:2.0:1790771165.479582:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xe:0x0] (24576->28671) req@ffff8bfc3d804700 x1877759533664000/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/4536 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.479590:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d804700 with x1877759533664000 ext(24576->28671) 00002000:00010000:2.0:1790771165.479594:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d804700 00000100:00100000:0.0:1790771165.479819:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13293:x1877759533663744:12345-192.168.204.50@tcp:37:ls.0 Request processed in 1951us (2196us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.479826:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1357 00000100:00100000:3.0:1790771165.486199:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533665152 00000100:00100000:3.0:1790771165.486205:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533665152 00000100:00100000:3.0:1790771165.486232:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5395 00000100:00100000:3.0:1790771165.486238:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13208:x1877759533665152:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.486247:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.486257:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a4d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b01 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.486300:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x43:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.486339:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a4d8 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x63:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b01 expref: 116 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.486348:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfc20109e00) 00010000:00010000:3.0:1790771165.486350:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.486353:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0a4d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x63:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b01 expref: 116 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.486362:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81000, rc 0) 00000100:00100000:3.0:1790771165.486388:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13208:x1877759533665152:12345-192.168.204.50@tcp:101:ls.0 Request processed in 150us (222us total) trans 4294968522 rc 301/301 00000100:00100000:3.0:1790771165.486394:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5395 00000100:00100000:0.0:1790771165.491452:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.491473:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.491516:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533665920 00000100:00100000:2.0:1790771165.491522:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533665920 00000100:00100000:2.0:1790771165.491558:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666176 00000100:00100000:2.0:1790771165.491561:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666176 00000100:00100000:2.0:1790771165.491585:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5396 00000100:00100000:2.0:1790771165.491592:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533665920:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:2.0:1790771165.491605:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.491615:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a4e6 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b16 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491714:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491725:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491735:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491758:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491769:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491783:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.491803:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:2.0:1790771165.491814:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491820:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491825:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491830:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.491834:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491843:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491860:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.491863:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.491869:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491875:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a4f4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491886:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491898:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491908:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491918:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.491923:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491930:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491943:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc2900aa00) 00010000:00010000:2.0:1790771165.491948:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.491955:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.491979:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a502 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.492018:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a4e6 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b16 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.492037:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.492046:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.492056:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a4e6 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b16 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.492085:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593800, rc 0) 00000100:00100000:2.0:1790771165.492133:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14277:x1877759533665920:12345-192.168.204.50@tcp:101:touch.0 Request processed in 538us (679us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.492149:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5396 00000100:00100000:2.0:1790771165.495462:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2397:x1877759533657728:12345-192.168.204.50@tcp:4:dd.0 Request processed in 31145us (31337us total) trans 4294967571 rc 0/0 00000100:00100000:2.0:1790771165.495469:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 77 00002000:00100000:2.0:1790771165.495476:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x14:0x0] (6225920->9240575) req@ffff8bfb05d65500 x1877759533657728/t4294967571(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/448 e 0 to 0 dl 1790771176 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.495503:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05d65500 with x1877759533657728 ext(6225920->9240575) 00010000:00010000:2.0:1790771165.495511:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 31 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.495521:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 31 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.495527:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb05d65500 00000100:00100000:0.0:1790771165.534269:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.534378:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.534422:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.534446:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533664256 00000100:00100000:2.0:1790771165.534452:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.534453:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533664256 00000100:00100000:0.0:1790771165.534506:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533669376 00000100:00100000:0.0:1790771165.534510:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533669376 00000100:00100000:2.0:1790771165.534527:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.534538:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5399 00000100:00100000:0.0:1790771165.534547:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13428:x1877759533664256:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771165.534557:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.534571:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a51e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34aec expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.534583:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29015180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539708416:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.534597:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.534601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.534616:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.534627:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.534648:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.534659:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.534713:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.534714:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80e00, rc 0) 00010000:00010000:0.0:1790771165.534726:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a51e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 104 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.534738:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670912 00000100:00100000:2.0:1790771165.534744:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670912 00010000:00010000:0.0:1790771165.534751:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 103 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.534761:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14346:x1877759533659264:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 68925us (69336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.534772:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533672576 00000100:00100000:2.0:1790771165.534777:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533672576 00000100:00100000:3.0:1790771165.534780:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 863 00010000:00010000:0.0:1790771165.534787:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.534794:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771165.534797:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1bc00, rc 0) 00000100:00100000:2.0:1790771165.534803:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5400 00000100:00100000:3.0:1790771165.534812:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533664640 00000100:00100000:2.0:1790771165.534814:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14277:x1877759533669376:12345-192.168.204.50@tcp:101:touch.0 00000100:00100000:3.0:1790771165.534819:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533664640 00010000:00010000:2.0:1790771165.534826:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.534828:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13428:x1877759533664256:12345-192.168.204.50@tcp:101:cat.0 Request processed in 282us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.534839:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a533 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b55 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.534846:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5399 00000100:00100000:3.0:1790771165.534854:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 865 00000100:00100000:3.0:1790771165.534865:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:13459:x1877759533664640:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1790771165.534876:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.534879:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5401 00000100:00100000:0.0:1790771165.534892:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14247:x1877759533670912:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.534893:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34af3 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.534909:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.534918:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(13 1) 00010000:00010000:0.0:1790771165.534921:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a541 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b7f expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.534928:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(14 1) 00010000:00010000:3.0:1790771165.534941:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->9371647] (req 9306112->9371647) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 32 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.534944:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.534955:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->9371647] (req 9306112->9371647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 32 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.534965:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.534967:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.534988:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81000, rc 0) 00010000:00010000:0.0:1790771165.534991:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.534994:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535006:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535010:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:13459:x1877759533664640:12345-192.168.204.50@tcp:101:dd.0 Request processed in 146us (354us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.535020:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535025:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535035:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 865 00010000:00010000:0.0:1790771165.535048:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535052:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535059:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535063:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.535090:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:2.0:1790771165.535104:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535108:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.535119:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535122:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535136:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535139:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535159:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.535160:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535169:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.535171:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 38336 00010000:00010000:2.0:1790771165.535182:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535194:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.535197:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.535201:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535209:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a548 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535209:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.535217:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535231:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535233:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535239:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535255:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535255:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535268:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.535273:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535276:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535281:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535289:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.535292:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.535297:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535302:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.535305:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535306:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.535313:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535320:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a556 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535320:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc2900aa00) 00010000:00010000:2.0:1790771165.535327:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.535332:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535336:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535344:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.535347:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a55d lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535354:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535361:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535365:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.535369:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535374:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535382:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc13348f00) 00010000:00010000:0.0:1790771165.535384:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.535387:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535388:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a533 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b55 expref: 118 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535399:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a564 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535405:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.535409:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.535415:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a533 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b55 expref: 118 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.535426:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593c00, rc 0) 00010000:00010000:0.0:1790771165.535436:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a541 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 121 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.535453:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14277:x1877759533669376:12345-192.168.204.50@tcp:101:touch.0 Request processed in 641us (1003us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.535457:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 120 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.535465:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5400 00010000:00010000:0.0:1790771165.535472:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771165.535475:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.535478:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b200, rc 0) 00000100:00100000:3.0:1790771165.535512:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.535530:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14247:x1877759533670912:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 641us (931us total) trans 4294969094 rc 0/0 00000100:00100000:2.0:1790771165.535531:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533665408 00000100:00100000:2.0:1790771165.535539:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533665408 00000100:00100000:0.0:1790771165.535541:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5401 00000100:00100000:0.0:1790771165.535571:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533664512 00000100:00100000:0.0:1790771165.535576:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533664512 00000100:00100000:2.0:1790771165.535592:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5403 00000100:00100000:0.0:1790771165.535606:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533664896 00000100:00100000:2.0:1790771165.535610:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14089:x1877759533665408:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:0.0:1790771165.535611:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533664896 00010000:00010000:2.0:1790771165.535625:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.535636:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.535638:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3c00/0xfa0c505d97f0a580 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b0f expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.535643:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533665280 00000100:00100000:0.0:1790771165.535648:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533665280 00000100:00100000:0.0:1790771165.535690:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 866 00010000:00010000:2.0:1790771165.535696:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3c00/0xfa0c505d97f0a580 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x83:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b0f expref: 118 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.535704:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533664512:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:3.0:1790771165.535717:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 867 00010000:00010000:2.0:1790771165.535722:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3c00/0xfa0c505d97f0a580 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x83:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b0f expref: 118 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.535731:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533664896:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.535745:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.535750:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:2.0:1790771165.535754:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771165.535756:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3c00, rc 0) 00010000:00010000:3.0:1790771165.535758:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000146a22d/0xfa0c505d97f0a587 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34afa expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.535760:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 868 00000100:00100000:0.0:1790771165.535775:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:13051:x1877759533665280:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:2.0:1790771165.535785:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14089:x1877759533665408:12345-192.168.204.50@tcp:101:cp.0 Request processed in 179us (341us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.535789:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.535797:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5403 00010000:00010000:0.0:1790771165.535800:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b08 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.535821:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533665664 00000100:00100000:2.0:1790771165.535826:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533665664 00010000:00010000:0.0:1790771165.535832:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x19:0x0].0x0 since=0s v=(3 2) 00010000:00010000:0.0:1790771165.535846:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 27 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535856:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x19:0x0].0x0 since=0s v=(4 2) 00000100:00100000:2.0:1790771165.535859:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1358 00010000:00010000:0.0:1790771165.535864:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10289152->10354687] (req 10289152->10354687) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.535875:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14201:x1877759533665664:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790771165.535880:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539709312:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.535893:0:13782:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 27 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535910:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [10289152->10354687] (req 10289152->10354687) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.535919:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b000, rc 0) 00000100:00100000:0.0:1790771165.535945:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:13051:x1877759533665280:12345-192.168.204.50@tcp:101:dd.0 Request processed in 176us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.535945:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.535955:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 868 00000100:00100000:0.0:1790771165.535990:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 357 00000100:00100000:2.0:1790771165.535994:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14201:x1877759533665664:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 121us (355us total) trans 4294969095 rc 0/0 00000100:00100000:3.0:1790771165.535996:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.536004:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533664128:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771165.536010:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1358 00000100:00100000:3.0:1790771165.536022:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666304 00000100:00100000:3.0:1790771165.536026:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666304 00000100:00100000:3.0:1790771165.536057:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 869 00000100:00100000:3.0:1790771165.536067:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14065:x1877759533666304:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:2.0:1790771165.536072:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 358 00010000:00010000:3.0:1790771165.536077:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.536084:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533664384:12345-192.168.204.50@tcp:10:cp.0 00010000:00010000:3.0:1790771165.536088:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b24 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536102:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533664128:12345-192.168.204.50@tcp:3:cat.0 Request processed in 102us (1723us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.536104:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(3 1) 00000100:00100000:0.0:1790771165.536111:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 357 00010000:00010000:3.0:1790771165.536114:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.536121:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (421888->425983) req@ffff8bfb0627d500 x1877759533664128/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.536123:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(4 1) 00010000:00010000:3.0:1790771165.536135:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 27 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.536138:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0627d500 with x1877759533664128 ext(421888->425983) 00002000:00010000:0.0:1790771165.536145:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0627d500 00010000:00010000:3.0:1790771165.536164:0:12031:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.536176:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.536185:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1400, rc 0) 00000100:00100000:0.0:1790771165.536186:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708544:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.536200:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708672:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.536213:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14065:x1877759533666304:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 147us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.536215:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03023b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539708800:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.536227:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 869 00002000:00010000:2.0:1790771165.536233:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 14756 -> 0 00002000:00010000:2.0:1790771165.536239:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1790771165 00002000:00010000:2.0:1790771165.536243:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771165.536246:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 0 -> 1790771165 00010000:00010000:0.0:1790771165.536248:0:13792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.536249:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771165.536291:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533664384:12345-192.168.204.50@tcp:10:cp.0 Request processed in 208us (1801us total) trans 4294967571 rc 0/0 00000100:00100000:3.0:1790771165.536299:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.536307:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 358 00002000:00010000:2.0:1790771165.536311:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/34 (0->18446744073709551615) 00002000:00100000:2.0:1790771165.536314:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05d65880 with x1877759533664384 ext(0->18446744073709551615) 00002000:00010000:2.0:1790771165.536319:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb05d65880. 00000100:00100000:3.0:1790771165.536327:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666432 00000100:00100000:3.0:1790771165.536333:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666432 00000100:00100000:3.0:1790771165.536372:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 870 00000100:00100000:3.0:1790771165.536382:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533666432:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:3.0:1790771165.536442:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539708928:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.536459:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.536463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.536507:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2398:x1877759533663104:12345-192.168.204.50@tcp:4:dd.0 Request processed in 58777us (58952us total) trans 4294967572 rc 0/0 00000100:00100000:2.0:1790771165.536511:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666944 00000100:00100000:0.0:1790771165.536516:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 78 00000100:00100000:2.0:1790771165.536517:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666944 00002000:00100000:0.0:1790771165.536524:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x14:0x0] (9240576->9306111) req@ffff8bfb06790000 x1877759533663104/t4294967572(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/448 e 0 to 0 dl 1790771176 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771165.536532:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790000 with x1877759533663104 ext(9240576->9306111) 00010000:00010000:0.0:1790771165.536537:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 32 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536546:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 32 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.536549:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5404 00002000:00010000:0.0:1790771165.536558:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06790000 00000100:00100000:2.0:1790771165.536562:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13353:x1877759533666944:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771165.536571:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.536581:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a59c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b2b expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536609:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.536613:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536622:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536629:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536637:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.536638:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536646:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536652:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.536704:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.536713:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536721:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536727:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536728:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533667200 00000100:00100000:0.0:1790771165.536736:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533667200 00000004:00200000:2.0:1790771165.536738:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00000004:00010000:2.0:1790771165.536753:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536761:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 871 00010000:00010000:2.0:1790771165.536769:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536775:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14145:x1877759533667200:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771165.536782:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536786:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.536789:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536794:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.536796:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536798:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b39 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536802:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536821:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.536823:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.536824:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(5 1) 00010000:00010000:2.0:1790771165.536826:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536833:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536834:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a5a3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536852:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1790771165.536855:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536857:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b39 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536870:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536877:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536883:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.536887:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536892:0:8408:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536893:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536912:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03188600) 00010000:00010000:2.0:1790771165.536916:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.536917:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b39 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536919:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.536939:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a5aa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.536940:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78e00, rc 0) 00010000:00010000:2.0:1790771165.536963:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a59c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 74 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536970:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:14145:x1877759533667200:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 198us (264us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.536975:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 73 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.536981:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 871 00010000:00010000:2.0:1790771165.536989:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6a:0x0].0x0 (ffff8bfc2900ad00) 00010000:00010000:2.0:1790771165.536991:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.536993:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2200, rc 0) 00000100:00100000:3.0:1790771165.537009:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666688 00000100:00100000:3.0:1790771165.537014:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666688 00000100:00100000:2.0:1790771165.537021:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13353:x1877759533666944:12345-192.168.204.50@tcp:101:cp.0 Request processed in 461us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.537027:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5404 00010000:00010000:3.0:1790771165.537034:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 121 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.537062:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666560 00000100:00100000:3.0:1790771165.537065:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666560 00000100:00100000:2.0:1790771165.537069:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539709184:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.537080:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.537084:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 122 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537090:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537102:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593e00, rc 0) 00000100:00100000:3.0:1790771165.537106:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533666816 00000100:00100000:3.0:1790771165.537110:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533666816 00000100:00100000:2.0:1790771165.537125:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14026:x1877759533662464:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 62594us (62861us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.537126:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 118 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.537141:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 864 00000100:00100000:0.0:1790771165.537149:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.537170:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533667968 00000100:00100000:2.0:1790771165.537174:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533667968 00000100:00100000:0.0:1790771165.537195:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.537212:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668096 00000100:00100000:2.0:1790771165.537216:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668096 00000100:00100000:2.0:1790771165.537246:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5405 00000100:00100000:0.0:1790771165.537252:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.537262:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14395:x1877759533667968:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771165.537278:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.537292:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533667840 00010000:00010000:2.0:1790771165.537294:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1790771165.537296:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533667840 00000100:00100000:3.0:1790771165.537302:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1496 00010000:00010000:2.0:1790771165.537311:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a445 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ad0 expref: 73 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.537319:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:2397:x1877759533666688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.537321:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668352 00000100:00100000:0.0:1790771165.537325:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668352 00010000:00010000:2.0:1790771165.537328:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6b:0x0].0x0 (ffff8bfc310f1000) 00010000:00010000:3.0:1790771165.537335:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.537339:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f09ce3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34822 expref: 73 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537347:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 122 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.537348:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1359 00010000:00010000:2.0:1790771165.537350:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:2.0:1790771165.537357:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.537362:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13763:x1877759533667840:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:2.0:1790771165.537371:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537373:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 122 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537390:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 119 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537397:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,1 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537400:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0139f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3175a expref: 122 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537420:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:3.0:1790771165.537425:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537426:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 119 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537443:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537449:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 119 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537454:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.537460:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13763:x1877759533667840:12345-192.168.204.50@tcp:35:cat.0 Request processed in 101us (380us total) trans 4294969096 rc 0/0 00000100:00100000:2.0:1790771165.537465:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539709824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.537472:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1359 00000100:00100000:3.0:1790771165.537482:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2397:x1877759533666688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 169us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.537516:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1360 00000100:00100000:3.0:1790771165.537521:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1496 00000100:00100000:0.0:1790771165.537527:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13894:x1877759533668352:12345-192.168.204.50@tcp:49:rm.0 00000100:00100000:2.0:1790771165.537541:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.537546:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1497 00000100:00100000:3.0:1790771165.537556:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533666560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.537563:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1498 00010000:00010000:3.0:1790771165.537566:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.537572:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.537580:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13894:x1877759533668352:12345-192.168.204.50@tcp:49:rm.0 Request processed in 50us (296us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771165.537580:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759533666816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.537590:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537595:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.537600:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1360 00010000:00010000:2.0:1790771165.537605:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 119 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537610:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f01e65 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c0e expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537621:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 119 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537626:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:3.0:1790771165.537631:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537636:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a3d5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a91 expref: 119 pid: 12030 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.537648:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.537657:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.537663:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.537665:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771165.537670:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.537694:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.537704:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2397:x1877759533666560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 148us (1064us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.537711:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.537719:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1497 00000100:00100000:0.0:1790771165.537724:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.537737:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.537755:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668480 00000100:00100000:3.0:1790771165.537760:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668480 00000100:00100000:2.0:1790771165.537770:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759533666816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.537779:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.537786:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668736 00000100:00100000:2.0:1790771165.537788:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1498 00000100:00100000:3.0:1790771165.537791:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668736 00000100:00100000:2.0:1790771165.537830:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1361 00000100:00100000:0.0:1790771165.537831:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.537843:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1362 00000100:00100000:2.0:1790771165.537847:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14017:x1877759533668480:12345-192.168.204.50@tcp:49:dd.0 00000100:00100000:3.0:1790771165.537861:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13972:x1877759533668736:12345-192.168.204.50@tcp:35:file_concat.sh.0 00000100:00100000:0.0:1790771165.537888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.537902:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14017:x1877759533668480:12345-192.168.204.50@tcp:49:dd.0 Request processed in 59us (258us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771165.537906:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668224 00000100:00100000:0.0:1790771165.537911:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668224 00000100:00100000:2.0:1790771165.537911:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1361 00000100:00100000:0.0:1790771165.537944:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533667456 00000100:00100000:2.0:1790771165.537945:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668864 00000100:00100000:0.0:1790771165.537948:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533667456 00000100:00100000:2.0:1790771165.537950:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668864 00000100:00100000:3.0:1790771165.537973:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13972:x1877759533668736:12345-192.168.204.50@tcp:35:file_concat.sh.0 Request processed in 116us (253us total) trans 4294969097 rc 0/0 00000100:00100000:0.0:1790771165.537978:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 872 00000100:00100000:2.0:1790771165.537985:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533669120 00000100:00100000:3.0:1790771165.537990:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1362 00000100:00100000:2.0:1790771165.537991:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533669120 00000100:00100000:0.0:1790771165.537994:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533668224:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:2.0:1790771165.538022:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5407 00000100:00100000:2.0:1790771165.538039:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14120:x1877759533668864:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771165.538048:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.538060:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0a5e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b47 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.538075:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 47456 -> 47456 00002000:00010000:0.0:1790771165.538079:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:0.0:1790771165.538083:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 1790771160 -> 0 00002000:00010000:0.0:1790771165.538090:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00000100:00100000:3.0:1790771165.538090:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539709056:192.168.204.50@tcp:105: 00002000:00010000:0.0:1790771165.538094:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:2.0:1790771165.538094:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.538105:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.538118:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538124:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759533668224:12345-192.168.204.50@tcp:2:chown.0 Request processed in 132us (872us total) trans 4294967572 rc 0/0 00000100:00100000:3.0:1790771165.538133:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533662080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 63841us (64019us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.538144:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 872 00010000:00010000:2.0:1790771165.538144:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538163:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 873 00000100:00100000:0.0:1790771165.538176:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2397:x1877759533667456:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:2.0:1790771165.538177:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538197:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538208:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.538238:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 21450 -> 21450 00002000:00010000:0.0:1790771165.538243:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790771163 -> 1790771163 00002000:00010000:0.0:1790771165.538249:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1790771162 -> 1752421453 00002000:00010000:0.0:1790771165.538255:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:0.0:1790771165.538258:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 56 -> 56 00010000:00010000:2.0:1790771165.538260:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538277:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538278:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+33:2397:x1877759533667456:12345-192.168.204.50@tcp:2:chown.0 Request processed in 106us (390us total) trans 4294967573 rc 0/0 00010000:00010000:2.0:1790771165.538298:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538300:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 873 00000100:00100000:3.0:1790771165.538303:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1495 00000004:00200000:2.0:1790771165.538368:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.538370:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771165.538374:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1790771165.538387:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538389:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533669504 00000100:00100000:0.0:1790771165.538395:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533669504 00010000:00010000:2.0:1790771165.538399:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538415:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.538421:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1363 00010000:00010000:2.0:1790771165.538421:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538431:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.538435:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13293:x1877759533669504:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771165.538437:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538459:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538479:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.538506:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.538510:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538515:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0a5e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538536:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538542:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538548:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538557:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.538563:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538569:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538576:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc2900a700) 00010000:00010000:2.0:1790771165.538580:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.538585:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.538597:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.538598:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a5f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538627:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0a5e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b47 expref: 121 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538650:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b47 expref: 120 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538660:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc2900a100) 00010000:00010000:2.0:1790771165.538663:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.538665:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56800, rc 0) 00000100:00100000:3.0:1790771165.538670:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.538709:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14120:x1877759533668864:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 674us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.538716:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5407 00000100:00100000:2.0:1790771165.538743:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533668992 00000100:00100000:2.0:1790771165.538748:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533668992 00000100:00100000:2.0:1790771165.538779:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 874 00000100:00100000:2.0:1790771165.538791:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759533668992:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:3.0:1790771165.538807:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.538829:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533669760 00000100:00100000:2.0:1790771165.538833:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533669760 00000100:00100000:2.0:1790771165.538857:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5410 00000100:00100000:2.0:1790771165.538864:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:12121:x1877759533669760:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.538871:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.538881:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b5c expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.538881:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967571 is committed 00000001:00080000:3.0:1790771165.538904:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967570 is committed 00010000:00010000:2.0:1790771165.538909:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538919:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538927:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.538946:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.538953:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2398:x1877759533664512:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 3252us (3847us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.538958:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.538963:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 866 00010000:00010000:2.0:1790771165.538975:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.538998:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967572 is committed 00000001:00080000:3.0:1790771165.539014:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967569 is committed 00010000:00010000:2.0:1790771165.539015:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539036:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539059:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539060:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533666432:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2678us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.539080:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 870 00000004:00010000:2.0:1790771165.539085:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539088:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539096:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539115:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539116:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539122:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539138:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539148:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539158:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.539163:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539178:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539179:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539195:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.539199:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.539206:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539207:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539224:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a621 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.539236:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000efdfc522 reply state 0000000022cb438a transno 4294968525 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539237:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.539251:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539254:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539261:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00000100:00100000:3.0:1790771165.539269:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.539270:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.539271:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539275:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.539290:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539291:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539303:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.539304:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14287:x1877759533661184:12345-192.168.204.50@tcp:36:cp.0 Request processed in 71622us (71695us total) trans 4294968525 rc 0/0 00010000:00010000:2.0:1790771165.539310:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539325:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5387 00000100:00100000:3.0:1790771165.539326:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539327:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539348:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670272 00010000:00010000:2.0:1790771165.539349:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf7a5b27a (ffff8bfc2900a500) 00000100:00100000:0.0:1790771165.539354:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670272 00010000:00010000:2.0:1790771165.539354:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.539360:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539370:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.539371:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a62f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539385:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670528 00000100:00100000:0.0:1790771165.539389:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670528 00000100:00100000:3.0:1790771165.539399:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533671040 00010000:00010000:2.0:1790771165.539403:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b5c expref: 124 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.539406:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533671040 00000100:00100000:0.0:1790771165.539414:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5411 00010000:00010000:2.0:1790771165.539423:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b5c expref: 123 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539426:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14299:x1877759533670272:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:3.0:1790771165.539438:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533671296 00010000:00010000:2.0:1790771165.539440:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:0.0:1790771165.539442:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.539442:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533671296 00010000:00010000:2.0:1790771165.539445:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.539449:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00010000:00010000:0.0:1790771165.539455:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a63d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b6a expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.539470:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:12121:x1877759533669760:12345-192.168.204.50@tcp:101:ls.0 Request processed in 605us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.539477:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5412 00000100:00100000:3.0:1790771165.539517:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14407:x1877759533670528:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.539526:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.539530:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5410 00010000:00010000:3.0:1790771165.539539:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a644 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b78 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539540:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.539552:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5413 00010000:00010000:0.0:1790771165.539564:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.539568:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14515:x1877759533671040:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:0.0:1790771165.539583:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539587:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539594:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771165.539602:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539608:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539610:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a270 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a13 expref: 72 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539611:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539634:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539637:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539645:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02000/0xfa0c505d97f08a1a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3414c expref: 71 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539665:0:12128:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539672:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539674:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f09c9d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34829 expref: 70 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539675:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539716:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539722:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:0.0:1790771165.539726:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670400 00010000:00010000:2.0:1790771165.539732:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.539733:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670400 00010000:00010000:3.0:1790771165.539738:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539753:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539756:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670016 00000100:00100000:0.0:1790771165.539761:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670016 00010000:00010000:2.0:1790771165.539765:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539782:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 875 00010000:00010000:2.0:1790771165.539786:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539788:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539795:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533670400:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771165.539811:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.539813:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539823:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c4892ce/0xfa0c505d97f0a68a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b71 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539836:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.539857:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 2272 00000100:00100000:0.0:1790771165.539860:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539709952:192.168.204.50@tcp:106: 00000004:00200000:3.0:1790771165.539862:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.539869:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003efcd1d8 reply state 00000000f2cee5c9 transno 4294968526 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.539875:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539891:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653780 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.539900:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.539904:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539913:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 876 00000100:00100000:0.0:1790771165.539926:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533670016:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771165.539932:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771165.539932:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.539934:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.539940:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.539943:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002f8caad/0xfa0c505d97f0a698 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b63 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.539944:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.539955:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539965:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.539969:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.539973:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.539981:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb62a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13793:1877759539710080:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.539989:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14515:x1877759533671040:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 422us (780us total) trans 4294968526 rc 0/0 00010000:00010000:3.0:1790771165.539990:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.540006:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.540007:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5413 00010000:00010000:3.0:1790771165.540016:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.540020:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.540025:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.540031:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5415 00000100:00100000:2.0:1790771165.540043:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5416 00000100:00100000:0.0:1790771165.540047:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14503:x1877759533671296:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.540047:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0a652 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.540060:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14493:x1877759533671424:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.540064:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.540077:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a69f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b8d expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540077:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.540080:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540087:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0a6a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34b94 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540107:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540126:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540132:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540132:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540133:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.540139:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540164:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540165:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540188:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540188:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc20109c00) 00010000:00010000:0.0:1790771165.540190:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540195:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.540200:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540208:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540219:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0a66e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540220:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540222:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540252:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540252:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0a644 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 131 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540260:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540280:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540288:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540290:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.540297:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.540301:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00010000:00010000:2.0:1790771165.540309:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540315:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540319:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540327:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14407:x1877759533670528:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 837us (1147us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.540344:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540348:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5412 00000004:00200000:2.0:1790771165.540372:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x43:0x0]: returning size 1681 00010000:00010000:0.0:1790771165.540373:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.540378:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.540389:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.540393:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540400:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540416:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.540419:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.540436:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 17315 00010000:00010000:2.0:1790771165.540437:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.540441:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.540448:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.540453:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.540468:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540471:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540480:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.540511:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540513:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.540536:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540548:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540549:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540559:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.540567:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.540575:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540575:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.540583:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.540591:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540591:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540612:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38200/0xfa0c505d97f0a6b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540614:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.540621:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.540626:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540631:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540632:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a6ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540656:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540660:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540668:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540673:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540697:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.540702:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540704:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540709:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539709312:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.540710:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.540718:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540729:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540731:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540736:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000146a22d/0xfa0c505d97f0a587 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34afa expref: 22 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540753:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfc2900aa00) 00010000:00010000:0.0:1790771165.540755:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc13348f00) 00010000:00010000:2.0:1790771165.540760:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.540765:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.540768:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540772:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540773:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000146a22d/0xfa0c505d97f0a587 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34afa expref: 22 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540801:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0a6bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.540806:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1c00, rc 0) 00010000:00010000:0.0:1790771165.540814:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a6c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.540828:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2398:x1877759533664896:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 5100us (5539us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.540836:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 867 00010000:00010000:2.0:1790771165.540850:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0a6a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b94 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540856:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a69f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 131 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540868:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b94 expref: 129 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.540874:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 129 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.540878:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:2.0:1790771165.540885:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.540887:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:2.0:1790771165.540889:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38600, rc 0) 00010000:00010000:0.0:1790771165.540895:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771165.540896:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.540900:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686200, rc 0) 00000100:00100000:2.0:1790771165.540915:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14493:x1877759533671424:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 860us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.540927:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14503:x1877759533671296:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 882us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.540934:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5416 00000100:00100000:3.0:1790771165.540943:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.540948:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5415 00000100:00100000:2.0:1790771165.540960:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5418 00000100:00100000:2.0:1790771165.540973:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14615:x1877759533672832:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:0.0:1790771165.540979:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533670144 00000100:00100000:0.0:1790771165.540985:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533670144 00010000:00010000:2.0:1790771165.541000:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:0.0:1790771165.541002:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (30163->18446744073709551615) 00002000:00100000:0.0:1790771165.541006:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064ace00 with x1877759533670144 ext(30163->18446744073709551615) 00002000:00010000:0.0:1790771165.541012:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb064ace00. 00010000:00010000:2.0:1790771165.541016:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f07495 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33a6f expref: 127 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.541030:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533672064 00010000:00010000:2.0:1790771165.541031:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x74:0x0].0x0 (ffff8bfc310f2900) 00000100:00100000:0.0:1790771165.541034:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533672064 00000100:00100000:3.0:1790771165.541036:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.541049:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0943f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e344fd expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541063:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:0.0:1790771165.541066:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533673216 00010000:00010000:2.0:1790771165.541068:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.541071:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533673216 00010000:00010000:2.0:1790771165.541085:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,1 mode: --/CW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541093:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.541096:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (425984->430079) req@ffff8bfb064af100 x1877759533673216/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771165.541105:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.541116:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064af100 with x1877759533673216 ext(425984->430079) 00002000:00010000:0.0:1790771165.541122:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb064af100 00010000:00010000:2.0:1790771165.541126:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541134:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541143:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.541148:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 359 00000100:00100000:0.0:1790771165.541162:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533670144:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:2.0:1790771165.541163:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x74:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541175:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 106 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541180:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541205:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 106 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.541216:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 106 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.541242:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539710208:192.168.204.50@tcp:104: 00002000:00010000:0.0:1790771165.541275:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 19884 -> 30163 00002000:00010000:0.0:1790771165.541279:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.541281:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.541284:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.541286:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771165.541301:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.541314:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759533670144:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 153us (902us total) trans 4294967573 rc 0/0 00000100:00100000:2.0:1790771165.541318:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533673344 00000100:00100000:2.0:1790771165.541325:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533673344 00000100:00100000:0.0:1790771165.541329:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 359 00002000:00010000:0.0:1790771165.541332:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (30163->18446744073709551615) 00002000:00100000:0.0:1790771165.541337:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064ace00 with x1877759533670144 ext(30163->18446744073709551615) 00002000:00010000:0.0:1790771165.541345:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb064ace00. 00000100:00100000:2.0:1790771165.541359:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 877 00000100:00100000:0.0:1790771165.541369:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 360 00000100:00100000:2.0:1790771165.541370:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533673344:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771165.541384:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2398:x1877759533672064:12345-192.168.204.50@tcp:22:fallocate.0 00002000:00010000:2.0:1790771165.541450:0:13781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x15:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790771165.541455:0:13781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x15:0x0] updating lvb mtime from disk: 0 -> 1674053537 00002000:00010000:2.0:1790771165.541461:0:13781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x15:0x0] updating lvb atime from disk: 0 -> 1752421453 00002000:00010000:2.0:1790771165.541463:0:13781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x15:0x0] updating lvb ctime from disk: 0 -> 1790771165 00002000:00010000:2.0:1790771165.541465:0:13781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x15:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771165.541517:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533673344:12345-192.168.204.50@tcp:2:cp.0 Request processed in 149us (578us total) trans 4294967574 rc 0/0 00002000:00010000:0.0:1790771165.541521:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 37366 -> 37366 00002000:00010000:0.0:1790771165.541529:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:2.0:1790771165.541530:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 877 00002000:00010000:0.0:1790771165.541537:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1790771165.541539:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533668992:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2748us (2866us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771165.541544:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.541551:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1790771165.541561:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 361 00000100:00100000:3.0:1790771165.541561:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 874 00000100:00100000:2.0:1790771165.541577:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533673216:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771165.541587:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2398:x1877759533672064:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 205us (1071us total) trans 4294967574 rc 0/0 00000100:00100000:3.0:1790771165.541590:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533669888 00000100:00100000:3.0:1790771165.541596:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533669888 00000100:00100000:0.0:1790771165.541602:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 360 00000100:00100000:3.0:1790771165.541627:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1364 00000100:00100000:3.0:1790771165.541641:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13559:x1877759533669888:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.541666:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533673216:12345-192.168.204.50@tcp:3:cat.0 Request processed in 88us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.541693:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 361 00002000:00100000:2.0:1790771165.541706:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (425984->430079) req@ffff8bfb064af100 x1877759533673216/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.541717:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064af100 with x1877759533673216 ext(425984->430079) 00002000:00010000:2.0:1790771165.541722:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb064af100 00000100:00100000:3.0:1790771165.541758:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13559:x1877759533669888:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (2639us total) trans 4294969098 rc 0/0 00000100:00100000:3.0:1790771165.541769:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1364 00000100:00100000:3.0:1790771165.544218:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.544649:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533673600 00000100:00100000:0.0:1790771165.544656:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533673600 00000100:00100000:0.0:1790771165.544703:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1365 00000100:00100000:0.0:1790771165.544712:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14247:x1877759533673600:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:0.0:1790771165.544798:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14247:x1877759533673600:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 88us (580us total) trans 4294969099 rc 0/0 00000100:00100000:0.0:1790771165.544805:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1365 00000100:00100000:3.0:1790771165.545063:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.545094:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533673856 00000100:00100000:2.0:1790771165.545100:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533673856 00000100:00100000:3.0:1790771165.545128:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.545138:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1366 00000100:00100000:2.0:1790771165.545147:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14605:x1877759533673856:12345-192.168.204.50@tcp:35:timeout.0 00000100:00100000:0.0:1790771165.545156:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533673984 00000100:00100000:0.0:1790771165.545162:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533673984 00010000:00010000:0.0:1790771165.545180:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 128 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.545208:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1499 00000100:00100000:0.0:1790771165.545218:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2399:x1877759533673984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.545227:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.545231:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 128 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545241:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 128 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.545250:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14605:x1877759533673856:12345-192.168.204.50@tcp:35:timeout.0 Request processed in 99us (182us total) trans 4294968527 rc 0/0 00010000:00010000:0.0:1790771165.545258:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f025b2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e8b expref: 128 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.545265:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1366 00010000:00010000:0.0:1790771165.545277:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:0.0:1790771165.545282:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545292:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545297:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545315:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.545330:0:13792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.545338:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2399:x1877759533673984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.545340:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.545351:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1499 00010000:00010000:2.0:1790771165.545364:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545373:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545380:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545427:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545432:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545437:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545444:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.545446:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545450:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545456:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:2.0:1790771165.545457:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771165.545460:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545463:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0a406 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545470:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545474:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545479:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545482:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.545503:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545508:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545517:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.545519:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790771165.545521:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545525:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a70f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545534:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545537:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545542:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545546:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.545548:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545551:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545555:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.545557:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.545558:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545562:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a3f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545571:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545575:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545579:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545582:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.545583:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545587:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545591:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfc13348000) 00010000:00010000:2.0:1790771165.545592:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.545594:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545597:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a3f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545605:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545609:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545612:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545616:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.545619:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545622:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545627:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbc0ca3a9 (ffff8bfc13348500) 00010000:00010000:2.0:1790771165.545629:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.545631:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545636:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545640:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545659:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.545667:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a3ff lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545674:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545691:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545730:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.545736:0:13792:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14186:x1877759533659520:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 79877us (80085us total) trans 0 rc -39/-39 00010000:00010000:0.0:1790771165.545741:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.545747:0:13792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 32 00010000:00010000:0.0:1790771165.545756:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.545775:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.545778:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.545786:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545793:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545799:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545804:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545808:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.545810:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545815:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545822:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.545824:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.545827:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545831:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a64b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545839:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545844:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545849:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545852:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.545855:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545859:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545864:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbc0ca3a9 (ffff8bfc13348500) 00010000:00010000:0.0:1790771165.545865:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.545867:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545870:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a659 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545886:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a63d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 127 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545893:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.545898:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.545899:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.545901:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686a00, rc 0) 00000100:00100000:0.0:1790771165.545921:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14299:x1877759533670272:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 6501us (6778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.545928:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5411 00000100:00100000:3.0:1790771165.545964:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.546000:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533674112 00000100:00100000:2.0:1790771165.546005:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533674112 00000100:00100000:2.0:1790771165.546038:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1367 00000100:00100000:2.0:1790771165.546048:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14568:x1877759533674112:12345-192.168.204.50@tcp:33:lfs.0 00000004:00200000:2.0:1790771165.546077:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.546080:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771165.546113:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14568:x1877759533674112:12345-192.168.204.50@tcp:33:lfs.0 Request processed in 69us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.546119:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1367 00000100:00100000:3.0:1790771165.546785:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.546819:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.546821:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533674496 00000100:00100000:2.0:1790771165.546825:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533674496 00000100:00100000:2.0:1790771165.546859:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533674624 00000100:00100000:2.0:1790771165.546862:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533674624 00000100:00100000:0.0:1790771165.546867:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5420 00000100:00100000:3.0:1790771165.546875:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.546880:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14203:x1877759533674496:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:2.0:1790771165.546896:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5421 00000100:00100000:2.0:1790771165.546906:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14259:x1877759533674624:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771165.546916:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.546925:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.546928:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a71d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bbe expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.546931:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.546946:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.546953:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.546965:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.546973:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.546975:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.546995:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.546996:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 107 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.547009:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.547023:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60e00 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000_UUID:13769:1877759539710336:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.547024:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547035:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547041:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547063:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653900 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.547076:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547080:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533674880 00010000:00010000:2.0:1790771165.547083:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547085:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533674880 00010000:00010000:2.0:1790771165.547094:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.547111:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000100:00100000:0.0:1790771165.547112:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533675264 00000004:00200000:2.0:1790771165.547115:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.547116:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533675264 00000004:00010000:2.0:1790771165.547126:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547134:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547138:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1368 00010000:00010000:2.0:1790771165.547147:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547148:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13763:x1877759533674880:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:2.0:1790771165.547160:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547166:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547170:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.547173:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547179:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547184:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.547187:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.547189:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547194:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a72b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547202:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.547207:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539709824:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.547209:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547215:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547219:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.547221:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547224:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547231:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc29009b00) 00010000:00010000:2.0:1790771165.547234:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.547237:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.547250:0:13778:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969100 00010000:00010000:2.0:1790771165.547251:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a732 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547287:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a71d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 73 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547304:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13763:x1877759533674880:12345-192.168.204.50@tcp:35:cat.0 Request processed in 154us (429us total) trans 4294969101 rc 0/0 00010000:00010000:2.0:1790771165.547306:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 72 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.547315:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547321:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1368 00010000:00010000:2.0:1790771165.547322:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000020:00080000:0.0:1790771165.547329:0:13778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771165.547329:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.547335:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02200, rc 0) 00000100:00100000:0.0:1790771165.547348:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1369 00000100:00100000:0.0:1790771165.547355:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13359:x1877759533675264:12345-192.168.204.50@tcp:35:dd.0 00000100:00100000:2.0:1790771165.547364:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14259:x1877759533674624:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 460us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.547370:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5421 00000100:00100000:2.0:1790771165.547393:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533675008 00000100:00100000:2.0:1790771165.547397:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533675008 00010000:00010000:2.0:1790771165.547413:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 122 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.547436:0:13778:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969102 00000100:00100000:2.0:1790771165.547442:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1500 00000100:00100000:3.0:1790771165.547446:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.547456:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759533675008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.547465:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.547469:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 122 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547507:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 122 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547521:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f09d1b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3483e expref: 122 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.547528:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13359:x1877759533675264:12345-192.168.204.50@tcp:35:dd.0 Request processed in 171us (523us total) trans 4294969103 rc 0/0 00000100:00100000:0.0:1790771165.547536:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1369 00010000:00010000:2.0:1790771165.547536:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00000100:00100000:3.0:1790771165.547544:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000020:00080000:0.0:1790771165.547546:0:13778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771165.547546:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547555:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547560:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547578:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.547614:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533675008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.547619:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1500 00010000:00010000:2.0:1790771165.547647:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547654:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547674:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547700:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547710:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547759:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547768:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 120 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547774:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.547781:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.547799:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 120 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547808:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 120 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.547819:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29017b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539710464:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.547856:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.547876:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2180 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.547922:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533674240 00000100:00100000:2.0:1790771165.547926:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533674240 00002000:00100000:2.0:1790771165.547945:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e:0x0] (4231168->4235263) req@ffff8bfc3facc700 x1877759533674240/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.547952:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3facc700 with x1877759533674240 ext(4231168->4235263) 00010000:00010000:2.0:1790771165.547959:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 25 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.547969:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 25 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.547975:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3facc700 00000100:00100000:2.0:1790771165.547992:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 80 00000100:00100000:2.0:1790771165.548002:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2398:x1877759533674240:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.548013:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533675520 00000100:00100000:3.0:1790771165.548018:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533675520 00000100:00100000:3.0:1790771165.548045:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533675776 00000100:00100000:3.0:1790771165.548048:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533675776 00000100:00100000:3.0:1790771165.548069:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5422 00000100:00100000:2.0:1790771165.548077:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2398:x1877759533674240:12345-192.168.204.50@tcp:3:cat.0 Request processed in 77us (536us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790771165.548079:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14017:x1877759533675520:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:2.0:1790771165.548088:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 80 00010000:00010000:3.0:1790771165.548092:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1790771165.548096:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e:0x0] (4231168->4235263) req@ffff8bfc3facc700 x1877759533674240/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/4536 e 0 to 0 dl 1790771176 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.548102:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a74e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bc5 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.548104:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3facc700 with x1877759533674240 ext(4231168->4235263) 00010000:00010000:2.0:1790771165.548113:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 25 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.548134:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 25 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.548141:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3facc700 00010000:00010000:3.0:1790771165.548174:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.548185:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.548189:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.548198:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.548208:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.548213:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.548218:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.548256:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13293:x1877759533669504:12345-192.168.204.50@tcp:37:ls.0 Request processed in 9824us (9890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.548263:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1363 00000100:00100000:0.0:1790771165.548288:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533676032 00000100:00100000:0.0:1790771165.548290:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533676032 00000100:00100000:0.0:1790771165.548312:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1371 00000100:00100000:0.0:1790771165.548318:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14287:x1877759533676032:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:0.0:1790771165.548424:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14287:x1877759533676032:12345-192.168.204.50@tcp:35:cp.0 Request processed in 106us (243us total) trans 4294968528 rc 0/0 00000100:00100000:0.0:1790771165.548430:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1371 00000100:00100000:0.0:1790771165.548450:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5423 00000100:00100000:0.0:1790771165.548457:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13997:x1877759533675776:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771165.548464:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.548472:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687800/0xfa0c505d97f0a763 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bcc expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548543:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548551:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548563:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548574:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548580:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548585:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548616:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548623:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548627:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.548642:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 21450 00000004:00200000:0.0:1790771165.548645:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.548653:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548659:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548664:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548671:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548676:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548693:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.548696:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548700:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548706:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.548708:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.548710:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548714:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a76a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548721:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548726:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548730:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548734:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.548737:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548741:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548745:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc13348f00) 00010000:00010000:0.0:1790771165.548746:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.548748:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548752:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a771 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548766:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687800/0xfa0c505d97f0a763 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bcc expref: 110 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548773:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bcc expref: 109 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.548777:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771165.548779:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.548780:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00000100:00100000:0.0:1790771165.548806:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13997:x1877759533675776:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 350us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.548810:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5423 00000004:00080000:2.0:1790771165.549024:0:12030:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x15:0x0], index 0: 0 00000004:00080000:2.0:1790771165.549031:0:12030:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x16:0x0], index 1: 0 00010000:00010000:2.0:1790771165.549115:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a77f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549130:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a77f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549145:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a77f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549170:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549189:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549197:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549202:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549206:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.549208:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549213:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549219:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.549221:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.549224:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549231:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a755 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.549240:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e063c71 reply state 00000000344e368a transno 4294968529 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549249:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549256:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:2.0:1790771165.549259:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.549262:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.549283:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a74e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bc5 expref: 75 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549296:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a77f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bc5 expref: 74 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.549302:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc29009200) 00010000:00010000:2.0:1790771165.549304:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.549305:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00000100:00100000:2.0:1790771165.549332:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14017:x1877759533675520:12345-192.168.204.50@tcp:101:dd.0 Request processed in 1257us (1891us total) trans 4294968529 rc 0/0 00000100:00100000:2.0:1790771165.549338:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5422 00000100:00100000:3.0:1790771165.550309:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.550334:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.550373:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533677184 00000100:00100000:2.0:1790771165.550378:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533677184 00000100:00100000:0.0:1790771165.550380:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533671680 00000100:00100000:0.0:1790771165.550388:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533671680 00000100:00100000:2.0:1790771165.550410:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533676288 00000100:00100000:2.0:1790771165.550414:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533676288 00000100:00100000:0.0:1790771165.550433:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5424 00000100:00100000:0.0:1790771165.550445:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14126:x1877759533677184:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771165.550458:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.550459:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5426 00010000:00010000:0.0:1790771165.550469:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a78d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bef expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.550476:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14407:x1877759533676288:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:3.0:1790771165.550518:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.550531:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.550541:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 108 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.550551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.550555:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550562:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a78d lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bef expref: 125 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.550564:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 5/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.550568:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533676416 00000100:00100000:3.0:1790771165.550574:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533676416 00010000:00010000:0.0:1790771165.550588:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.550592:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.550598:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a78d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bef expref: 125 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.550601:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.550604:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 878 00000100:00100000:3.0:1790771165.550619:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2398:x1877759533676416:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771165.550631:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687e00, rc 0) 00010000:00010000:2.0:1790771165.550632:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 130 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.550634:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.550645:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f7a0a08/0xfa0c505d97f0a7a9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bd3 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.550668:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14126:x1877759533677184:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 223us (355us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.550668:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06793800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539710592:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.550702:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5424 00000100:00100000:3.0:1790771165.550716:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539710720:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.550720:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533677440 00000100:00100000:0.0:1790771165.550724:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533677440 00000100:00100000:3.0:1790771165.550754:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa636c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.550761:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5427 00000100:00100000:0.0:1790771165.550774:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14171:x1877759533677440:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771165.550786:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 108 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550789:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.550798:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 108 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550802:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a7be lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bf6 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.550811:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06790380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539710848:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.550846:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2240 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.550866:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550893:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550902:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550918:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550934:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.550942:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.550994:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x36:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.551003:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551010:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551017:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551035:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551040:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.551045:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551068:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551081:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.551084:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.551087:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551091:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a7c5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551099:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551110:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551122:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551127:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.551130:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551134:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551142:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd6e9df9d (ffff8bfb03188900) 00010000:00010000:0.0:1790771165.551144:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.551147:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551154:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a7cc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551173:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a7be lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bf6 expref: 124 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551179:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.551181:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.551184:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a7be lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bf6 expref: 124 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.551191:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00000100:00100000:0.0:1790771165.551222:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14171:x1877759533677440:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 452us (705us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.551228:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5427 00000100:00100000:2.0:1790771165.551459:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13208:x1877759533675648:12345-192.168.204.50@tcp:37:ls.0 Request processed in 3581us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.551466:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1370 00000100:00100000:3.0:1790771165.554661:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.554701:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.554736:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533677952 00000100:00100000:0.0:1790771165.554742:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533677952 00000100:00100000:3.0:1790771165.554772:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5429 00000100:00100000:3.0:1790771165.554784:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14277:x1877759533677952:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.554795:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.554806:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a7da lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c0b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554870:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554882:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554891:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554913:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554922:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554928:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.554948:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.554957:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554962:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554968:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554972:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554976:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.554978:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554982:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554988:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.554991:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.554993:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.554998:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0a7e8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555018:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555035:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555054:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555062:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.555067:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555086:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555093:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc20109c00) 00010000:00010000:3.0:1790771165.555097:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.555101:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555109:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0a7f6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555140:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a7da lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c0b expref: 123 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555157:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.555164:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.555172:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0a7da lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c0b expref: 123 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555197:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593c00, rc 0) 00000100:00100000:3.0:1790771165.555240:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14277:x1877759533677952:12345-192.168.204.50@tcp:101:touch.0 Request processed in 455us (536us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.555252:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5429 00000100:00100000:2.0:1790771165.555627:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.555657:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533678080 00000100:00100000:3.0:1790771165.555664:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533678080 00002000:00010000:0.0:1790771165.555706:0:8408:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb atime: 0 -> 1790771163 00000100:00100000:3.0:1790771165.555708:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5430 00000100:00100000:3.0:1790771165.555719:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:12121:x1877759533678080:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771165.555724:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539709952:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.555727:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.555737:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a804 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c12 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.555755:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c4892ce/0xfa0c505d97f0a68a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b71 expref: 28 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555762:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555774:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.555781:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c4892ce/0xfa0c505d97f0a68a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b71 expref: 28 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555782:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.555804:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ae00, rc 0) 00000004:00200000:3.0:1790771165.555810:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.555813:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.555830:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a804 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 77 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555841:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 76 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.555847:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771165.555850:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533670400:12345-192.168.204.50@tcp:101:ln.0 Request processed in 16058us (16616us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771165.555851:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1790771165.555855:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0800, rc 0) 00000100:00100000:0.0:1790771165.555865:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 875 00000100:00100000:3.0:1790771165.555884:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:12121:x1877759533678080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 165us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.555890:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5430 00000100:00100000:2.0:1790771165.562566:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.562635:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533679744 00000100:00100000:3.0:1790771165.562642:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533679744 00000100:00100000:3.0:1790771165.562690:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5431 00000100:00100000:3.0:1790771165.562698:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14326:x1877759533679744:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:3.0:1790771165.562707:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.562715:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a812 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c3c expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562760:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562768:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562774:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562781:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562786:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.562791:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.562962:0:7771:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x16:0x0], index 0: 0 00010000:00010000:3.0:1790771165.563051:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a827 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563061:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a827 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563070:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a827 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563095:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563100:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563104:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563108:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563112:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.563114:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563118:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563125:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.563127:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.563129:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563137:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a819 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.563144:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019691245 reply state 00000000d7cad528 transno 4294968530 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563151:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563155:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfb0321ac00) 00010000:00010000:3.0:1790771165.563157:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.563158:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.563172:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a812 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c3c expref: 79 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563180:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a827 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c3c expref: 78 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.563185:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc20109c00) 00010000:00010000:3.0:1790771165.563187:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.563189:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00000100:00100000:3.0:1790771165.563217:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14326:x1877759533679744:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 521us (653us total) trans 4294968530 rc 0/0 00000100:00100000:3.0:1790771165.563222:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5431 00000100:00100000:2.0:1790771165.568406:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.568457:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533676800 00000100:00100000:0.0:1790771165.568462:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533676800 00000100:00100000:0.0:1790771165.568521:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5432 00000100:00100000:0.0:1790771165.568531:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14077:x1877759533676800:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771165.568540:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.568542:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29016a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539710208:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.568551:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a835 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34be1 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.568563:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.568610:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.568624:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.568625:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.568645:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.568654:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 2272 00000100:00100000:2.0:1790771165.568660:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.568699:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533678336 00000100:00100000:2.0:1790771165.568705:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533678336 00000100:00100000:3.0:1790771165.568720:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533678720 00000100:00100000:3.0:1790771165.568727:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533678720 00010000:00010000:0.0:1790771165.568730:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a835 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 134 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.568746:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 134 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.568753:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771165.568755:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5433 00010000:00010000:0.0:1790771165.568757:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:0.0:1790771165.568762:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687000, rc 0) 00000100:00100000:3.0:1790771165.568767:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5434 00000100:00100000:2.0:1790771165.568770:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14017:x1877759533678336:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771165.568781:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.568782:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14493:x1877759533678720:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:2.0:1790771165.568786:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1790771165.568791:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14077:x1877759533676800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 259us (384us total) trans 4294969105 rc 0/0 00000100:00100000:0.0:1790771165.568799:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5432 00010000:00010000:2.0:1790771165.568807:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a77f lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bc5 expref: 79 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.568811:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.568828:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc29009200) 00010000:00010000:3.0:1790771165.568832:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0a6c9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b94 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.568838:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.568850:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a84a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c19 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.568860:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00000100:00100000:0.0:1790771165.568862:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.568869:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.568891:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533678464 00010000:00010000:3.0:1790771165.568894:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.568895:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533678464 00010000:00010000:2.0:1790771165.568898:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.568914:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.568916:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.568927:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 879 00010000:00010000:3.0:1790771165.568935:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.568938:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.568944:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533678464:12345-192.168.204.50@tcp:2:chmod.0 00002000:00010000:0.0:1790771165.569032:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 4360 -> 4360 00002000:00010000:0.0:1790771165.569038:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.569045:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 1790771159 -> 0 00002000:00010000:0.0:1790771165.569049:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.569052:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 16 -> 16 00000004:00010000:3.0:1790771165.569058:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e74a58dd reply state 00000000bb4450e8 transno 4294969106 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569072:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569082:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00000100:00100000:0.0:1790771165.569083:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533678464:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 143us (225us total) trans 4294967575 rc 0/0 00000040:00080000:2.0:1790771165.569087:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 88 off9408 00010000:00010000:3.0:1790771165.569088:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.569093:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00080000:2.0:1790771165.569100:0:13767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 165774613120ns, next at 166289701276ns, rc = 0 00000100:00100000:0.0:1790771165.569104:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 879 00000040:00080000:2.0:1790771165.569136:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].15, 88 off9368 00000004:00080000:2.0:1790771165.569145:0:13767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 165774658297ns, next at 165824614272ns, rc = 0 00000100:00100000:3.0:1790771165.569145:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14493:x1877759533678720:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 366us (485us total) trans 4294969106 rc 0/0 00000100:00100000:3.0:1790771165.569156:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5434 00000100:00100000:3.0:1790771165.569223:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.569271:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533683584 00000100:00100000:2.0:1790771165.569277:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533683584 00000100:00100000:2.0:1790771165.569320:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5436 00000100:00100000:2.0:1790771165.569330:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14277:x1877759533683584:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:2.0:1790771165.569344:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.569354:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a874 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c66 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569416:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569426:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569436:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.569448:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.569467:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.569472:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533683840 00010000:00010000:2.0:1790771165.569476:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.569478:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533683840 00010000:00010000:2.0:1790771165.569519:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.569540:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5437 00000004:00200000:2.0:1790771165.569548:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00000100:00100000:3.0:1790771165.569555:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:12121:x1877759533683840:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.569560:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569568:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.569570:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569575:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.569578:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a897 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c6d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569593:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569607:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.569609:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.569613:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569619:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569632:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771165.569633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.569640:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.569643:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569659:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0a882 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569660:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.569693:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533679232 00010000:00010000:2.0:1790771165.569694:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569695:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569699:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533679232 00010000:00010000:2.0:1790771165.569718:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569720:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569725:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533679488 00000100:00100000:0.0:1790771165.569730:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533679488 00010000:00010000:2.0:1790771165.569740:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569746:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569747:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533679872 00010000:00010000:2.0:1790771165.569752:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058af000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.569753:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533679872 00010000:00010000:2.0:1790771165.569759:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569767:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569772:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569777:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc29009a00) 00010000:00010000:2.0:1790771165.569785:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.569787:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569789:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569810:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569811:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a890 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569841:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5439 00010000:00010000:2.0:1790771165.569856:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a874 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c66 expref: 123 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569857:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:11969:x1877759533679488:12345-192.168.204.50@tcp:101:ls.0 00000004:00200000:3.0:1790771165.569872:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.569873:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.569883:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c35 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569898:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.569902:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.569908:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a874 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c66 expref: 123 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.569917:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 88 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.569923:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03600, rc 0) 00010000:00010000:3.0:1790771165.569923:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.569929:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 88 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.569943:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.569951:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:2.0:1790771165.569953:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14277:x1877759533683584:12345-192.168.204.50@tcp:101:touch.0 Request processed in 623us (726us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.569958:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.569963:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687e00, rc 0) 00000100:00100000:2.0:1790771165.569973:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5436 00010000:00010000:3.0:1790771165.569981:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.569995:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:11969:x1877759533679488:12345-192.168.204.50@tcp:101:ls.0 Request processed in 141us (362us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.569998:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.570012:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5439 00010000:00010000:3.0:1790771165.570018:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.570022:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533676544 00010000:00010000:3.0:1790771165.570023:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570027:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533676544 00010000:00010000:3.0:1790771165.570031:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570051:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.570054:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.570057:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570062:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 880 00010000:00010000:3.0:1790771165.570069:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1200/0xfa0c505d97f0a89e lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570078:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533676544:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771165.570094:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.570096:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.570106:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0a8cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bda expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570118:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570140:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570149:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.570154:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570163:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3e8f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539710976:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.570173:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570185:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc20109900) 00010000:00010000:3.0:1790771165.570189:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.570192:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570198:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0a8a5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.570219:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.570230:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a897 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c6d expref: 87 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570235:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2900 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.570253:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.570256:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.570261:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0a897 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c6d expref: 87 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570263:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533677696 00000100:00100000:2.0:1790771165.570272:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533677696 00010000:00010000:3.0:1790771165.570276:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1c00, rc 0) 00000100:00100000:3.0:1790771165.570306:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:12121:x1877759533683840:12345-192.168.204.50@tcp:101:ls.0 Request processed in 754us (860us total) trans 4294968532 rc 301/301 00000100:00100000:2.0:1790771165.570315:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 881 00000100:00100000:3.0:1790771165.570324:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5437 00000100:00100000:0.0:1790771165.570328:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.570334:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533677696:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.570349:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.570354:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680000 00000100:00100000:3.0:1790771165.570358:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680000 00010000:00010000:2.0:1790771165.570365:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0a8e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c04 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.570399:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:3.0:1790771165.570413:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533680000:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:2.0:1790771165.570421:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3e8f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539711104:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.570426:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.570442:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.570442:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d1b46f/0xfa0c505d97f0a8eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c4a expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570455:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.570514:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29017b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539710464:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.570533:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.570566:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539711232:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.570569:0:7423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb0533e400/0xfa0c505d97f098d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f098ec expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.570578:0:7423:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb0533e400/0xfa0c505d97f098d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f098ec expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.570610:0:7423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb0533e400/0xfa0c505d97f098d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f098ec expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570615:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.570616:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94300 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.570628:0:7423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790771165.570642:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680256 00000100:00100000:3.0:1790771165.570648:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680256 00010000:00010000:0.0:1790771165.570656:0:7423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb0533e400/0xfa0c505d97f098d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f098ec expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570667:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711360:0@lo:103:jbd2/dm-1-8.0 00000001:00080000:0.0:1790771165.570690:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968531 is committed 00000004:00080000:0.0:1790771165.570699:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 9 committed 00000100:00100000:3.0:1790771165.570703:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1372 00000004:00080000:0.0:1790771165.570714:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 9 committed 00000100:00100000:3.0:1790771165.570715:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13292:x1877759533680256:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.570732:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1790771165.570752:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968528 is committed 00000001:00080000:0.0:1790771165.570824:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968508 is committed 00000100:00100000:2.0:1790771165.570875:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539711360 00000100:00100000:2.0:1790771165.570879:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539711360 00000100:00100000:3.0:1790771165.570901:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13292:x1877759533680256:12345-192.168.204.50@tcp:35:ls.0 Request processed in 188us (461us total) trans 4294969108 rc 0/0 00010000:00010000:0.0:1790771165.570904:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.570914:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1372 00010000:00010000:0.0:1790771165.570915:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570918:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00010000:00010000:0.0:1790771165.570928:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.570932:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+7:3624:x1877759539711360:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1790771165.570945:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.570950:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.570950:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.570952:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.570967:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f098ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f098d0 expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.570968:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.570979:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.570996:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc0ab7e300) 00010000:00010000:3.0:1790771165.570997:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.570998:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:0.0:1790771165.571006:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.571009:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.571012:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571013:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.571020:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571031:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f09d3e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571035:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571041:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+6:3624:x1877759539711360:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 111us (311us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.571054:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571057:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00010000:00010000:0.0:1790771165.571069:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571076:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571076:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc3600f200) 00010000:00010000:3.0:1790771165.571084:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.571090:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571091:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571098:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571109:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571115:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711872:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1790771165.571122:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x62:0x0].0x0 (ffff8bfc2008df00) 00010000:00010000:0.0:1790771165.571129:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.571133:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571142:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0a09b lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x62:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571142:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.571156:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f09c73 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571165:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571171:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571176:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711360:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1790771165.571178:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571185:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571188:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571191:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1790771165.571193:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571200:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711488:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1790771165.571202:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:0.0:1790771165.571211:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.571215:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571224:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f09f98 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571226:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571235:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571236:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.571238:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571254:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571256:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571272:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571274:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.571280:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571284:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00010000:00010000:0.0:1790771165.571285:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.571291:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571292:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571303:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+8:3626:x1877759539711616:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:3.0:1790771165.571316:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9537b590 (ffff8bfc113f3f00) 00010000:00010000:0.0:1790771165.571318:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571323:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00080000:2.0:1790771165.571326:0:12031:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:17 count 1 00010000:00010000:3.0:1790771165.571329:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571338:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03188600) 00010000:00010000:3.0:1790771165.571339:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f09c6c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571342:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.571345:0:12031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571347:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571356:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571369:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a36c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571384:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571384:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571394:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571409:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571417:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790771165.571418:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571428:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771165.571430:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.571436:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571440:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571442:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571456:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571464:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571471:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571482:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771165.571505:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771165.571508:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571511:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x50000000010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571521:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f09c7a lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571522:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571534:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x70000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571549:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.571555:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571558:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.571563:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571572:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0627f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539712128:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.571577:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571586:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0a4a0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571599:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571608:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571613:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571616:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571617:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a20c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.571626:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571632:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571633:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571652:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c19 expref: 60 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571654:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571661:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571662:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7a:0x0].0x0 (ffff8bfc20109d00) 00010000:00010000:3.0:1790771165.571671:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.571690:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571692:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571694:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc29009b00) 00010000:00010000:2.0:1790771165.571703:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1790771165.571710:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f09b0e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571715:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771165.571720:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.571721:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0a84a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c19 expref: 60 pid: 13767 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571723:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571725:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571747:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0a675 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571755:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c19 expref: 59 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571761:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571767:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571772:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.571772:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc29009b00) 00010000:00010000:2.0:1790771165.571778:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1790771165.571783:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03400, rc 0) 00010000:00010000:0.0:1790771165.571785:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571791:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571803:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571806:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571810:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14017:x1877759533678336:12345-192.168.204.50@tcp:101:dd.0 Request processed in 3043us (3187us total) trans 4294968531 rc 0/0 00010000:00010000:0.0:1790771165.571816:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x9537b590 (ffff8bfc20109400) 00010000:00010000:0.0:1790771165.571825:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.571829:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571830:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.571830:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5433 00010000:00010000:3.0:1790771165.571849:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.571850:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0a75c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571853:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571861:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571865:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571879:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571882:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x68:0x0].0x0 (ffff8bfc19631200) 00010000:00010000:0.0:1790771165.571885:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571886:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.571891:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571894:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.571899:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.571901:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571906:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f09c1f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.571921:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:0.0:1790771165.571922:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.571927:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.571933:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x12:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1790771165.571936:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfb0321ac00) 00000100:00100000:2.0:1790771165.571937:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.571942:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.571945:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.571957:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0a820 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571969:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.571976:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.571980:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3624:x1877759539711488:12345-0@lo:2:osp-syn-0-1.0 Request processed in 148us (746us total) trans 4294967577 rc 0/0 00010000:00010000:3.0:1790771165.571985:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.571994:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00010000:00010000:3.0:1790771165.571994:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.572000:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.572002:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572008:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572016:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533679104 00010000:00010000:3.0:1790771165.572018:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0xea196397 (ffff8bfb03146b00) 00000100:00100000:1.0:1790771165.572019:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533679104 00010000:00010000:3.0:1790771165.572024:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.572028:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572034:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f09eaa lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572054:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 888 00010000:00010000:3.0:1790771165.572058:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572068:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533679104:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:2.0:1790771165.572068:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.572069:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539712640:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.572077:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.572082:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.572083:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572089:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.572093:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d96a77e/0xfa0c505d97f0a907 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c27 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572094:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572113:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572114:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.572126:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x68:0x0].0x0 (ffff8bfc19631200) 00010000:00010000:3.0:1790771165.572129:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.572131:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572136:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f09f52 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x68:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572141:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790771165.572142:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.572143:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d2bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539712768:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.572153:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539712512:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1790771165.572169:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680384 00000100:00100000:2.0:1790771165.572174:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680384 00000100:00100000:1.0:1790771165.572182:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1af8d540 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.572188:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771165.572195:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 110 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572215:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539712384:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.572224:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572228:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539712640 00000100:00100000:2.0:1790771165.572228:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1501 00000100:00100000:1.0:1790771165.572235:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539712640 00000100:00100000:0.0:1790771165.572240:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.572243:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.572247:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759533680384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.572253:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572260:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539712512 00010000:00010000:3.0:1790771165.572261:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.572262:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.572265:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539712512 00010000:00010000:3.0:1790771165.572266:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572271:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539712384 00010000:00010000:2.0:1790771165.572273:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 110 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572277:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539712384 00010000:00010000:3.0:1790771165.572278:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572283:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1790771165.572297:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3627:x1877759539712640:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.572301:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xd870248a (ffff8bfc20109800) 00000100:00100000:0.0:1790771165.572304:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00010000:00010000:2.0:1790771165.572305:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 110 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572305:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.572311:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572318:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+7:3627:x1877759539712512:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.572324:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4800/0xfa0c505d97f09f3d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572326:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f08440 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33fa8 expref: 110 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1790771165.572335:0:13787:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:10 count 1 00010000:00010000:2.0:1790771165.572353:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x74:0x0].0x0 (ffff8bfc310f2900) 00010000:00010000:0.0:1790771165.572354:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572357:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572359:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572379:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572383:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3627:x1877759539712640:12345-0@lo:2:osp-syn-1-1.0 Request processed in 86us (270us total) trans 4294967576 rc 0/0 00010000:00010000:2.0:1790771165.572383:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572388:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 31 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572388:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572405:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00010000:00010000:2.0:1790771165.572406:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572413:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.572419:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572420:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0xa:0x0].0x0 since=2s v=(1 0) 00000100:00100000:1.0:1790771165.572426:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00010000:00010000:0.0:1790771165.572431:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771165.572433:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.572435:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572436:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572441:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3625:x1877759539712384:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1790771165.572457:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2397:x1877759533680384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 214us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.572471:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1501 00010000:00010000:3.0:1790771165.572473:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771165.572476:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.572479:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572480:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 31 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572518:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 31 pid: 13781 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572528:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539712896:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.572534:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572541:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572562:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0a040 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572566:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653900 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.572576:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572583:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684736 00010000:00010000:3.0:1790771165.572584:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572589:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684736 00010000:00010000:3.0:1790771165.572592:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572597:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.572599:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572605:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572615:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:3.0:1790771165.572619:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771165.572620:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533681024 00010000:00010000:3.0:1790771165.572623:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572625:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533681024 00010000:00010000:3.0:1790771165.572634:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0a238 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.572648:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5441 00000100:00100000:0.0:1790771165.572657:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14227:x1877759533684736:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:0.0:1790771165.572665:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.572688:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a915 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c89 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.572708:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000017a57c23 reply state 00000000e74d5475 transno 4294969109 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.572714:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 14872 -> 14872 00002000:00010000:1.0:1790771165.572722:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 1790771163 -> 1790771163 00002000:00010000:1.0:1790771165.572730:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790771165.572733:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 1790771164 -> 1790771164 00010000:00010000:2.0:1790771165.572735:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.572736:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 32 -> 32 00010000:00010000:3.0:1790771165.572741:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572748:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x74:0x0].0x0 (ffff8bfc310f2900) 00010000:00010000:2.0:1790771165.572755:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771165.572758:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.572758:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572762:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572765:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572773:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3625:x1877759539712384:12345-0@lo:2:osp-syn-1-1.0 Request processed in 335us (535us total) trans 4294967577 rc 0/0 00010000:00010000:2.0:1790771165.572786:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572790:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00010000:00010000:0.0:1790771165.572798:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572800:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572817:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967526 gen 2 00010000:00010000:2.0:1790771165.572819:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02c00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:1.0:1790771165.572822:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05a0e680, transno 4294967521 00010000:00010000:0.0:1790771165.572823:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572824:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572829:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.572832:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05a0df80, transno 4294967526 00000100:00100000:1.0:1790771165.572842:0:3625:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb06543b80 x1877759539712384/t4294967577(4294967577) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1790771165.572847:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572858:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572866:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000004:00080000:1.0:1790771165.572867:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06543b80/2, rc 0, transno 4294967577 00010000:00010000:2.0:1790771165.572873:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.572876:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572877:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.572880:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539712384:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.572889:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.572895:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572898:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0a6de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572903:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572910:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.572924:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000017a57c23 reply state 00000000e74d5475 transno 4294969109 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572932:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:2.0:1790771165.572933:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572938:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.572943:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.572945:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0xea196397 (ffff8bfc2900ab00) 00010000:00010000:2.0:1790771165.572950:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.572954:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1790771165.572954:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0a40d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.572966:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572971:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.572977:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06541c00/2, rc 0, transno 4294967576 00000100:00100000:1.0:1790771165.572989:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539712640:0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1790771165.572990:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:14615:x1877759533672832:12345-192.168.204.50@tcp:36:ln.0 Request processed in 32017us (32432us total) trans 4294969109 rc 0/0 00010000:00010000:0.0:1790771165.572993:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.572993:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573005:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5418 00000100:00100000:1.0:1790771165.573009:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967556 gen 2 00010000:00010000:3.0:1790771165.573015:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573020:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573022:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5e00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:1.0:1790771165.573023:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa94000, transno 4294967553 00010000:00010000:3.0:1790771165.573027:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573030:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5442 00000004:00080000:1.0:1790771165.573034:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb03c6fb80, transno 4294967556 00000004:00200000:0.0:1790771165.573043:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.573044:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14182:x1877759533681024:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:3.0:1790771165.573044:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573045:0:3624:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfc29017b80 x1877759539711488/t4294967577(4294967577) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790771165.573054:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573068:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfb0321ac00) 00010000:00010000:0.0:1790771165.573075:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.573076:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc29017b80/2, rc 0, transno 4294967577 00010000:00010000:3.0:1790771165.573076:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.573081:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573085:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29017b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711488:0@lo:2:osp-syn-0-1.0 00010000:00010000:0.0:1790771165.573092:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573099:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0a47d lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573102:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687a00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:1.0:1790771165.573103:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb03020e00/2, rc 0, transno 4294967576 00010000:00010000:0.0:1790771165.573109:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573111:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539711872:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1790771165.573116:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573117:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14182:x1877759533681024:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 73us (1123us total) trans 0 rc -17/-17 00010000:00010000:0.0:1790771165.573125:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573137:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5442 00010000:00010000:3.0:1790771165.573138:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573144:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771165.573149:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.573149:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573154:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573158:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04caee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.573162:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0a92a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573163:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573180:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.573182:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573187:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573194:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573199:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573204:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573209:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.573212:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573221:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573230:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00000100:00100000:1.0:1790771165.573232:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.573234:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.573237:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.573238:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573240:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.573249:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573250:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0a461 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573270:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0a91c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573282:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573287:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573292:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533681280 00000100:00100000:1.0:1790771165.573295:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.573298:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533681280 00010000:00010000:0.0:1790771165.573302:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573307:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.573310:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573316:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573320:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680640 00010000:00010000:0.0:1790771165.573324:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc22108500) 00000100:00100000:1.0:1790771165.573326:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680640 00010000:00010000:0.0:1790771165.573328:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.573332:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573332:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1373 00010000:00010000:0.0:1790771165.573343:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0a923 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573349:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13293:x1877759533681280:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.573350:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 92 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573358:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.573368:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a915 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c89 expref: 92 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573376:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.573379:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.573383:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0a915 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c89 expref: 92 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.573384:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680512 00000100:00100000:1.0:1790771165.573389:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680512 00000100:00100000:2.0:1790771165.573397:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.573403:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00010000:00010000:1.0:1790771165.573408:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 110 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573417:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533681920 00000100:00100000:2.0:1790771165.573422:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533681920 00000100:00100000:1.0:1790771165.573432:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533680768 00000100:00100000:1.0:1790771165.573436:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533680768 00000100:00100000:0.0:1790771165.573441:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1502 00000100:00100000:0.0:1790771165.573451:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2397:x1877759533680640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.573457:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5443 00010000:00010000:0.0:1790771165.573462:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.573470:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 91 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.573472:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:14503:x1877759533681920:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771165.573475:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1503 00010000:00010000:0.0:1790771165.573507:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 91 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573516:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13293:x1877759533681280:12345-192.168.204.50@tcp:35:ls.0 Request processed in 171us (1451us total) trans 4294969110 rc 0/0 00000100:00100000:1.0:1790771165.573517:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533680512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.573522:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f08ca5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342db expref: 91 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573535:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.573536:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1373 00010000:00010000:0.0:1790771165.573537:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6b:0x0].0x0 (ffff8bfc310f1000) 00010000:00010000:2.0:1790771165.573545:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573548:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573548:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 111 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.573566:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 139 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573570:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573577:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 110 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.573587:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.573591:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573609:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0a4c3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ae5 expref: 110 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573621:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771165.573624:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.573625:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 139 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573627:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573643:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 704 00000100:00100000:0.0:1790771165.573647:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:2397:x1877759533680640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (470us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.573650:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.573650:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 139 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573663:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2397:x1877759533680768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.573664:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1502 00010000:00010000:1.0:1790771165.573672:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573699:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.573700:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539713024:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.573712:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533681536 00010000:00010000:1.0:1790771165.573713:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.573717:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533681536 00010000:00010000:3.0:1790771165.573718:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0a636 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b5c expref: 139 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.573731:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:3.0:1790771165.573735:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1790771165.573746:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (430080->434175) req@ffff8bfc3d8aa680 x1877759533681536/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.573747:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2397:x1877759533680512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.573748:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.573762:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:2397:x1877759533680768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.573767:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1503 00002000:00100000:0.0:1790771165.573779:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aa680 with x1877759533681536 ext(430080->434175) 00010000:00010000:2.0:1790771165.573779:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573782:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 704 00002000:00010000:0.0:1790771165.573788:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3d8aa680 00010000:00010000:2.0:1790771165.573795:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573800:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573807:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.573815:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 362 00000100:00100000:0.0:1790771165.573825:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2396:x1877759533681536:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.573848:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771165.573868:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000061013cca reply state 00000000d8a6f9ca transno 4294969111 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573881:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.573890:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771165.573894:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.573897:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771165.573928:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2396:x1877759533681536:12345-192.168.204.50@tcp:3:cat.0 Request processed in 104us (574us total) trans 0 rc 0/0 00000040:00080000:2.0:1790771165.573930:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].16, 64 off9432 00000100:00100000:0.0:1790771165.573937:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 362 00002000:00100000:0.0:1790771165.573944:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (430080->434175) req@ffff8bfc3d8aa680 x1877759533681536/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.573951:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14203:x1877759533674496:12345-192.168.204.50@tcp:36:cp.0 Request processed in 27074us (27609us total) trans 4294969111 rc 0/0 00002000:00100000:0.0:1790771165.573961:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aa680 with x1877759533681536 ext(430080->434175) 00010000:00010000:2.0:1790771165.573966:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.573966:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771165.573970:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3d8aa680 00000100:00100000:1.0:1790771165.573970:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5420 00010000:00010000:2.0:1790771165.573982:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.573990:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.573996:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574005:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574010:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574029:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14227:x1877759533684736:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 1371us (2091us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.574030:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790771165.574042:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5441 00010000:00010000:2.0:1790771165.574044:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574051:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574055:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574059:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.574061:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574065:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574075:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6b:0x0].0x0 (ffff8bfc310f1000) 00010000:00010000:2.0:1790771165.574077:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771165.574080:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574081:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533677568 00010000:00010000:3.0:1790771165.574081:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790771165.574089:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533677568 00010000:00010000:2.0:1790771165.574091:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0a747 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574091:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574104:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.574113:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574121:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682304 00010000:00010000:2.0:1790771165.574121:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574126:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682304 00010000:00010000:2.0:1790771165.574133:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574137:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574141:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.574143:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574148:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574158:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.574159:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00000100:00100000:0.0:1790771165.574161:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5444 00010000:00010000:2.0:1790771165.574166:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.574166:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574172:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.574173:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 3/0,0 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574177:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:14120:x1877759533677568:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771165.574191:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0a5bf lrc: 0/0,0 mode: --/CW res: [0x240000402:0x67:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574192:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.574193:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682432 00000100:00100000:1.0:1790771165.574199:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682432 00000004:00010000:2.0:1790771165.574205:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003a716cc7 reply state 0000000077ea7ab7 transno 4294968533 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574206:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a93f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34bfd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574213:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574224:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5445 00010000:00010000:2.0:1790771165.574231:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574240:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:14089:x1877759533682304:12345-192.168.204.50@tcp:55:cp.0 00010000:00010000:3.0:1790771165.574240:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6b:0x0].0x0 (ffff8bfc310f1000) 00010000:00010000:2.0:1790771165.574244:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x1d91fb2c (ffff8bfc29009500) 00010000:00010000:3.0:1790771165.574246:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790771165.574251:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574252:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.574254:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.574258:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771165.574266:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574269:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,1 mode: --/PW res: [0x240000402:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574274:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574279:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574290:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574290:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.574303:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:14395:x1877759533667968:12345-192.168.204.50@tcp:36:rm.0 Request processed in 37040us (37151us total) trans 4294968533 rc 0/0 00010000:00010000:0.0:1790771165.574313:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574314:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0a938 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x6b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.574320:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5405 00010000:00010000:1.0:1790771165.574323:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574335:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574339:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574347:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771165.574349:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5446 00010000:00010000:3.0:1790771165.574351:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.574357:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.574359:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.574364:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13972:x1877759533682432:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771165.574368:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.574369:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574374:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.574375:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574381:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574383:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574389:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a95b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.574390:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.574401:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574408:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:1.0:1790771165.574414:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771165.574415:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574418:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 2/0,0 mode: --/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574421:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ba00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.574427:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.574429:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0a94d lrc: 0/0,0 mode: --/PW res: [0x240000402:0x83:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574435:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574441:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.574449:0:13782:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime: 1752421453 -> 1790771163 00010000:00010000:2.0:1790771165.574458:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574463:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771165.574466:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539710720:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.574467:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574468:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.574474:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574476:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14089:x1877759533682304:12345-192.168.204.50@tcp:55:cp.0 Request processed in 237us (375us total) trans 0 rc -22/-22 00010000:00010000:0.0:1790771165.574515:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0a946 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574531:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574536:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574544:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574550:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f7a0a08/0xfa0c505d97f0a7a9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bd3 expref: 31 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574552:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5445 00000004:00200000:2.0:1790771165.574553:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.574558:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ae00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771165.574560:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.574564:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.574573:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574581:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574605:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc22108f00) 00010000:00010000:0.0:1790771165.574608:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.574611:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574614:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0a95b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 91 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.574615:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f7a0a08/0xfa0c505d97f0a7a9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bd3 expref: 31 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574620:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0a954 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.574628:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.574651:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80600, rc 0) 00010000:00010000:2.0:1790771165.574658:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 90 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.574666:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a93f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bfd expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.574697:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2398:x1877759533676416:12345-192.168.204.50@tcp:101:ln.0 Request processed in 24078us (24147us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.574705:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.574707:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:1.0:1790771165.574710:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.574713:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.574716:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.574717:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 878 00010000:00010000:0.0:1790771165.574722:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0a93f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bfd expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.574724:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00010000:00010000:0.0:1790771165.574736:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687200, rc 0) 00000100:00100000:2.0:1790771165.574754:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13972:x1877759533682432:12345-192.168.204.50@tcp:101:cat.0 Request processed in 392us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.574767:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5446 00000100:00100000:0.0:1790771165.574768:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:14120:x1877759533677568:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 592us (802us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.574772:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.574786:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5444 00000100:00100000:2.0:1790771165.574795:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533683072 00000100:00100000:2.0:1790771165.574800:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533683072 00000100:00100000:0.0:1790771165.574822:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682560 00000100:00100000:0.0:1790771165.574827:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682560 00000100:00100000:2.0:1790771165.574834:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5447 00000100:00100000:1.0:1790771165.574844:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.574848:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:14331:x1877759533683072:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771165.574857:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.574862:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533683328 00010000:00010000:2.0:1790771165.574866:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a969 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c5f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574867:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533683328 00000100:00100000:3.0:1790771165.574882:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1374 00010000:00010000:2.0:1790771165.574888:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a970 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.574896:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:14247:x1877759533682560:12345-192.168.204.50@tcp:35:lfs.0 00010000:00010000:2.0:1790771165.574900:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574904:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1375 00000100:00100000:1.0:1790771165.574913:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.574917:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a970 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.574918:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13208:x1877759533683328:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.574939:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.574957:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.574974:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684224 00000100:00100000:1.0:1790771165.574978:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684224 00010000:00010000:2.0:1790771165.574991:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0a969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c5f expref: 141 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575008:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a970 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c5f expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575009:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 892 00000100:00100000:0.0:1790771165.575022:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:13208:x1877759533683328:12345-192.168.204.50@tcp:35:ls.0 Request processed in 104us (177us total) trans 4294968534 rc 0/0 00010000:00010000:2.0:1790771165.575022:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00000100:00100000:1.0:1790771165.575023:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14326:x1877759533684224:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771165.575028:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.575033:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57600, rc 0) 00010000:00010000:1.0:1790771165.575038:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.575042:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1375 00010000:00010000:1.0:1790771165.575052:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c82 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575063:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:14331:x1877759533683072:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 220us (299us total) trans 0 rc 0/0 00002000:00010000:1.0:1790771165.575067:0:8408:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1790771165.575068:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533683968 00000100:00100000:2.0:1790771165.575071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5447 00000100:00100000:0.0:1790771165.575074:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533683968 00010000:00010000:1.0:1790771165.575083:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=165s v=(0 0) 00010000:00010000:1.0:1790771165.575088:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1790771165.575091:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684096 00010000:00010000:1.0:1790771165.575097:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575097:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684096 00000100:00100000:0.0:1790771165.575107:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5448 00000100:00100000:0.0:1790771165.575120:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13997:x1877759533683968:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771165.575123:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575130:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.575134:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5200, rc 0) 00000100:00100000:2.0:1790771165.575134:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5449 00010000:00010000:0.0:1790771165.575143:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a97e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c74 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575150:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:14363:x1877759533684096:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:3.0:1790771165.575158:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:14247:x1877759533682560:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 264us (770us total) trans 4294969112 rc 0/0 00010000:00010000:2.0:1790771165.575163:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.575164:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14326:x1877759533684224:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 141us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.575171:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1374 00000100:00100000:1.0:1790771165.575175:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 892 00010000:00010000:2.0:1790771165.575179:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a985 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c7b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575182:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575194:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575201:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575216:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575219:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575225:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.575240:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575241:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575247:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684608 00000100:00100000:1.0:1790771165.575253:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684608 00010000:00010000:0.0:1790771165.575255:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575262:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575281:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5450 00000004:00200000:2.0:1790771165.575289:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.575291:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+59:12123:x1877759533684608:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.575293:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x42:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.575296:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771165.575301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.575307:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.575309:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.575312:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575316:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f0a9a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c90 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575319:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.575354:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x42:0x0]: returning size 6971 00010000:00010000:2.0:1790771165.575356:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0a985 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c7b expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.575359:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.575364:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.575372:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575377:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575378:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c7b expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575386:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575399:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575403:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.575407:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575409:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.575414:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af000, rc 0) 00010000:00010000:0.0:1790771165.575422:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575428:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.575432:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.575437:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771165.575440:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771165.575442:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14363:x1877759533684096:12345-192.168.204.50@tcp:101:chown.0 Request processed in 295us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.575455:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5449 00010000:00010000:0.0:1790771165.575456:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.575457:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575467:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684864 00000100:00100000:2.0:1790771165.575472:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684864 00010000:00010000:0.0:1790771165.575475:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.575479:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575516:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533684992 00010000:00010000:1.0:1790771165.575518:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f0a9a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c90 expref: 60 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575520:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533684992 00010000:00010000:0.0:1790771165.575527:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575539:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.575543:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.575544:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c90 expref: 60 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575548:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5451 00010000:00010000:0.0:1790771165.575549:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575562:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:13978:x1877759533684864:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771165.575567:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.575569:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0a98c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575573:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.575575:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.575579:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.575580:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5a00, rc 0) 00010000:00010000:2.0:1790771165.575585:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0a9b6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c97 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575590:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575597:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.575601:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685760 00010000:00010000:0.0:1790771165.575603:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575604:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575607:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:12123:x1877759533684608:12345-192.168.204.50@tcp:101:ls.0 Request processed in 317us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.575607:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685760 00010000:00010000:0.0:1790771165.575626:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc0151fa00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.575628:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5450 00010000:00010000:2.0:1790771165.575629:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575630:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.575647:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1376 00000100:00100000:1.0:1790771165.575651:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5452 00010000:00010000:0.0:1790771165.575667:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.575668:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14367:x1877759533684992:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:3.0:1790771165.575669:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14436:x1877759533685760:12345-192.168.204.50@tcp:35:lfs.0 00010000:00010000:2.0:1790771165.575670:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575699:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc22108b00) 00010000:00010000:1.0:1790771165.575699:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.575704:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.575707:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575710:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0a9c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c9e expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575712:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0a99a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575745:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0a97e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c74 expref: 112 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575752:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575756:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c74 expref: 111 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.575766:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.575767:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00010000:00010000:0.0:1790771165.575774:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.575778:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f400, rc 0) 00010000:00010000:1.0:1790771165.575783:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575785:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0a9b6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 93 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.575803:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13997:x1877759533683968:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 684us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.575810:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5448 00000004:00200000:1.0:1790771165.575811:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.575813:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 92 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.575817:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.575826:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000100:00100000:3.0:1790771165.575830:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:14436:x1877759533685760:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 168us (256us total) trans 4294968535 rc 0/0 00010000:00010000:2.0:1790771165.575831:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00010000:1.0:1790771165.575832:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.575837:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03600, rc 0) 00000100:00100000:3.0:1790771165.575848:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1376 00000100:00100000:0.0:1790771165.575866:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.575867:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0a9c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c9e expref: 62 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575871:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:13978:x1877759533684864:12345-192.168.204.50@tcp:101:dd.0 Request processed in 310us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.575885:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5451 00000100:00100000:0.0:1790771165.575887:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686016 00000100:00100000:0.0:1790771165.575891:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686016 00010000:00010000:1.0:1790771165.575906:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c9e expref: 61 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575912:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682048 00010000:00010000:1.0:1790771165.575914:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771165.575917:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682048 00010000:00010000:1.0:1790771165.575919:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.575923:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5800, rc 0) 00000100:00100000:0.0:1790771165.575927:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5453 00010000:00010000:2.0:1790771165.575936:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 25 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.575940:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:14077:x1877759533686016:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:1.0:1790771165.575952:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:14367:x1877759533684992:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 287us (582us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.575955:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.575959:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5452 00010000:00010000:0.0:1790771165.575966:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0a9d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cc8 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.575969:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682816 00000100:00100000:2.0:1790771165.575973:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682816 00010000:00010000:2.0:1790771165.575991:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 142 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576006:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.576014:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533682944 00010000:00010000:0.0:1790771165.576016:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.576018:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533682944 00010000:00010000:0.0:1790771165.576025:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576034:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 111 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576038:0:6495:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576050:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.576065:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1504 00000100:00100000:2.0:1790771165.576075:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533682048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.576082:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790771165.576088:0:13784:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb size from disk: 17315 -> 9306112 00002000:00010000:2.0:1790771165.576090:0:13784:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb mtime from disk: 1790771164 -> 1790771165 00002000:00010000:2.0:1790771165.576092:0:13784:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:2.0:1790771165.576094:0:13784:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb blocks from disk: 0 -> 6016 00010000:00010000:2.0:1790771165.576098:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 7 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 25 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576109:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 7 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 25 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.576116:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1505 00010000:00010000:2.0:1790771165.576125:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac944a4d/0xfa0c505d97f06840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 7 type: EXT [0->10682367] (req 6225920->6291455) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c8 expref: 25 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.576134:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2396:x1877759533682816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.576136:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539710976:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.576141:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(14 1) 00010000:00010000:2.0:1790771165.576147:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(14 1) 00010000:00010000:0.0:1790771165.576151:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.576153:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a36 expref: 29 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576160:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0a8cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bda expref: 29 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576162:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 142 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576169:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a36 expref: 29 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576194:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0a8cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bda expref: 29 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576196:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 142 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576203:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(14 1) 00010000:00010000:2.0:1790771165.576212:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(14 1) 00010000:00010000:1.0:1790771165.576223:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00010000:00010000:2.0:1790771165.576224:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576231:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771165.576237:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576238:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576247:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533676544:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 6173us (6676us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.576262:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.576269:0:13788:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb size: 9306112 -> 14614528 00000100:00100000:1.0:1790771165.576270:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 880 00010000:00010000:0.0:1790771165.576272:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.576275:0:13788:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb atime: 1790771160 -> 1790771165 00010000:00010000:0.0:1790771165.576285:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576291:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.576291:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539711232:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.576300:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576307:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1506 00010000:00010000:3.0:1790771165.576315:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099d1b46f/0xfa0c505d97f0a8eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c4a expref: 27 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.576317:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2396:x1877759533682816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 191us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.576318:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539713152:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771165.576326:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533682944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.576339:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1505 00010000:00010000:1.0:1790771165.576345:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.576349:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d1b46f/0xfa0c505d97f0a8eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c4a expref: 27 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576356:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 111 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.576362:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372a00, rc 0) 00010000:00010000:1.0:1790771165.576375:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 111 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576378:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a643e82c/0xfa0c505d97f0a29a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [4194304->8388607] (req 4194304->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a36 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576388:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0a683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b78 expref: 141 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.576394:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533680000:12345-192.168.204.50@tcp:101:ln.0 Request processed in 5983us (6073us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771165.576407:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771165.576410:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539713280:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.576416:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.576416:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:0.0:1790771165.576420:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06793800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539710592:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.576433:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.576439:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc105a7540 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.576440:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576444:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0a525 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34aec expref: 111 pid: 13771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576453:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40290400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576460:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.576464:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06790380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539710848:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.576468:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.576474:0:13781:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime: 0 -> 1790771160 00010000:00010000:1.0:1790771165.576508:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.576509:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3e8f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539711104:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.576519:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576527:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576534:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0a8e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c04 expref: 26 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576535:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2396:x1877759533682944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 215us (1826us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.576550:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576557:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1506 00000100:00100000:3.0:1790771165.576560:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.576568:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0a8e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c04 expref: 26 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.576579:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00000100:00100000:1.0:1790771165.576600:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d2be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13793:1877759539712000:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.576604:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533677696:12345-192.168.204.50@tcp:101:chown.0 Request processed in 6274us (6384us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.576612:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 881 00010000:00010000:1.0:1790771165.576629:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1b5170d/0xfa0c505d97f0a8f2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be8 expref: 25 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.576630:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cab99c74 reply state 0000000070ef2417 transno 4294969113 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.576649:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0627f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539712128:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.576652:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576658:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1b5170d/0xfa0c505d97f0a8f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be8 expref: 25 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576662:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771165.576666:0:12031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576669:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.576674:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576674:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5800, rc 0) 00010000:00010000:0.0:1790771165.576704:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576710:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576715:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533676928:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 5620us (6103us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.576724:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 883 00000100:00100000:0.0:1790771165.576732:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.576737:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.576768:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:14407:x1877759533676288:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 26297us (26381us total) trans 4294969113 rc 0/0 00000100:00100000:0.0:1790771165.576775:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5426 00000100:00100000:0.0:1790771165.576795:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686784 00000100:00100000:0.0:1790771165.576799:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686784 00000100:00100000:0.0:1790771165.576826:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5454 00000100:00100000:0.0:1790771165.576834:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14182:x1877759533686784:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1790771165.576840:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.576848:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0a9e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ce4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576873:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576880:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576886:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576894:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539712256:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.576896:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576907:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576913:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.576917:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576946:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.576952:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576955:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686656 00010000:00010000:0.0:1790771165.576959:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.576960:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686656 00000004:00200000:0.0:1790771165.576983:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 5134 00000004:00200000:0.0:1790771165.576986:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.576997:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577000:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1377 00010000:00010000:0.0:1790771165.577011:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577015:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:11969:x1877759533686656:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771165.577023:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577030:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577035:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577039:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577044:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.577047:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577051:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577060:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.577062:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.577065:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577070:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0a9e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577078:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577084:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577089:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577092:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577093:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.577099:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577104:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577111:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.577112:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.577125:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xcdd6ff3 (ffff8bfc22108000) 00010000:00010000:0.0:1790771165.577128:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.577130:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577134:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0a9ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.577138:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 2272 00000004:00200000:2.0:1790771165.577141:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.577153:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577158:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0a9e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 112 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577173:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577179:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:2.0:1790771165.577182:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0a9d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 142 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577183:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.577187:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73200, rc 0) 00000100:00100000:3.0:1790771165.577198:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.577213:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.577220:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539712896:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.577225:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:3.0:1790771165.577228:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.577234:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.577239:0:13787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577239:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fe00, rc 0) 00000100:00100000:3.0:1790771165.577252:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.577268:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533687296 00000100:00100000:0.0:1790771165.577272:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533687296 00000100:00100000:2.0:1790771165.577280:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14077:x1877759533686016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 1343us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.577285:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.577295:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5453 00000100:00100000:0.0:1790771165.577299:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533687680 00000100:00100000:0.0:1790771165.577303:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533687680 00000100:00100000:3.0:1790771165.577312:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533687808 00000100:00100000:3.0:1790771165.577317:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533687808 00000100:00100000:2.0:1790771165.577320:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533688192 00000100:00100000:2.0:1790771165.577326:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533688192 00000100:00100000:0.0:1790771165.577329:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5455 00000100:00100000:0.0:1790771165.577339:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14089:x1877759533687296:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:3.0:1790771165.577352:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5456 00000100:00100000:3.0:1790771165.577363:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14299:x1877759533687680:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771165.577367:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.577370:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5457 00010000:00010000:0.0:1790771165.577381:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.577388:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:13208:x1877759533687808:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.577391:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577396:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577400:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.577410:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577415:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0aa0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cf2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577419:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577435:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577441:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577447:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 141 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577453:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577458:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577460:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 141 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.577465:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006a0785a4 reply state 00000000c789548a transno 4294968536 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577480:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577482:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 10/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577533:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577534:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 141 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577539:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577559:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:3.0:1790771165.577560:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 141 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577563:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00200000:2.0:1790771165.577564:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.577568:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771165.577571:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771165.577579:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d2bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539712768:192.168.204.50@tcp:106: 00000004:00010000:2.0:1790771165.577585:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.577590:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06542680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.577600:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14089:x1877759533687296:12345-192.168.204.50@tcp:36:cp.0 Request processed in 262us (523us total) trans 4294968536 rc 0/0 00010000:00010000:1.0:1790771165.577604:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d96a77e/0xfa0c505d97f0a907 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c27 expref: 24 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577610:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0aa0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf2 expref: 97 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.577612:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5455 00010000:00010000:1.0:1790771165.577636:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d96a77e/0xfa0c505d97f0a907 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c27 expref: 24 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.577638:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5458 00010000:00010000:2.0:1790771165.577646:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf2 expref: 95 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.577652:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5600, rc 0) 00000100:00100000:0.0:1790771165.577653:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:14195:x1877759533688192:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1790771165.577657:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577670:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:1.0:1790771165.577688:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759533679104:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 5613us (5780us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.577690:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.577691:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790771165.577692:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 141 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577696:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00010000:00010000:0.0:1790771165.577707:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a200/0xfa0c505d97f03509 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32473 expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577709:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 888 00000100:00100000:3.0:1790771165.577717:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06374000 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713536:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.577732:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97efb710 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f68a expref: 62 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.577733:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13208:x1877759533687808:12345-192.168.204.50@tcp:101:ls.0 Request processed in 347us (505us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.577755:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00000100:00100000:2.0:1790771165.577756:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5457 00010000:00010000:3.0:1790771165.577756:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 141 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577763:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.577766:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14182:x1877759533686784:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 931us (1032us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.577776:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.577782:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686912 00010000:00010000:3.0:1790771165.577782:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 141 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577783:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5454 00000100:00100000:2.0:1790771165.577789:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686912 00010000:00010000:0.0:1790771165.577795:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.577802:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06376d80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713664:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.577806:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577810:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577824:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577830:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577837:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577838:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.577845:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1507 00000100:00100000:1.0:1790771165.577854:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.577861:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533686912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.577863:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 141 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577877:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.577881:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94c700 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713792:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.577886:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533687040 00010000:00010000:2.0:1790771165.577886:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577894:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533687040 00010000:00010000:2.0:1790771165.577900:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x50000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577904:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577910:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577915:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b2ef188/0xfa0c505d97f0760f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->49151) gid 0 flags: 0x44801400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33b56 expref: 23 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577920:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 94 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.577920:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000122d1f1a/0xfa0c505d97efec07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e309a7 expref: 28 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.577954:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 94 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.577960:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 141 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.577965:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790771165.577968:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.577972:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1508 00010000:00010000:2.0:1790771165.577975:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00000100:00100000:1.0:1790771165.577986:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2396:x1877759533687040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.577987:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.577993:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713920:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.578001:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.578007:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 94 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578009:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578012:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000122d1f1a/0xfa0c505d97efec07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e309a7 expref: 28 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.578022:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578034:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 94 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578047:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.578053:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 141 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.578067:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759533686912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 208us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.578068:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539714048:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.578070:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000122d1f1a/0xfa0c505d97efec07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e309a7 expref: 28 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.578085:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539714176:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.578087:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1507 00010000:00010000:1.0:1790771165.578100:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000122d1f1a/0xfa0c505d97efec07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e309a7 expref: 28 pid: 13788 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578112:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 2) 00010000:00010000:0.0:1790771165.578114:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 94 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578116:0:12031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578117:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 2) 00010000:00010000:3.0:1790771165.578129:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578130:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578142:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 94 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578144:0:12031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578159:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.578162:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 141 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578175:0:12031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.578177:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539714304:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.578197:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb55880 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539714432:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.578199:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.578200:0:12031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.578216:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653900 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.578218:0:12031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771165.578224:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533687040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.578228:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.578232:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1508 00010000:00010000:1.0:1790771165.578258:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578268:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578279:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578290:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.578313:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1790771165.578314:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539711616:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7017us (7425us total) trans 4294967578 rc 0/0 00000100:00100000:2.0:1790771165.578327:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00100000:0.0:1790771165.578338:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539713024:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.578346:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790771165.578353:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578354:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.578371:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.578373:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38200 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.578378:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578387:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.578391:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533688320 00000100:00100000:0.0:1790771165.578396:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533688320 00010000:00010000:2.0:1790771165.578401:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578408:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0a8f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.578416:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539711744:12345-0@lo:6:osp-syn-0-1.0 Request processed in 7103us (7446us total) trans 4294967579 rc 0/0 00000100:00100000:1.0:1790771165.578426:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:0.0:1790771165.578431:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5459 00010000:00010000:2.0:1790771165.578432:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771165.578436:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.578442:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13269:x1877759533688320:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.578445:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5a00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771165.578449:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.578452:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.578453:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb03020700/2, rc 0, transno 4294967579 00010000:00010000:0.0:1790771165.578455:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.578466:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0aa2d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cf9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.578467:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539711744:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1790771165.578475:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578515:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.578521:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb03023b80/2, rc 0, transno 4294967578 00010000:00010000:2.0:1790771165.578522:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cafe8005/0xfa0c505d97f0a900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.578530:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03023b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539711616:0@lo:6:osp-syn-0-1.0 00010000:00010000:0.0:1790771165.578538:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578547:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.578548:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.578552:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.578558:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.578560:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.578574:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.578576:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.578586:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578602:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0aa2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 144 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578618:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 143 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.578624:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771165.578626:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.578628:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687600, rc 0) 00000100:00100000:0.0:1790771165.578648:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:13269:x1877759533688320:12345-192.168.204.50@tcp:101:ls.0 Request processed in 211us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.578653:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5459 00000100:00100000:3.0:1790771165.580099:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.580142:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533688832 00000100:00100000:0.0:1790771165.580149:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533688832 00000100:00100000:0.0:1790771165.580178:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5460 00000100:00100000:0.0:1790771165.580184:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc34320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14277:x1877759533688832:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:0.0:1790771165.580193:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.580200:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0aa3b lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d07 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580259:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580272:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580280:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580296:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580305:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580313:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.580338:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:0.0:1790771165.580350:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580359:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.580359:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.580367:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580372:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580376:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.580379:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580383:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580390:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.580392:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.580394:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580402:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0aa42 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.580406:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533690112 00010000:00010000:0.0:1790771165.580411:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.580414:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533690112 00010000:00010000:0.0:1790771165.580418:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580424:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580428:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.580430:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580434:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580439:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc22108100) 00010000:00010000:0.0:1790771165.580441:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.580442:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580446:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa49 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.580456:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5461 00000100:00100000:1.0:1790771165.580469:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14587:x1877759533690112:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:0.0:1790771165.580472:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0aa3b lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d07 expref: 96 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580506:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.580508:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.580512:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.580516:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0aa3b lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d07 expref: 96 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580521:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0aa50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34c51 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.580526:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00000100:00100000:0.0:1790771165.580560:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc34320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14277:x1877759533688832:12345-192.168.204.50@tcp:101:touch.0 Request processed in 376us (461us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.580566:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5460 00010000:00010000:1.0:1790771165.580586:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580600:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580611:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.580622:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 38336 00010000:00010000:1.0:1790771165.580697:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0aa50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 146 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580715:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 145 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.580724:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:1.0:1790771165.580727:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790771165.580730:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2e00, rc 0) 00000100:00100000:1.0:1790771165.580772:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:14587:x1877759533690112:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 306us (415us total) trans 4294969114 rc 0/0 00000100:00100000:1.0:1790771165.580782:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5461 00010000:00010000:0.0:1790771165.586593:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790771165.588219:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.588261:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.588276:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533688576 00000100:00100000:2.0:1790771165.588286:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533688576 00000100:00100000:3.0:1790771165.588315:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.588316:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685120 00000100:00100000:1.0:1790771165.588324:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685120 00000100:00100000:2.0:1790771165.588386:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685504 00000100:00100000:2.0:1790771165.588391:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685504 00000100:00100000:1.0:1790771165.588400:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5462 00000100:00100000:0.0:1790771165.588413:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5463 00000100:00100000:1.0:1790771165.588414:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:13996:x1877759533688576:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:3.0:1790771165.588421:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.588429:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:11823:x1877759533685120:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.588435:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.588440:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.588441:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5464 00010000:00010000:1.0:1790771165.588454:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0aa65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d00 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.588458:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533688448 00010000:00010000:0.0:1790771165.588459:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ca5 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.588463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.588464:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533688448 00000100:00100000:3.0:1790771165.588508:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689088 00000100:00100000:3.0:1790771165.588514:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689088 00002000:00100000:2.0:1790771165.588516:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (434176->438271) req@ffff8bfb0552e680 x1877759533688448/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.588527:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552e680 with x1877759533688448 ext(434176->438271) 00002000:00010000:2.0:1790771165.588532:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0552e680 00010000:00010000:1.0:1790771165.588542:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.588551:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 363 00010000:00010000:1.0:1790771165.588557:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.588560:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.588564:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533688448:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.588569:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1378 00010000:00010000:1.0:1790771165.588581:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.588585:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.588591:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13189:x1877759533689088:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771165.588601:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588604:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588614:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588620:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.588643:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.588647:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.588668:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588690:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x43:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588705:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.588715:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aa6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ca5 expref: 65 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588717:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.588751:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ca5 expref: 64 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.588753:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x43:0x0]: returning size 1681 00000100:00100000:3.0:1790771165.588762:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13189:x1877759533689088:12345-192.168.204.50@tcp:35:ls.0 Request processed in 175us (300us total) trans 4294969115 rc 0/0 00000004:00200000:1.0:1790771165.588763:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771165.588763:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533688448:12345-192.168.204.50@tcp:3:cat.0 Request processed in 200us (342us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.588767:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.588774:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00010000:1.0:1790771165.588777:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.588780:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a400, rc 0) 00000100:00100000:3.0:1790771165.588784:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1378 00000100:00100000:2.0:1790771165.588785:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 363 00002000:00100000:2.0:1790771165.588798:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (434176->438271) req@ffff8bfb0552e680 x1877759533688448/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.588799:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.588819:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552e680 with x1877759533688448 ext(434176->438271) 00010000:00010000:1.0:1790771165.588820:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.588822:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:11823:x1877759533685120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 397us (561us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771165.588826:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0552e680 00000100:00100000:3.0:1790771165.588836:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.588842:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5463 00010000:00010000:1.0:1790771165.588843:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588854:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588868:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.588870:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689344 00000100:00100000:3.0:1790771165.588878:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689344 00000100:00100000:2.0:1790771165.588881:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:12122:x1877759533685504:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.588882:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.588890:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.588896:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.588902:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.588913:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0aa8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cb3 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.588921:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1379 00010000:00010000:1.0:1790771165.588922:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771165.588929:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.588933:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.588941:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14395:x1877759533689344:12345-192.168.204.50@tcp:49:rm.0 00010000:00010000:1.0:1790771165.588942:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0aa73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.588957:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588960:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588972:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.588973:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.588981:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.588993:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.588997:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.588999:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.589004:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14395:x1877759533689344:12345-192.168.204.50@tcp:49:rm.0 Request processed in 66us (172us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771165.589006:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.589020:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.589024:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1379 00000004:00200000:2.0:1790771165.589025:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.589032:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.589034:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.589045:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589046:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689856 00010000:00010000:1.0:1790771165.589047:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfb0321af00) 00000100:00100000:3.0:1790771165.589051:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689856 00000100:00100000:0.0:1790771165.589056:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.589057:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.589065:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589074:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aa81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.589079:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0aa8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cb3 expref: 66 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589082:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1380 00000100:00100000:0.0:1790771165.589092:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.589099:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:12121:x1877759533689856:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771165.589114:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cb3 expref: 65 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589117:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0aa65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d00 expref: 147 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.589130:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.589132:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.589139:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.589142:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e200, rc 0) 00010000:00010000:1.0:1790771165.589147:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d00 expref: 146 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589154:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:1.0:1790771165.589157:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771165.589160:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8200, rc 0) 00000100:00100000:2.0:1790771165.589181:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:12122:x1877759533685504:12345-192.168.204.50@tcp:101:ls.0 Request processed in 729us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.589188:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5464 00000100:00100000:1.0:1790771165.589192:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:13996:x1877759533688576:12345-192.168.204.50@tcp:101:rm.0 Request processed in 781us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.589200:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5462 00000100:00100000:3.0:1790771165.589206:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:12121:x1877759533689856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 110us (189us total) trans 4294968537 rc 0/0 00000100:00100000:2.0:1790771165.589209:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685632 00000100:00100000:2.0:1790771165.589213:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685632 00000100:00100000:0.0:1790771165.589218:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.589221:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533690240 00000100:00100000:3.0:1790771165.589224:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1380 00000100:00100000:1.0:1790771165.589228:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533690240 00000100:00100000:2.0:1790771165.589250:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685248 00000100:00100000:2.0:1790771165.589255:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685248 00000100:00100000:0.0:1790771165.589256:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.589256:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689600 00000100:00100000:3.0:1790771165.589263:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689600 00000100:00100000:1.0:1790771165.589269:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691008 00000100:00100000:1.0:1790771165.589275:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691008 00000100:00100000:2.0:1790771165.589290:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5465 00000100:00100000:0.0:1790771165.589292:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.589303:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:11826:x1877759533685632:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.589308:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 893 00000100:00100000:1.0:1790771165.589310:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533685888 00000100:00100000:1.0:1790771165.589316:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533685888 00010000:00010000:2.0:1790771165.589318:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.589324:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:10903:x1877759533689600:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1790771165.589333:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.589337:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0aa9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cba expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.589339:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.589353:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686272 00010000:00010000:3.0:1790771165.589357:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d0e expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589359:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686272 00000100:00100000:0.0:1790771165.589370:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.589379:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.589388:0:13786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1790771165.589389:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5466 00010000:00010000:2.0:1790771165.589389:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.589403:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589404:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14273:x1877759533690240:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:3.0:1790771165.589408:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=165s v=(0 0) 00010000:00010000:3.0:1790771165.589420:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1790771165.589429:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533690752 00000004:00200000:2.0:1790771165.589430:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.589430:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.589436:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533690752 00000004:00200000:2.0:1790771165.589436:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.589449:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.589451:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.589467:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372e00, rc 0) 00000100:00100000:0.0:1790771165.589480:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 33 00010000:00010000:2.0:1790771165.589481:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0aa9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cba expref: 70 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589504:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14273:x1877759533690240:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 83us (397us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771165.589514:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5466 00000100:00100000:0.0:1790771165.589525:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13997:x1877759533690752:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:2.0:1790771165.589534:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cba expref: 69 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589539:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5467 00010000:00010000:2.0:1790771165.589548:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:1.0:1790771165.589553:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12120:x1877759533685248:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.589554:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.589556:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1790771165.589559:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ee00, rc 0) 00010000:00010000:1.0:1790771165.589567:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.589572:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:10903:x1877759533689600:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 251us (595us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.589577:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0a9a1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c74 expref: 112 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589580:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0aab2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cac expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589585:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 893 00000100:00100000:2.0:1790771165.589586:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:11826:x1877759533685632:12345-192.168.204.50@tcp:101:ls.0 Request processed in 283us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.589602:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686528 00000100:00100000:2.0:1790771165.589606:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5465 00000100:00100000:3.0:1790771165.589608:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686528 00010000:00010000:0.0:1790771165.589613:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97eff894 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x42:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30db3 expref: 111 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589627:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589628:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00000100:00100000:2.0:1790771165.589636:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5468 00000100:00100000:3.0:1790771165.589639:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 894 00010000:00010000:0.0:1790771165.589644:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0a778 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bcc expref: 110 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589645:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.589662:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13869:x1877759533691008:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:3.0:1790771165.589662:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533686528:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:1.0:1790771165.589666:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589671:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771165.589705:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0a311 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a6e expref: 109 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.589707:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.589710:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:1.0:1790771165.589713:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.589727:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589729:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.589729:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f06251 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3334c expref: 95 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589737:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.589752:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:0.0:1790771165.589755:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.589756:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.589758:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0aab2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cac expref: 70 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.589771:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589776:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.589776:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x18:0x0] updating lvb size from disk: 1681 -> 1681 00002000:00010000:3.0:1790771165.589785:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x18:0x0] updating lvb mtime from disk: 1790771162 -> 1790771162 00002000:00010000:3.0:1790771165.589793:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x18:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:2.0:1790771165.589796:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.589799:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x18:0x0] updating lvb ctime from disk: 1790771163 -> 1790771165 00010000:00010000:0.0:1790771165.589801:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.589807:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x18:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771165.589809:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cac expref: 69 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.589816:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589831:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589832:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533686528:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 181us (463us total) trans 4294967578 rc 0/0 00010000:00010000:1.0:1790771165.589836:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.589844:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589846:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.589852:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 894 00010000:00010000:1.0:1790771165.589853:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8e00, rc 0) 00010000:00010000:2.0:1790771165.589868:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589870:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589887:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5469 00000100:00100000:1.0:1790771165.589890:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12120:x1877759533685248:12345-192.168.204.50@tcp:101:ls.0 Request processed in 333us (758us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.589890:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589895:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.589900:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12188:x1877759533685888:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.589912:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5467 00010000:00010000:3.0:1790771165.589917:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.589929:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.589934:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0aaea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cc1 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589935:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589936:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5470 00010000:00010000:2.0:1790771165.589943:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.589952:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:12118:x1877759533686272:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.589961:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589967:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.589967:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.589970:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.589977:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0aaf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cd6 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.589984:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590003:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590011:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590021:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590030:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.590031:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.590037:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.590039:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590042:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.590048:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.590053:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 108 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.590069:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.590073:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.590077:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0aaea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc1 expref: 71 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.590079:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.590094:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc1 expref: 70 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.590098:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 108 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.590099:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590103:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.590110:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.590115:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373600, rc 0) 00010000:00010000:0.0:1790771165.590126:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 108 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.590135:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b4501bfe reply state 00000000e7006ce2 transno 4294968538 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590138:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0aaf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cd6 expref: 71 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590140:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:12188:x1877759533685888:12345-192.168.204.50@tcp:101:ls.0 Request processed in 241us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.590146:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539714560:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.590160:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5469 00010000:00010000:2.0:1790771165.590163:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590171:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:2.0:1790771165.590173:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.590176:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cd6 expref: 69 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.590177:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.590183:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590186:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.590192:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.590193:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590195:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8800, rc 0) 00000100:00100000:0.0:1790771165.590202:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.590204:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590211:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590217:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.590221:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590223:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.590226:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12118:x1877759533686272:12345-192.168.204.50@tcp:101:ls.0 Request processed in 272us (893us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.590237:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.590243:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5470 00010000:00010000:2.0:1790771165.590249:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.590252:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.590255:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590263:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0aac7 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590264:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771165.590276:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b4501bfe reply state 00000000e7006ce2 transno 4294968538 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590283:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.590285:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689216 00010000:00010000:2.0:1790771165.590290:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc29009f00) 00000100:00100000:1.0:1790771165.590291:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689216 00010000:00010000:2.0:1790771165.590296:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.590298:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790771165.590305:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.590331:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 895 00000100:00100000:2.0:1790771165.590338:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13869:x1877759533691008:12345-192.168.204.50@tcp:36:ln.0 Request processed in 684us (1082us total) trans 4294968538 rc 0/0 00000100:00100000:1.0:1790771165.590349:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533689216:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:3.0:1790771165.590353:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.590359:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5468 00000100:00100000:2.0:1790771165.590380:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691136 00000100:00100000:2.0:1790771165.590384:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691136 00000100:00100000:3.0:1790771165.590395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.590416:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686144 00000100:00100000:2.0:1790771165.590420:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686144 00000100:00100000:3.0:1790771165.590424:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:1.0:1790771165.590450:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1790771165.590455:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5471 00002000:00010000:1.0:1790771165.590457:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1790771165 -> 1674053537 00000100:00100000:3.0:1790771165.590459:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:1.0:1790771165.590463:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1752421453 00002000:00010000:1.0:1790771165.590467:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.590471:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771165.590472:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14456:x1877759533691136:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:2.0:1790771165.590519:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.590521:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.590523:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533689216:12345-192.168.204.50@tcp:2:cp.0 Request processed in 174us (255us total) trans 4294967580 rc 0/0 00010000:00010000:2.0:1790771165.590535:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0a7b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ba2 expref: 146 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.590536:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 895 00010000:00010000:2.0:1790771165.590553:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00000100:00100000:3.0:1790771165.590557:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.590559:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.590572:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590580:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590587:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.590588:0:6506:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691520 00000100:00100000:1.0:1790771165.590594:0:6506:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691520 00000100:00100000:3.0:1790771165.590618:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.590632:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 34 00000100:00100000:1.0:1790771165.590642:0:6506:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14120:x1877759533691520:12345-192.168.204.50@tcp:36:mrename.0 00000100:00100000:3.0:1790771165.590642:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691904 00000100:00100000:3.0:1790771165.590648:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691904 00010000:00010000:1.0:1790771165.590664:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.590692:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5472 00010000:00010000:1.0:1790771165.590702:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0a5f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b47 expref: 147 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590704:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:12119:x1877759533686144:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.590719:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.590722:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc2900a100) 00010000:00010000:3.0:1790771165.590734:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ab14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ccf expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590735:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.590749:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590757:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590764:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590768:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590777:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590779:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590792:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590793:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590811:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.590818:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.590822:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.590823:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.590831:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.590832:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.590838:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689472 00000100:00100000:2.0:1790771165.590844:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689472 00010000:00010000:1.0:1790771165.590855:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590861:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ab14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ccf expref: 70 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.590871:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 26 pid: 13781 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590883:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ccf expref: 69 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.590890:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.590892:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.590895:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373a00, rc 0) 00000100:00100000:2.0:1790771165.590906:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533689984 00000100:00100000:2.0:1790771165.590913:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533689984 00010000:00010000:1.0:1790771165.590915:0:6506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590916:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12119:x1877759533686144:12345-192.168.204.50@tcp:101:ls.0 Request processed in 213us (519us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.590932:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 148 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.590933:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:11969:x1877759533686656:12345-192.168.204.50@tcp:37:ls.0 Request processed in 13918us (14379us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.590933:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5472 00010000:00010000:1.0:1790771165.590936:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.590956:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1377 00000100:00100000:3.0:1790771165.590957:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5473 00010000:00010000:1.0:1790771165.590959:0:6506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.590970:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:14384:x1877759533691904:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771165.590976:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691392 00000100:00100000:2.0:1790771165.590979:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691392 00010000:00010000:3.0:1790771165.591004:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.591005:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691264 00000100:00100000:0.0:1790771165.591011:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691264 00000100:00100000:2.0:1790771165.591012:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1509 00010000:00010000:3.0:1790771165.591024:0:13773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 148 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.591029:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533689472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.591040:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.591045:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.591050:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1510 00010000:00010000:2.0:1790771165.591053:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 26 pid: 13781 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.591062:0:13773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 148 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.591064:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:2399:x1877759533689984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.591067:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 26 pid: 13781 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591080:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.591088:0:13773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 148 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591089:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 148 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.591098:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000270d5349/0xfa0c505d97f01eab lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31c2a expref: 26 pid: 13781 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591117:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 148 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.591122:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(1 1) 00000100:00100000:3.0:1790771165.591123:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539714688:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.591132:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xa:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771165.591138:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591143:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0a6d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b8d expref: 148 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.591146:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771165.591157:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].36, 576 off54848 00010000:00010000:0.0:1790771165.591163:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:0.0:1790771165.591169:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.591173:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.591176:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63480 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.591177:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591190:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.591197:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533689472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 172us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.591203:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1509 00010000:00010000:0.0:1790771165.591212:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:1.0:1790771165.591215:0:6506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].36, 776 off61000 00000004:00080000:1.0:1790771165.591223:0:6506:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb061a2540 with version 72 00000100:00100000:2.0:1790771165.591224:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 705 00000100:00100000:0.0:1790771165.591235:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:2399:x1877759533689984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 173us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.591238:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2396:x1877759533691392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.591249:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1510 00010000:00010000:2.0:1790771165.591251:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00080000:1.0:1790771165.591254:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 72 rpc_version 72 00000100:00100000:3.0:1790771165.591262:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.591264:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0a9af lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c90 expref: 69 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.591272:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 706 00010000:00010000:2.0:1790771165.591279:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000020:00100000:1.0:1790771165.591281:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790771165.591286:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2396:x1877759533691264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.591287:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.591290:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692160 00000100:00100000:1.0:1790771165.591292:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05a0c700 x1877759539714944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1496/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771165.591297:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692160 00010000:00010000:0.0:1790771165.591299:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.591307:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2396:x1877759533691392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (882us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.591313:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0a9cb lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c9e expref: 68 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.591315:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539714944:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1790771165.591329:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 705 00010000:00010000:0.0:1790771165.591335:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:3.0:1790771165.591335:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1381 00010000:00010000:0.0:1790771165.591343:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.591352:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14089:x1877759533692160:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:2.0:1790771165.591363:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533691648 00000100:00100000:0.0:1790771165.591364:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:2396:x1877759533691264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.591370:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533691648 00000100:00100000:1.0:1790771165.591373:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771165.591382:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 706 00000100:00100000:1.0:1790771165.591401:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.591410:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 364 00010000:00010000:0.0:1790771165.591415:0:13787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.591423:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539714944 00000100:00100000:2.0:1790771165.591423:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533691648:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771165.591430:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539714944 00010000:00010000:0.0:1790771165.591431:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591440:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591447:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591463:0:13787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771165.591465:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:1.0:1790771165.591474:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7768:x1877759539714944:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1790771165.591516:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14089:x1877759533692160:12345-192.168.204.50@tcp:35:cp.0 Request processed in 135us (224us total) trans 4294968539 rc 0/0 00000100:00100000:3.0:1790771165.591524:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1381 00000100:00100000:0.0:1790771165.591586:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+8:3627:x1877759539712512:12345-0@lo:6:osp-syn-1-1.0 Request processed in 19272us (19400us total) trans 4294967579 rc 0/0 00000100:00100000:0.0:1790771165.591594:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00010000:00010000:0.0:1790771165.591623:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.591623:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 0 -> 32696 00002000:00010000:2.0:1790771165.591631:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:0.0:1790771165.591634:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.591636:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1790771165.591640:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539714944:12345-0@lo:1000:osp_up1-0.0 Request processed in 165us (268us total) trans 4294968540 rc 0/0 00002000:00010000:2.0:1790771165.591646:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1790771165.591653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.591655:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 24 00000100:00100000:1.0:1790771165.591666:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:2.0:1790771165.591700:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759533691648:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 282us (1146us total) trans 4294967581 rc 0/0 00000100:00100000:2.0:1790771165.591707:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 364 00000100:00100000:3.0:1790771165.591726:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:1.0:1790771165.591728:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06541500/2, rc 0, transno 4294967579 00000100:00100000:1.0:1790771165.591742:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539712512:0@lo:6:osp-syn-1-1.0 00000004:00010000:0.0:1790771165.591745:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000223efdf2 reply state 00000000c6e84170 transno 4294969118 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591754:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591759:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:0.0:1790771165.591762:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771165.591764:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771165.591792:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14503:x1877759533681920:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 18327us (18400us total) trans 4294969118 rc 0/0 00000100:00100000:0.0:1790771165.591799:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5443 00000100:00100000:3.0:1790771165.591799:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692288 00000100:00100000:3.0:1790771165.591805:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692288 00000100:00100000:1.0:1790771165.591806:0:7768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968508 gen 2 00000004:00080000:1.0:1790771165.591811:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968492 committed transno 4294968508 00000100:00100000:0.0:1790771165.591821:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692416 00000100:00100000:0.0:1790771165.591826:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692416 00000004:00080000:1.0:1790771165.591831:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968494 committed transno 4294968508 00000100:00100000:3.0:1790771165.591840:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5474 00000100:00100000:3.0:1790771165.591853:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14416:x1877759533692288:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:0.0:1790771165.591861:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5475 00010000:00010000:3.0:1790771165.591863:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1790771165.591869:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968505 committed transno 4294968508 00000100:00100000:0.0:1790771165.591875:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13208:x1877759533692416:12345-192.168.204.50@tcp:101:ls.0 00000020:00080000:1.0:1790771165.591876:0:7768:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc1106fe40 refcount 2 committed 0 result 0 batchid 43 00010000:00010000:3.0:1790771165.591879:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ab45 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d1c expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.591886:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb03d2cf00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc112df480 00010000:00010000:0.0:1790771165.591893:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00080000:1.0:1790771165.591894:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].34 00000020:00080000:1.0:1790771165.591898:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb03d2ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc3fa02a00 00000020:00080000:1.0:1790771165.591901:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].34 00010000:00010000:0.0:1790771165.591909:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d23 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.591914:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ab53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.591919:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968508 committed transno 4294968508 00000020:00080000:1.0:1790771165.591924:0:7768:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb04b8b180 refcount 2 committed 0 result 0 batchid 44 00010000:00010000:0.0:1790771165.591928:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 2/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.591928:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3fa05200 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb04b8bcc0 00010000:00010000:3.0:1790771165.591932:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.591936:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].35 00000020:00080000:1.0:1790771165.591942:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3fa05800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb051a0600 00010000:00010000:0.0:1790771165.591950:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 2/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.591951:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].35 00010000:00010000:3.0:1790771165.591956:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ab53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591962:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 5/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 110 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.591967:0:7768:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb05a0c700 x1877759539714944/t4294968540(4294968540) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1496/4320 e 0 to 0 dl 1790771181 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790771165.591989:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.591996:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.591997:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539714944:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771165.592014:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 110 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.592018:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 45 committed batchid 42 00010000:00010000:0.0:1790771165.592022:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.592025:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.592028:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 110 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.592031:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771165.592035:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc0151fa00, rc 0) 00010000:00010000:2.0:1790771165.592038:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.592047:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687800 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.592052:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.592053:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 42 00010000:00010000:3.0:1790771165.592057:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ab45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d1c expref: 151 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.592058:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13208:x1877759533692416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 186us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.592078:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5475 00010000:00010000:2.0:1790771165.592078:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.592092:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ab53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d1c expref: 150 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.592095:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.592098:0:6506:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f814dcaa reply state 000000009fc5df64 transno 4294969117 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.592101:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:3.0:1790771165.592110:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.592120:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac5d0b15/0xfa0c505d97f0a90e lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592123:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592134:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb0321ae00) 00010000:00010000:1.0:1790771165.592136:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:1.0:1790771165.592138:0:6506:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.592141:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1790771165.592143:0:6506:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f814dcaa reply state 000000009fc5df64 transno 4294969117 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.592144:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.592149:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.592154:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592160:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfb0321a600) 00010000:00010000:1.0:1790771165.592162:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.592163:0:6506:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1790771165.592166:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592171:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592176:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592181:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.592185:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00000100:00100000:0.0:1790771165.592188:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539713152:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.592188:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.592194:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592204:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.592209:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539713280:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.592216:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771165.592218:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+150:14416:x1877759533692288:12345-192.168.204.50@tcp:101:chown.0 Request processed in 366us (568us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.592220:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.592230:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 109 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.592231:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.592234:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5474 00010000:00010000:1.0:1790771165.592248:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.592256:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759533682048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 16180us (18404us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.592261:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.592266:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1504 00000100:00100000:3.0:1790771165.592277:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06542680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713408:192.168.204.50@tcp:104: 00000004:00010000:1.0:1790771165.592281:0:6506:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f814dcaa reply state 000000009fc5df64 transno 4294969117 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592289:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.592295:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfb0321ad00) 00010000:00010000:1.0:1790771165.592298:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.592301:0:6506:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1790771165.592302:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06374000 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713536:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.592325:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06376d80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713664:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.592408:0:6506:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+150:14120:x1877759533691520:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 1767us (1893us total) trans 4294969117 rc 0/0 00000100:00100000:1.0:1790771165.592415:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 34 00000001:00080000:3.0:1790771165.593084:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969118 is committed 00000001:00080000:3.0:1790771165.593094:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969115 is committed 00010000:00010000:0.0:1790771165.593103:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593111:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593116:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593118:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593121:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593127:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593133:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593135:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593154:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593155:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.593162:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.593166:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593168:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.593175:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.593182:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e529f3b8 reply state 00000000064949f5 transno 4294969116 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593183:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593191:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593204:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0a429 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.593207:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593213:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfb0321ad00) 00010000:00010000:1.0:1790771165.593223:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.593225:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.593226:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:1.0:1790771165.593229:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.593234:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.593239:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771165.593245:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.593246:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593250:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab29 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593260:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593268:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593271:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593278:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593279:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790771165.593284:0:13768:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1790771165.593293:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771165.593296:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14456:x1877759533691136:12345-192.168.204.50@tcp:36:chown.0 Request processed in 2826us (2949us total) trans 4294969116 rc 0/0 00010000:00010000:0.0:1790771165.593297:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.593297:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593302:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.593314:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5471 00010000:00010000:0.0:1790771165.593324:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593325:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593341:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0a46f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593343:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.593351:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593357:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593374:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593376:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593381:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593393:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.593396:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfb0321a600) 00010000:00010000:0.0:1790771165.593397:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593403:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.593406:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593408:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593416:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:0.0:1790771165.593419:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.593420:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab30 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593422:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593439:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0a851 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x43:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593450:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593451:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593471:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593472:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593504:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593510:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593513:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593518:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593528:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593532:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0xc8b04d25 (ffff8bfb0321a200) 00010000:00010000:0.0:1790771165.593538:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.593541:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593542:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593548:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593550:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0a86d lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593568:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593575:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593580:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb0321ae00) 00010000:00010000:0.0:1790771165.593581:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593587:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771165.593593:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593594:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593604:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593608:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593611:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6506 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593616:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593632:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0xea196397 (ffff8bfc2900ab00) 00010000:00010000:0.0:1790771165.593633:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.593636:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593639:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593640:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0a6e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593659:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593672:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593672:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593703:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593703:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.593710:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593719:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593723:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593727:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593733:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593739:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:0.0:1790771165.593740:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593747:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.593752:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593753:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x74:0x0].0x0 (ffff8bfc310f2900) 00010000:00010000:0.0:1790771165.593759:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.593763:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.593767:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ab0d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593773:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0a6f3 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x74:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593794:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593798:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593803:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593806:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593807:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593811:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593815:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.593816:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.593818:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593822:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593826:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593829:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0a79b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593835:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593840:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593844:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593849:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593851:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593858:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593865:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:0.0:1790771165.593868:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.593871:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593878:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0a931 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x31:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593890:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593897:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593901:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593905:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593907:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593912:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593917:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:0.0:1790771165.593919:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.593920:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593925:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0a373 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593932:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593936:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593940:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593943:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.593945:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593948:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593952:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771165.593954:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.593956:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.593961:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0a724 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.595671:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94c700 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713792:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.595703:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539713920:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.595726:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539714048:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.595729:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539714176:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.595746:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539714304:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.595755:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb55880 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539714432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.595757:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.595763:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.595794:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.595805:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693312 00010000:00010000:3.0:1790771165.595807:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.595813:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693312 00000100:00100000:2.0:1790771165.595820:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.595839:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692544 00000100:00100000:2.0:1790771165.595841:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692928 00000100:00100000:0.0:1790771165.595845:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692544 00000100:00100000:2.0:1790771165.595847:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692928 00000100:00100000:1.0:1790771165.595855:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1382 00000100:00100000:1.0:1790771165.595866:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:11696:x1877759533693312:12345-192.168.204.50@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1790771165.595875:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 121 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.595877:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 121 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.595878:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.595917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.595933:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693696 00000100:00100000:0.0:1790771165.595934:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692800 00000100:00100000:2.0:1790771165.595938:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693696 00000100:00100000:0.0:1790771165.595940:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692800 00000100:00100000:3.0:1790771165.595960:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.595962:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 99 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.595964:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 122 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.595975:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:11696:x1877759533693312:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 109us (219us total) trans 4294968541 rc 0/0 00000100:00100000:1.0:1790771165.595992:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1382 00000100:00100000:2.0:1790771165.596002:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693440 00000100:00100000:2.0:1790771165.596007:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693440 00000100:00100000:0.0:1790771165.596012:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1511 00000100:00100000:0.0:1790771165.596024:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:2397:x1877759533692928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.596028:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1512 00010000:00010000:0.0:1790771165.596036:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.596042:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1513 00000100:00100000:1.0:1790771165.596043:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:2397:x1877759533692544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.596046:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 122 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.596059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.596060:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.596060:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:2397:x1877759533693696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.596070:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 122 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.596071:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 122 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596074:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.596085:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 99 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.596098:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.596114:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 99 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.596116:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 122 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596146:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02800/0xfa0c505d97f09a89 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34726 expref: 122 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596152:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97eff116 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30b59 expref: 99 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.596153:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0a716 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b6a expref: 122 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596162:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.596171:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596185:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596187:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00000100:00100000:3.0:1790771165.596190:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693824 00010000:00010000:2.0:1790771165.596195:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.596198:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693824 00010000:00010000:0.0:1790771165.596201:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.596202:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.596210:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.596211:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.596224:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 121 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596228:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.596232:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.596237:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2397:x1877759533692928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 214us (416us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.596253:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.596253:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:2397:x1877759533693696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 198us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.596260:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1511 00000100:00100000:3.0:1790771165.596274:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1514 00000100:00100000:1.0:1790771165.596280:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533692544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.596286:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1513 00000100:00100000:3.0:1790771165.596292:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533692800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.596300:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1515 00010000:00010000:3.0:1790771165.596307:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.596308:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1512 00000100:00100000:0.0:1790771165.596316:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533693824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.596319:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.596320:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 707 00010000:00010000:0.0:1790771165.596337:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.596337:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2397:x1877759533693440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.596340:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 119 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.596347:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693952 00010000:00010000:0.0:1790771165.596350:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 119 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.596352:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693952 00010000:00010000:2.0:1790771165.596355:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1790771165.596373:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (438272->442367) req@ffff8bfc3f94c700 x1877759533693952/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.596375:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f09be0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3473b expref: 119 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596378:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 119 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596378:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0aa11 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf2 expref: 97 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771165.596409:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f94c700 with x1877759533693952 ext(438272->442367) 00002000:00010000:1.0:1790771165.596414:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f94c700 00010000:00010000:2.0:1790771165.596414:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771165.596418:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.596422:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f099fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34711 expref: 118 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.596422:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.596426:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.596437:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 365 00000100:00100000:2.0:1790771165.596446:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:2397:x1877759533693440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 112us (486us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.596449:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.596453:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533693952:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771165.596469:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 707 00010000:00010000:3.0:1790771165.596471:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.596472:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.596477:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596553:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.596559:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.596566:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2397:x1877759533692800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 278us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.596576:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1514 00000100:00100000:0.0:1790771165.596588:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2397:x1877759533693824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 277us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.596595:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1515 00000100:00100000:1.0:1790771165.596614:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533693952:12345-192.168.204.50@tcp:3:cat.0 Request processed in 164us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.596621:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 365 00002000:00100000:1.0:1790771165.596628:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (438272->442367) req@ffff8bfc3f94c700 x1877759533693952/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790771165.596635:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f94c700 with x1877759533693952 ext(438272->442367) 00002000:00010000:1.0:1790771165.596638:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f94c700 00000100:00100000:3.0:1790771165.596908:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.596940:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.596942:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533686400 00000100:00100000:1.0:1790771165.596947:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533686400 00000100:00100000:1.0:1790771165.596979:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533687552 00000100:00100000:1.0:1790771165.596982:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533687552 00000100:00100000:2.0:1790771165.596995:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5476 00000100:00100000:3.0:1790771165.597007:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5477 00000100:00100000:2.0:1790771165.597008:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:11832:x1877759533686400:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.597020:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.597027:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:13894:x1877759533687552:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771165.597031:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ab5a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34cdd expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.597040:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.597054:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ab61 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ceb expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.597061:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.597072:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.597078:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.597096:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.597098:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.597109:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.597117:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.597123:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ab5a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 70 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.597136:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 69 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.597142:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.597144:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.597146:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00000100:00100000:2.0:1790771165.597177:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:11832:x1877759533686400:12345-192.168.204.50@tcp:101:ls.0 Request processed in 175us (314us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.597181:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ab61 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ceb expref: 70 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.597193:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5476 00010000:00010000:3.0:1790771165.597205:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.597209:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.597215:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ab61 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ceb expref: 69 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.597229:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56200, rc 0) 00000100:00100000:3.0:1790771165.597264:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:13894:x1877759533687552:12345-192.168.204.50@tcp:101:rm.0 Request processed in 245us (326us total) trans 4294968542 rc 301/301 00000100:00100000:3.0:1790771165.597270:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5477 00000100:00100000:0.0:1790771165.602977:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.603029:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533690496 00000100:00100000:1.0:1790771165.603034:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533690496 00000100:00100000:1.0:1790771165.603070:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5478 00000100:00100000:1.0:1790771165.603081:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:12186:x1877759533690496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.603093:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.603104:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab76 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d15 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603145:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603153:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603159:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603168:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603173:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603178:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.603240:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.603280:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603286:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603290:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603295:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.603299:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603312:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603333:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.603336:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.603341:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603347:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ab7d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603356:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603360:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603365:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603368:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.603370:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603374:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603379:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfb0321ae00) 00010000:00010000:1.0:1790771165.603380:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.603382:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603389:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ab84 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603413:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab76 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d15 expref: 70 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603423:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.603425:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.603430:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0ab76 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d15 expref: 70 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.603441:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597600, rc 0) 00000100:00100000:1.0:1790771165.603472:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12186:x1877759533690496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 395us (498us total) trans 4294968543 rc 301/301 00000100:00100000:1.0:1790771165.603478:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5478 00000100:00100000:2.0:1790771165.604233:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.604256:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.604291:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696000 00000100:00100000:1.0:1790771165.604298:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696000 00000100:00100000:0.0:1790771165.604310:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696256 00000100:00100000:0.0:1790771165.604317:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696256 00000100:00100000:1.0:1790771165.604342:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5479 00000100:00100000:1.0:1790771165.604353:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533696000:12345-192.168.204.50@tcp:101:touch.0 00000100:00100000:0.0:1790771165.604359:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5480 00010000:00010000:1.0:1790771165.604365:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.604371:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14199:x1877759533696256:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:1.0:1790771165.604375:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab92 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d46 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604383:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.604395:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0ab99 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d4d expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604442:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604453:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604457:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604462:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604469:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604477:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604478:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604507:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604514:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.604544:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:0.0:1790771165.604546:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604554:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604558:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604563:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604575:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604575:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604590:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604596:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.604599:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604604:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604613:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.604615:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.604617:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604621:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0aba0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604628:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604634:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604636:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0abbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604639:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604653:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.604657:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604659:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0abbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604662:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604674:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0abbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604689:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfb0321a600) 00010000:00010000:1.0:1790771165.604696:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.604700:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.604704:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 19884 00010000:00010000:1.0:1790771165.604705:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0abae lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604740:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab92 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d46 expref: 97 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604747:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604752:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.604757:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604758:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.604767:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0ab92 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d46 expref: 97 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604768:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604787:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.604788:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596c00, rc 0) 00010000:00010000:0.0:1790771165.604794:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.604798:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604802:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604810:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.604812:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.604817:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 94 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.604824:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533696000:12345-192.168.204.50@tcp:101:touch.0 Request processed in 471us (590us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.604826:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.604834:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5479 00010000:00010000:0.0:1790771165.604839:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0aba7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604847:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604852:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604856:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604861:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.604863:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604867:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604875:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x61bf1dfb (ffff8bfc22108100) 00010000:00010000:0.0:1790771165.604877:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.604879:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604883:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0abb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604909:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0ab99 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d4d expref: 119 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604917:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0abbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d4d expref: 118 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.604921:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:0.0:1790771165.604922:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.604924:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686a00, rc 0) 00000100:00100000:0.0:1790771165.604954:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14199:x1877759533696256:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 588us (697us total) trans 4294969119 rc 0/0 00000100:00100000:0.0:1790771165.604959:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5480 00000100:00100000:2.0:1790771165.605279:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.605297:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.605314:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694208 00000100:00100000:0.0:1790771165.605318:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694208 00000100:00100000:2.0:1790771165.605333:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.605340:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694848 00000100:00100000:1.0:1790771165.605346:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694848 00000100:00100000:0.0:1790771165.605354:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5481 00000100:00100000:0.0:1790771165.605365:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14238:x1877759533694208:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771165.605373:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.605378:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5482 00010000:00010000:0.0:1790771165.605384:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0abca lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d2a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605384:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.605395:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13976:x1877759533694848:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:2.0:1790771165.605406:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694592 00000100:00100000:2.0:1790771165.605412:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694592 00010000:00010000:1.0:1790771165.605416:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.605431:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0abd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d31 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605432:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605440:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694976 00000100:00100000:2.0:1790771165.605446:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694976 00000100:00100000:3.0:1790771165.605447:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.605457:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605465:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605475:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694464 00000100:00100000:2.0:1790771165.605479:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694464 00010000:00010000:0.0:1790771165.605480:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605522:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605527:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605532:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605533:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 708 00010000:00010000:0.0:1790771165.605541:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.605544:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.605551:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533694592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.605555:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605562:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.605567:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605570:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605578:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ab22 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ccf expref: 71 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605579:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605582:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.605596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.605604:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605608:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605611:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605612:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.605622:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.605625:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.605628:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.605633:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605638:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605646:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.605648:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.605654:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605654:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605667:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759533694592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (331us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.605691:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0abd8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605691:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605699:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 708 00010000:00010000:1.0:1790771165.605716:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605721:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605722:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533694720 00000100:00100000:2.0:1790771165.605727:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533694720 00010000:00010000:0.0:1790771165.605731:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605737:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605741:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.605744:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.605746:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x31:0x0]: returning size 14614528 00010000:00010000:0.0:1790771165.605752:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.605753:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771165.605754:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695104 00000100:00100000:2.0:1790771165.605760:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695104 00010000:00010000:0.0:1790771165.605769:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc22108f00) 00010000:00010000:0.0:1790771165.605772:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1790771165.605772:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605776:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695232 00010000:00010000:0.0:1790771165.605777:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605782:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695232 00010000:00010000:1.0:1790771165.605787:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605789:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0abdf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605800:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 709 00000100:00100000:3.0:1790771165.605802:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539714688:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.605806:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605816:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:2397:x1877759533694976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.605818:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605827:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.605827:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605831:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0abca lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d2a expref: 97 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605835:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605844:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0aaab lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cba expref: 72 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605858:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605860:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.605867:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.605874:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.605876:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0abca lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d2a expref: 97 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605877:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.605878:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.605888:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.605898:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.605902:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687400, rc 0) 00010000:00010000:1.0:1790771165.605908:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771165.605911:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.605922:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.605923:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605929:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0abe6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605934:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533694976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.605941:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14238:x1877759533694208:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 574us (657us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771165.605946:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605949:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 709 00010000:00010000:1.0:1790771165.605962:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.605964:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.605967:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5481 00010000:00010000:1.0:1790771165.605975:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605979:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.605983:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.605988:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.605988:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695360 00000100:00100000:2.0:1790771165.605993:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695360 00010000:00010000:1.0:1790771165.605997:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfb0321ad00) 00010000:00010000:1.0:1790771165.606000:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.606002:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606006:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0abed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606012:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 97 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606022:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 710 00010000:00010000:1.0:1790771165.606035:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0abd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d31 expref: 98 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606037:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759533694464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.606043:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1516 00010000:00010000:0.0:1790771165.606057:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.606059:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533695360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.606064:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d31 expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606069:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.606075:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0aa7a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ca5 expref: 70 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606079:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 97 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606080:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:1.0:1790771165.606089:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771165.606094:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.606095:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00010000:00010000:2.0:1790771165.606107:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 97 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606110:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.606119:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.606127:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13976:x1877759533694848:12345-192.168.204.50@tcp:101:rm.0 Request processed in 737us (826us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.606131:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:1.0:1790771165.606138:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5482 00010000:00010000:2.0:1790771165.606139:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.606145:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.606152:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2397:x1877759533694464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 117us (710us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.606154:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.606159:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695744 00000100:00100000:1.0:1790771165.606165:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695744 00010000:00010000:2.0:1790771165.606171:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606175:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 710 00010000:00010000:2.0:1790771165.606192:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.606199:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5483 00000100:00100000:0.0:1790771165.606201:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695488 00000100:00100000:0.0:1790771165.606206:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695488 00000100:00100000:1.0:1790771165.606210:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14587:x1877759533695744:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:2.0:1790771165.606219:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:2396:x1877759533695360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (296us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.606225:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 119 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606225:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.606231:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1516 00000100:00100000:3.0:1790771165.606237:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.606250:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0abfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d3f expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606257:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696384 00000100:00100000:2.0:1790771165.606262:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696384 00000100:00100000:0.0:1790771165.606266:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1517 00010000:00010000:1.0:1790771165.606276:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606277:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2396:x1877759533695488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.606292:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 711 00010000:00010000:0.0:1790771165.606293:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.606293:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.606295:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606303:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 120 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606310:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2397:x1877759533694720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.606315:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606324:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 120 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606329:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.606340:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0a9d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc8 expref: 120 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606348:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aaff lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cd6 expref: 69 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606350:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.606358:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606374:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606376:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.606383:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606384:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.606404:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0abfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606409:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.606409:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.606410:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2397:x1877759533694720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.606424:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 711 00000100:00100000:0.0:1790771165.606437:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2396:x1877759533695488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (396us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.606437:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606444:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696512 00000100:00100000:3.0:1790771165.606445:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696640 00000100:00100000:2.0:1790771165.606450:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696512 00000100:00100000:3.0:1790771165.606452:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696640 00000100:00100000:0.0:1790771165.606456:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1517 00010000:00010000:1.0:1790771165.606462:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:1.0:1790771165.606465:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771165.606468:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596200, rc 0) 00010000:00010000:2.0:1790771165.606470:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 96 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606478:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 712 00000100:00100000:0.0:1790771165.606509:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:2397:x1877759533695104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.606517:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.606525:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1518 00000100:00100000:1.0:1790771165.606527:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14587:x1877759533695744:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 315us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.606527:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1383 00010000:00010000:0.0:1790771165.606529:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0aab9 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cac expref: 67 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606544:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:2397:x1877759533696512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.606546:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5483 00000100:00100000:3.0:1790771165.606546:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13269:x1877759533696640:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771165.606560:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.606561:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.606567:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.606570:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 96 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606582:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 96 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.606587:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 713 00000100:00100000:0.0:1790771165.606593:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:2397:x1877759533695104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 105us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.606601:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:2397:x1877759533695232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.606602:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 712 00010000:00010000:2.0:1790771165.606604:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97efe037 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e304c2 expref: 96 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606616:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.606622:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00000100:00100000:0.0:1790771165.606628:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 714 00010000:00010000:2.0:1790771165.606631:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606632:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0aaf8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cc1 expref: 65 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.606642:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2396:x1877759533696384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.606659:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.606659:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606661:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.606668:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.606686:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606693:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0aa96 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cb3 expref: 64 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606705:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.606708:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.606709:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:2397:x1877759533695232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (1085us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.606710:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.606721:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 713 00000100:00100000:2.0:1790771165.606738:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:2397:x1877759533696512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.606746:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:2396:x1877759533696384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.606750:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1518 00000100:00100000:0.0:1790771165.606759:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 714 00000100:00100000:2.0:1790771165.606802:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533695616 00010000:00010000:1.0:1790771165.606804:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f09f83 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34933 expref: 95 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606806:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533695616 00010000:00010000:0.0:1790771165.606807:0:13773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606822:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.606827:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ef800 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539714560:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.606840:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 896 00010000:00010000:1.0:1790771165.606843:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606851:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533695616:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771165.606854:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606862:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.606865:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.606879:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000780a665f/0xfa0c505d97f0ac09 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d38 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606880:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606899:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.606908:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000021ede403 reply state 000000009abec9dc transno 4294969120 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.606908:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606931:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.606932:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539715072:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.606945:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771165.606946:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.606949:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771165.606953:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.606961:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 119 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.606971:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539715200:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.606985:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653900 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.606986:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14384:x1877759533691904:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 16017us (16364us total) trans 4294969120 rc 0/0 00000100:00100000:0.0:1790771165.606995:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5473 00000100:00100000:1.0:1790771165.606996:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc06b14b40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.607030:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607037:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.607072:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.607104:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607111:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607117:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607121:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.607125:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.607132:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.607139:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607148:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc0ab7f800) 00010000:00010000:2.0:1790771165.607150:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771165.607153:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607158:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0aa26 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.607159:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696896 00000100:00100000:0.0:1790771165.607165:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696896 00010000:00010000:2.0:1790771165.607179:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607185:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.607188:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533696768 00002000:00100000:0.0:1790771165.607189:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (442368->446463) req@ffff8bfb05ee2680 x1877759533696896/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.607195:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533696768 00010000:00010000:2.0:1790771165.607202:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.607209:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05ee2680 with x1877759533696896 ext(442368->446463) 00010000:00010000:2.0:1790771165.607212:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73400 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:0.0:1790771165.607215:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05ee2680 00010000:00010000:2.0:1790771165.607216:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607224:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.607231:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5484 00010000:00010000:2.0:1790771165.607232:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.607236:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.607239:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.607240:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 366 00000100:00100000:1.0:1790771165.607247:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14416:x1877759533696768:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:0.0:1790771165.607257:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533696896:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771165.607259:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0aa18 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607273:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607278:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.607279:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.607288:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607293:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.607296:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.607298:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0a691 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b86 expref: 121 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607302:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607328:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc22108500) 00010000:00010000:1.0:1790771165.607329:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.607332:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.607336:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.607338:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607348:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0aa1f lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.607352:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533696896:12345-192.168.204.50@tcp:3:cat.0 Request processed in 99us (223us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.607367:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.607371:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 366 00002000:00100000:0.0:1790771165.607380:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (442368->446463) req@ffff8bfb05ee2680 x1877759533696896/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.607381:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.607402:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05ee2680 with x1877759533696896 ext(442368->446463) 00000100:00100000:2.0:1790771165.607405:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:14195:x1877759533688192:12345-192.168.204.50@tcp:36:rm.0 Request processed in 29754us (30120us total) trans 0 rc -39/-39 00010000:00010000:1.0:1790771165.607406:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.607407:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05ee2680 00000100:00100000:2.0:1790771165.607421:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5458 00000100:00100000:0.0:1790771165.607455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.607523:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.607551:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533697024 00000100:00100000:0.0:1790771165.607557:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533697152 00000100:00100000:3.0:1790771165.607558:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533697024 00000100:00100000:0.0:1790771165.607563:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533697152 00000100:00100000:0.0:1790771165.607597:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1384 00000100:00100000:0.0:1790771165.607604:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:13894:x1877759533697152:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:2.0:1790771165.607694:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 897 00000040:00080000:1.0:1790771165.607698:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 88 off10680 00000100:00100000:2.0:1790771165.607705:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:14017:x1877759533697024:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771165.607714:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.607725:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b19fad46/0xfa0c505d97f0ac1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d54 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.607739:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004fe05293 reply state 00000000022fff7b transno 4294969121 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.607740:0:12031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790771165.607754:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=165s v=(0 0) 00010000:00010000:1.0:1790771165.607756:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607760:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771165.607772:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.607773:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b19fad46/0xfa0c505d97f0ac1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d54 expref: 24 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.607776:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771165.607781:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.607789:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b19fad46/0xfa0c505d97f0ac1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d54 expref: 24 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.607798:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4800, rc 0) 00000100:00100000:2.0:1790771165.607830:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14017:x1877759533697024:12345-192.168.204.50@tcp:101:dd.0 Request processed in 130us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.607835:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 897 00000100:00100000:1.0:1790771165.607842:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14416:x1877759533696768:12345-192.168.204.50@tcp:36:chown.0 Request processed in 600us (767us total) trans 4294969121 rc 0/0 00000100:00100000:1.0:1790771165.607849:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5484 00000100:00100000:2.0:1790771165.608541:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.608571:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533697408 00000100:00100000:0.0:1790771165.608576:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533697408 00000100:00100000:0.0:1790771165.608607:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5485 00000100:00100000:0.0:1790771165.608615:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14277:x1877759533697408:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:0.0:1790771165.608625:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.608626:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.608634:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ac25 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d5b expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.608657:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533697664 00000100:00100000:1.0:1790771165.608662:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533697664 00010000:00010000:0.0:1790771165.608702:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.608703:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1385 00010000:00010000:0.0:1790771165.608714:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.608716:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:12186:x1877759533697664:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771165.608732:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608742:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608747:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608752:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.608768:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:0.0:1790771165.608775:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608779:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608783:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608788:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608792:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.608795:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608799:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608809:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.608811:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.608813:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608817:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ac2c lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.608823:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:12186:x1877759533697664:12345-192.168.204.50@tcp:35:ls.0 Request processed in 109us (197us total) trans 4294968544 rc 0/0 00010000:00010000:0.0:1790771165.608828:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.608834:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1385 00010000:00010000:0.0:1790771165.608839:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608845:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608849:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.608851:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608856:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608861:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc22108900) 00010000:00010000:0.0:1790771165.608863:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.608865:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608869:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ac33 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608899:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ac25 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d5b expref: 96 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608904:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.608906:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.608908:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ac25 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d5b expref: 96 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.608915:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00000100:00100000:0.0:1790771165.608960:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14277:x1877759533697408:12345-192.168.204.50@tcp:101:touch.0 Request processed in 347us (419us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.608966:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5485 00000100:00100000:3.0:1790771165.608992:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.609016:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533697920 00000100:00100000:1.0:1790771165.609021:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533697920 00000100:00100000:1.0:1790771165.609056:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5486 00000100:00100000:1.0:1790771165.609065:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:11824:x1877759533697920:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.609076:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.609086:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ac3a lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d62 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609127:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609135:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609142:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609152:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609158:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609164:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.609202:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.609236:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609244:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609251:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609260:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609266:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.609270:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609276:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609284:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.609286:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.609288:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609295:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0ac41 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609307:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609315:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609323:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609331:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.609335:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609342:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609349:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfb0321ae00) 00010000:00010000:1.0:1790771165.609351:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.609354:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609359:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ac48 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609384:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ac3a lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d62 expref: 65 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609391:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.609393:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.609397:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0ac3a lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d62 expref: 65 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.609409:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00000100:00100000:1.0:1790771165.609436:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:11824:x1877759533697920:12345-192.168.204.50@tcp:101:ls.0 Request processed in 370us (444us total) trans 4294968545 rc 301/301 00000100:00100000:1.0:1790771165.609445:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5486 00000100:00100000:0.0:1790771165.609803:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:13269:x1877759533696640:12345-192.168.204.50@tcp:37:ls.0 Request processed in 3264us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.609810:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1383 00000100:00100000:3.0:1790771165.610006:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.610042:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533698048 00000100:00100000:1.0:1790771165.610049:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533698048 00000100:00100000:2.0:1790771165.610062:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:13894:x1877759533697152:12345-192.168.204.50@tcp:37:rm.0 Request processed in 2458us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.610069:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1384 00000100:00100000:1.0:1790771165.610094:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 898 00000100:00100000:1.0:1790771165.610106:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533698048:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771165.610115:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.610124:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000378ac67/0xfa0c505d97f0ac56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d69 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.610149:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539715328:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771165.610187:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.612893:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.612927:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533699712 00000100:00100000:1.0:1790771165.612932:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533699712 00000100:00100000:1.0:1790771165.612956:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5487 00000100:00100000:1.0:1790771165.612961:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14310:x1877759533699712:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771165.612969:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.612976:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ac5d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d77 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613021:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613029:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613036:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.613037:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.613054:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613063:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.613064:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.613076:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613083:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533698304 00000100:00100000:0.0:1790771165.613089:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533698304 00000100:00100000:3.0:1790771165.613091:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771165.613099:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00000100:00100000:2.0:1790771165.613103:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533698432 00000100:00100000:2.0:1790771165.613109:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533698432 00010000:00010000:1.0:1790771165.613110:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.613121:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.613123:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613131:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533698688 00010000:00010000:1.0:1790771165.613133:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613135:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533698688 00010000:00010000:1.0:1790771165.613142:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.613146:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613148:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533698944 00010000:00010000:1.0:1790771165.613154:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613155:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533698944 00000100:00100000:3.0:1790771165.613162:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5488 00010000:00010000:1.0:1790771165.613170:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771165.613175:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5489 00010000:00010000:1.0:1790771165.613177:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.613178:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13976:x1877759533698304:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:1.0:1790771165.613182:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613191:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13459:x1877759533698432:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771165.613192:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ac64 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613200:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5490 00010000:00010000:3.0:1790771165.613203:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771165.613206:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.613211:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613216:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14598:x1877759533698688:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771165.613218:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687800/0xfa0c505d97f0ac72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d70 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613220:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0abf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d31 expref: 96 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613234:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613251:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.613256:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613257:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97efdc55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e303f0 expref: 96 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613263:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.613268:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687800/0xfa0c505d97f0ac72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d70 expref: 96 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613270:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.613284:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613299:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:2.0:1790771165.613306:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613306:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.613312:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687800/0xfa0c505d97f0ac72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d70 expref: 95 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613312:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613319:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613340:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc29009f00) 00010000:00010000:3.0:1790771165.613343:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613344:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.613347:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:1.0:1790771165.613350:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.613355:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771165.613360:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687800, rc 0) 00010000:00010000:3.0:1790771165.613364:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.613365:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ac6b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613390:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613392:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13459:x1877759533698432:12345-192.168.204.50@tcp:101:dd.0 Request processed in 205us (327us total) trans 0 rc 0/0 00000004:00010000:2.0:1790771165.613400:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000047bc9afc reply state 0000000024e751e7 transno 4294969122 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613404:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613411:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5489 00010000:00010000:1.0:1790771165.613411:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ac5d lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d77 expref: 96 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.613424:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613427:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613433:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5491 00010000:00010000:1.0:1790771165.613440:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.613447:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:0.0:1790771165.613448:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:14257:x1877759533698944:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771165.613448:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.613453:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.613458:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ac5d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d77 expref: 96 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613459:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.613470:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9e00, rc 0) 00010000:00010000:3.0:1790771165.613505:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613514:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14598:x1877759533698688:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 301us (421us total) trans 4294969122 rc 0/0 00010000:00010000:3.0:1790771165.613517:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.613524:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14310:x1877759533699712:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 559us (629us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.613528:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5490 00000100:00100000:0.0:1790771165.613531:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:12128:1877759539715456:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1790771165.613538:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.613544:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5487 00000100:00100000:0.0:1790771165.613576:0:12128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771165.613600:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.613615:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.613615:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539715456 00000100:00100000:2.0:1790771165.613622:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539715456 00000100:00100000:0.0:1790771165.613645:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533699200 00000100:00100000:0.0:1790771165.613650:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533699200 00000004:00080000:3.0:1790771165.613673:0:6493:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000402:0x31:0x0] is inserted into orphan list, open count = 2 00000100:00100000:2.0:1790771165.613687:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:1.0:1790771165.613690:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.613699:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:12128:x1877759539715456:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1790771165.613701:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533699840 00000100:00100000:0.0:1790771165.613707:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533699840 00000100:00100000:0.0:1790771165.613737:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1386 00000100:00100000:0.0:1790771165.613747:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13428:x1877759533699200:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1790771165.613755:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.613797:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:12128:x1877759539715456:12345-0@lo:1000:mdt00_005.0 Request processed in 102us (220us total) trans 0 rc 1/1 00000100:00100000:2.0:1790771165.613804:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00010000:00010000:3.0:1790771165.613817:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.613824:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613832:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533699968 00010000:00010000:3.0:1790771165.613834:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.613838:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.613839:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533699968 00000100:00100000:0.0:1790771165.613852:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13428:x1877759533699200:12345-192.168.204.50@tcp:35:cat.0 Request processed in 105us (237us total) trans 4294969124 rc 0/0 00000100:00100000:0.0:1790771165.613859:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1386 00002000:00100000:2.0:1790771165.613867:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (446464->450559) req@ffff8bfb03c6c000 x1877759533699968/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.613879:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6c000 with x1877759533699968 ext(446464->450559) 00000100:00100000:0.0:1790771165.613881:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1387 00002000:00010000:2.0:1790771165.613888:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6c000 00000100:00100000:1.0:1790771165.613893:0:12128:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969022 gen 2 00000100:00100000:0.0:1790771165.613895:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14562:x1877759533699840:12345-192.168.204.50@tcp:35:lfs.0 00000004:00080000:1.0:1790771165.613898:0:12128:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969022 committed transno 4294969022 00000020:00080000:1.0:1790771165.613908:0:12128:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8bfb061a7000 refcount 2 committed 0 result 0 batchid 17 00010000:00010000:3.0:1790771165.613909:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00000020:00080000:1.0:1790771165.613912:0:12128:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c000 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc05321840 00010000:00010000:3.0:1790771165.613915:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.613916:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 367 00000020:00080000:1.0:1790771165.613919:0:12128:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].17 00000020:00080000:1.0:1790771165.613925:0:12128:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06b64600 00000100:00100000:2.0:1790771165.613930:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533699968:12345-192.168.204.50@tcp:3:cat.0 00000020:00080000:1.0:1790771165.613931:0:12128:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].17 00010000:00010000:3.0:1790771165.613958:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.613959:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:12128:1877759539715456:0@lo:1000:mdt00_005.0 00010000:00010000:3.0:1790771165.613974:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:3.0:1790771165.613977:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771165.613980:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613985:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14562:x1877759533699840:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 92us (311us total) trans 4294969125 rc 0/0 00010000:00010000:3.0:1790771165.613989:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ac8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x31:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.613996:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1387 00010000:00010000:3.0:1790771165.614003:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.614006:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:14257:x1877759533698944:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 559us (887us total) trans 0 rc -17/-17 00010000:00010000:3.0:1790771165.614015:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771165.614016:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 17 committed batchid 16 00000100:00100000:1.0:1790771165.614021:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5491 00000100:00100000:2.0:1790771165.614025:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533699968:12345-192.168.204.50@tcp:3:cat.0 Request processed in 95us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.614033:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.614038:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 367 00000100:00100000:1.0:1790771165.614041:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533700224 00010000:00010000:3.0:1790771165.614045:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771165.614046:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 16 00000100:00100000:1.0:1790771165.614047:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533700224 00002000:00100000:2.0:1790771165.614050:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (446464->450559) req@ffff8bfb03c6c000 x1877759533699968/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.614064:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00002000:00100000:2.0:1790771165.614067:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6c000 with x1877759533699968 ext(446464->450559) 00010000:00010000:3.0:1790771165.614069:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.614072:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6c000 00010000:00010000:3.0:1790771165.614079:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614089:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.614092:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.614094:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.614098:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5492 00010000:00010000:3.0:1790771165.614100:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ac80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.614113:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000713d6ffd reply state 00000000878e78a1 transno 4294969123 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.614114:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13996:x1877759533700224:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1790771165.614128:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614133:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc20109500) 00010000:00010000:3.0:1790771165.614135:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.614136:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.614140:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790771165.614153:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aa88 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d00 expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.614169:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13976:x1877759533698304:12345-192.168.204.50@tcp:36:rm.0 Request processed in 997us (1131us total) trans 4294969123 rc 0/0 00010000:00010000:1.0:1790771165.614172:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f01bbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x43:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31ae1 expref: 122 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.614181:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5488 00010000:00010000:1.0:1790771165.614188:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:1.0:1790771165.614193:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.614203:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614211:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614220:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614233:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614242:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614251:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614289:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614298:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614305:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771165.614411:0:12128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10696 00010000:00010000:1.0:1790771165.614443:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 3/0,1 mode: --/PW res: [0x200000403:0x43:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614453:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614462:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614469:0:12128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614474:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614478:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614509:0:12128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771165.614519:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614524:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614528:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614533:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.614534:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771165.614536:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614540:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614542:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614557:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593c00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771165.614560:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:1.0:1790771165.614564:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771165.614566:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614567:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614578:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0aca3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x43:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614582:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614606:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x43:0x0].0x0 (ffff8bfc113f3200) 00010000:00010000:1.0:1790771165.614609:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614610:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790771165.614615:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 1/0,0 mode: --/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614618:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614623:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acaa lrc: 0/0,0 mode: --/PW res: [0x200000403:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614626:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614633:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.614634:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.614637:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.614638:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771165.614641:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.614646:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614652:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771165.614654:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.614655:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614659:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0ac95 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.614665:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f1cf2d27 reply state 00000000b7a4cc56 transno 4294969126 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614671:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.614691:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfb0321a600) 00010000:00010000:1.0:1790771165.614693:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.614695:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771165.614728:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13996:x1877759533700224:12345-192.168.204.50@tcp:36:rm.0 Request processed in 619us (896us total) trans 4294969126 rc 0/0 00000100:00100000:1.0:1790771165.614737:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5492 00000100:00100000:0.0:1790771165.628622:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.628641:0:13781:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size: 4232640 -> 4232645 00000100:00100000:1.0:1790771165.628652:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539715200:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.628653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.628665:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539715072:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771165.628689:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.628703:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533700608 00000100:00100000:0.0:1790771165.628704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.628710:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533700608 00010000:00010000:2.0:1790771165.628714:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000780a665f/0xfa0c505d97f0ac09 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d38 expref: 26 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.628735:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533700864 00000100:00100000:0.0:1790771165.628736:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.628739:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000780a665f/0xfa0c505d97f0ac09 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d38 expref: 26 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.628743:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533700864 00010000:00010000:2.0:1790771165.628754:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00000100:00100000:0.0:1790771165.628762:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.628788:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5493 00000100:00100000:3.0:1790771165.628797:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533701120 00000100:00100000:2.0:1790771165.628798:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533695616:12345-192.168.204.50@tcp:101:cat.0 Request processed in 21949us (22838us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.628802:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14363:x1877759533700864:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:3.0:1790771165.628803:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533701120 00000100:00100000:2.0:1790771165.628812:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 896 00010000:00010000:1.0:1790771165.628836:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1790771165.628837:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1388 00000100:00100000:3.0:1790771165.628851:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:11824:x1877759533700608:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.628855:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0a993 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c7b expref: 65 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.628856:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1389 00000100:00100000:0.0:1790771165.628869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.628874:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:13894:x1877759533701120:12345-192.168.204.50@tcp:35:rm.0 00010000:00010000:1.0:1790771165.628886:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f04ba6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bce expref: 64 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.628900:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771165.628902:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533701504 00010000:00010000:1.0:1790771165.628903:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.628908:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533701504 00010000:00010000:1.0:1790771165.628927:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.628937:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 94 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.628940:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1390 00000100:00100000:0.0:1790771165.628955:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:10903:x1877759533701504:12345-192.168.204.50@tcp:35:dir_create.sh.0 00010000:00010000:1.0:1790771165.628958:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 64 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.628967:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 65 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.628973:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 6/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.628996:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 65 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629006:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 65 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629014:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:13894:x1877759533701120:12345-192.168.204.50@tcp:35:rm.0 Request processed in 141us (307us total) trans 4294968546 rc 0/0 00000100:00100000:3.0:1790771165.629016:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:11824:x1877759533700608:12345-192.168.204.50@tcp:35:ls.0 Request processed in 166us (396us total) trans 4294968547 rc 0/0 00000100:00100000:1.0:1790771165.629026:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715584:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.629035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1389 00000100:00100000:3.0:1790771165.629044:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1388 00000100:00100000:2.0:1790771165.629065:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533700352 00000100:00100000:2.0:1790771165.629070:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533700352 00010000:00010000:1.0:1790771165.629089:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 64 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629092:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 64 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629109:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 64 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.629110:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:10903:x1877759533701504:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 158us (244us total) trans 4294969127 rc 0/0 00000100:00100000:2.0:1790771165.629120:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533701248 00000100:00100000:2.0:1790771165.629125:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533701248 00000100:00100000:0.0:1790771165.629130:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1390 00000100:00100000:1.0:1790771165.629131:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715712:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.629141:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 125 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629163:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.629169:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1519 00010000:00010000:1.0:1790771165.629170:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 94 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629182:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:2396:x1877759533700352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.629189:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 94 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629196:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.629200:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715840:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.629207:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 64 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629209:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.629222:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 64 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.629231:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05321840 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.629240:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.629244:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629251:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629257:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1790771165.629271:0:8409:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime: 0 -> 1790771161 00000100:00100000:1.0:1790771165.629284:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539715328:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.629291:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:2396:x1877759533700352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.629292:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693056 00000100:00100000:0.0:1790771165.629299:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693056 00000100:00100000:2.0:1790771165.629304:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1519 00010000:00010000:1.0:1790771165.629315:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000378ac67/0xfa0c505d97f0ac56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d69 expref: 25 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629318:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 125 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629329:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1520 00000100:00100000:2.0:1790771165.629343:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2396:x1877759533701248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.629351:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000378ac67/0xfa0c505d97f0ac56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d69 expref: 25 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629354:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.629361:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1521 00010000:00010000:1.0:1790771165.629365:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9200, rc 0) 00010000:00010000:2.0:1790771165.629367:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 125 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.629376:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2399:x1877759533693056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.629381:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 125 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629388:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.629395:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 125 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.629400:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533698048:12345-192.168.204.50@tcp:101:cat.0 Request processed in 19294us (19394us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.629406:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f096bc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34590 expref: 125 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629411:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 125 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.629419:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 898 00010000:00010000:2.0:1790771165.629438:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00010000:00010000:0.0:1790771165.629443:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f09a5f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3471f expref: 124 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629445:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.629455:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702016 00000100:00100000:3.0:1790771165.629461:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.629462:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702016 00010000:00010000:0.0:1790771165.629469:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.629473:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629474:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629515:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629519:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.629520:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702272 00000100:00100000:1.0:1790771165.629525:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702272 00010000:00010000:0.0:1790771165.629531:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.629536:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.629555:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:2399:x1877759533693056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 182us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.629556:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5494 00000100:00100000:2.0:1790771165.629567:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:2396:x1877759533701248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 224us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.629572:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.629573:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1521 00000100:00100000:1.0:1790771165.629573:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14434:x1877759533702016:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:2.0:1790771165.629586:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1520 00010000:00010000:1.0:1790771165.629587:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.629597:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0acb8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d85 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.629609:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5495 00000100:00100000:0.0:1790771165.629621:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14324:x1877759533702272:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771165.629633:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629634:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533699328 00000100:00100000:2.0:1790771165.629642:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533699328 00010000:00010000:0.0:1790771165.629645:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.629645:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.629661:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0a827 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c3c expref: 66 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629661:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.629672:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (4231168->4232644) req@ffff8bfb069aa300 x1877759533699328/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 1968/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.629701:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629704:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:2.0:1790771165.629723:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069aa300 with x1877759533699328 ext(4231168->4232644) 00010000:00010000:0.0:1790771165.629727:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc20109c00) 00010000:00010000:1.0:1790771165.629728:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629733:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 24 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629741:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.629752:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.629755:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 24 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629766:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629771:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.629779:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb069aa300 00010000:00010000:0.0:1790771165.629784:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629793:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629803:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 81 00000100:00100000:2.0:1790771165.629813:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759533699328:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:1.0:1790771165.629815:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629825:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629832:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629841:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771165.629848:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00000004:00010000:0.0:1790771165.629862:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000001da6bc8 reply state 000000007197fde4 transno 4294968548 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.629864:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629883:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.629887:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629894:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.629896:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771165.629904:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.629907:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.629908:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.629916:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.629920:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.629924:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702656 00010000:00010000:1.0:1790771165.629926:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629929:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702656 00010000:00010000:1.0:1790771165.629931:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.629936:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629941:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629950:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.629953:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.629958:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:14324:x1877759533702272:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 338us (500us total) trans 4294968548 rc 0/0 00010000:00010000:1.0:1790771165.629959:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.629959:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533701760 00000100:00100000:2.0:1790771165.629965:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533701760 00000100:00100000:3.0:1790771165.629970:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.629977:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0acbf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.629978:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5495 00010000:00010000:1.0:1790771165.629992:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.629997:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.630002:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702784 00010000:00010000:1.0:1790771165.630004:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.630005:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702528 00000100:00100000:0.0:1790771165.630007:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702784 00010000:00010000:1.0:1790771165.630013:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.630016:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630021:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630029:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc29009f00) 00010000:00010000:1.0:1790771165.630031:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.630034:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630038:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0acc6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.630042:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533703040 00000100:00100000:3.0:1790771165.630046:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.630047:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533703040 00000100:00100000:2.0:1790771165.630050:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702528 00010000:00010000:1.0:1790771165.630064:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0acb8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 71 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.630070:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533703296 00000100:00100000:0.0:1790771165.630075:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533703296 00010000:00010000:1.0:1790771165.630076:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 70 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630083:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:1.0:1790771165.630087:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.630090:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593c00, rc 0) 00000100:00100000:2.0:1790771165.630094:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533702912 00000100:00100000:2.0:1790771165.630099:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533702912 00000100:00100000:3.0:1790771165.630110:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533703936 00000100:00100000:1.0:1790771165.630116:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14434:x1877759533702016:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 550us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.630116:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533703936 00000100:00100000:0.0:1790771165.630122:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5496 00000100:00100000:2.0:1790771165.630136:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5497 00000100:00100000:0.0:1790771165.630137:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14506:x1877759533702656:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771165.630146:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5494 00010000:00010000:0.0:1790771165.630148:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.630153:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533701760:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:0.0:1790771165.630161:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0acdb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d93 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630163:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.630169:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5498 00010000:00010000:2.0:1790771165.630176:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ace2 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d7e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.630182:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5499 00000100:00100000:3.0:1790771165.630186:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14507:x1877759533702784:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:1.0:1790771165.630197:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14545:x1877759533703040:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.630199:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630201:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.630207:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.630211:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630214:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0acf0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d9a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630220:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0acf7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34da8 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630222:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630250:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630253:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630258:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630265:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630271:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630277:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630283:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630292:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630304:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630306:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630312:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630331:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630334:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630343:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630344:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630345:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630353:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630368:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630370:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630375:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630378:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630395:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630401:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630403:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630410:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.630422:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.630428:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.630431:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.630440:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:3.0:1790771165.630440:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.630441:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630454:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630464:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630464:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630465:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.630467:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630509:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630514:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630518:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630521:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630537:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630541:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.630545:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630551:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630551:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630565:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630576:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630579:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.630579:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.630580:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x4d:0x0]: returning size 8 00010000:00010000:0.0:1790771165.630588:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630590:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.630592:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000004:00010000:1.0:1790771165.630598:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630598:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630599:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.630602:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630605:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630621:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630625:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630630:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.630633:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630638:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.630644:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630648:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.630657:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.630658:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ad0c lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630659:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ace9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630663:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630663:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630696:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630700:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ad05 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630702:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630702:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630710:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630728:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630729:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630735:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630744:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630753:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630755:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.630757:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.630767:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630770:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630771:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630771:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630774:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630794:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ba00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.630796:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.630798:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630800:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630801:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630803:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc0786ee00) 00010000:00010000:2.0:1790771165.630812:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.630817:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630822:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.630826:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630826:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630829:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ad28 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630830:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.630836:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630855:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc22108f00) 00010000:00010000:1.0:1790771165.630856:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0ad13 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630858:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc20109b00) 00010000:00010000:0.0:1790771165.630859:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.630864:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630867:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.630876:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630879:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0acfe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630879:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ace2 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d7e expref: 97 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630880:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630902:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0ad1a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630905:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630910:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.630918:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.630923:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0acdb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 75 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.630924:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630925:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.630943:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0acf0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d9a expref: 76 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630948:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.630953:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0ace2 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d7e expref: 97 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630955:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630957:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 75 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.630978:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630988:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771165.630989:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5c00, rc 0) 00010000:00010000:1.0:1790771165.630991:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x391d5834 (ffff8bfb0321ae00) 00010000:00010000:3.0:1790771165.630991:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d9a expref: 74 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.630999:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.630999:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.631004:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631006:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1bc00, rc 0) 00010000:00010000:3.0:1790771165.631007:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:1.0:1790771165.631012:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0ad2f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631013:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.631019:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487e600, rc 0) 00000100:00100000:2.0:1790771165.631025:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533701760:12345-192.168.204.50@tcp:101:touch.0 Request processed in 874us (1323us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.631041:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5497 00010000:00010000:1.0:1790771165.631042:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0acf7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34da8 expref: 75 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631050:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14506:x1877759533702656:12345-192.168.204.50@tcp:101:ln.0 Request processed in 914us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.631054:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14507:x1877759533702784:12345-192.168.204.50@tcp:101:chown.0 Request processed in 870us (1285us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.631064:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34da8 expref: 74 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.631064:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5500 00000100:00100000:3.0:1790771165.631076:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5498 00000100:00100000:2.0:1790771165.631078:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14470:x1877759533702528:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:0.0:1790771165.631090:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5496 00010000:00010000:1.0:1790771165.631093:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4d:0x0].0x0 (ffff8bfc2900ac00) 00010000:00010000:2.0:1790771165.631095:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.631096:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:3.0:1790771165.631100:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5501 00010000:00010000:1.0:1790771165.631101:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81800, rc 0) 00010000:00010000:2.0:1790771165.631105:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0ad44 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34d8c expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.631114:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13890:x1877759533703296:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771165.631121:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5502 00010000:00010000:3.0:1790771165.631126:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.631128:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14545:x1877759533703040:12345-192.168.204.50@tcp:101:chown.0 Request processed in 934us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.631136:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14326:x1877759533702912:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:1.0:1790771165.631139:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5499 00010000:00010000:3.0:1790771165.631139:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ad4b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34daf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631141:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631155:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.631161:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5503 00010000:00010000:2.0:1790771165.631165:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631169:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a200/0xfa0c505d97f0ad59 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34da1 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.631173:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13737:x1877759533703936:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.631178:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631187:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.631189:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631196:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0ad67 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34db6 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631206:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631208:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631222:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631223:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631226:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a200/0xfa0c505d97f0ad59 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34da1 expref: 74 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631244:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.631249:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.631255:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a200/0xfa0c505d97f0ad59 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34da1 expref: 74 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631256:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631283:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631288:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771165.631290:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631293:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771165.631298:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631299:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a200, rc 0) 00010000:00010000:1.0:1790771165.631313:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0ad67 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34db6 expref: 97 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631314:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631326:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14326:x1877759533702912:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 195us (1362us total) trans 0 rc 0/0 00000004:00200000:3.0:1790771165.631335:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.631344:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5502 00010000:00010000:1.0:1790771165.631346:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.631351:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.631354:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631357:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0ad67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34db6 expref: 97 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631372:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.631374:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.631377:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81600, rc 0) 00010000:00010000:3.0:1790771165.631386:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631388:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631400:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.631400:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631405:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.631411:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13737:x1877759533703936:12345-192.168.204.50@tcp:101:ls.0 Request processed in 238us (1367us total) trans 4294968549 rc 301/301 00010000:00010000:3.0:1790771165.631417:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631427:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631431:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.631435:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5503 00010000:00010000:2.0:1790771165.631439:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.631439:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.631446:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631453:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.631457:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704320 00010000:00010000:2.0:1790771165.631459:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.631462:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704320 00010000:00010000:3.0:1790771165.631464:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.631468:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.631471:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.631472:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631477:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.631505:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631509:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0ad60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631514:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0ad83 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.631521:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5504 00010000:00010000:3.0:1790771165.631532:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.631538:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14362:x1877759533704320:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771165.631540:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631544:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533703680 00010000:00010000:3.0:1790771165.631546:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631550:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533703680 00010000:00010000:1.0:1790771165.631551:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.631569:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ad91 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dc4 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631570:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631570:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.631582:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5505 00010000:00010000:3.0:1790771165.631594:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.631596:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14203:x1877759533703680:12345-192.168.204.50@tcp:55:cp.0 00010000:00010000:2.0:1790771165.631596:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631599:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631617:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.631618:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631625:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631629:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc20109f00) 00010000:00010000:0.0:1790771165.631630:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631634:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ad9f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631636:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.631642:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631644:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631659:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 97 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631659:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ad9f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631663:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0ad75 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631674:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.631691:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.631697:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631704:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631705:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ad9f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631705:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0ad52 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631722:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ad4b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34daf expref: 74 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.631736:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00010000:00010000:3.0:1790771165.631738:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.631739:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631744:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.631746:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 97 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631753:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0ad4b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34daf expref: 74 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631754:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.631771:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 97 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631778:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.631782:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00010000:00010000:2.0:1790771165.631790:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.631791:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539715968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.631797:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ad91 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dc4 expref: 99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631797:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.631812:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13890:x1877759533703296:12345-192.168.204.50@tcp:101:ls.0 Request processed in 698us (1891us total) trans 4294968550 rc 301/301 00010000:00010000:2.0:1790771165.631816:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631832:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ad9f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dc4 expref: 98 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.631832:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5501 00000100:00100000:0.0:1790771165.631835:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87480 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.631835:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf7a5b27a (ffff8bfc310f1f00) 00010000:00010000:2.0:1790771165.631843:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.631848:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631849:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771165.631856:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790771165.631860:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0ad6e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631861:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1c00, rc 0) 00000100:00100000:1.0:1790771165.631895:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:14362:x1877759533704320:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 360us (451us total) trans 4294968551 rc 0/0 00010000:00010000:2.0:1790771165.631895:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0ad44 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d8c expref: 72 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.631902:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.631921:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771165.631922:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5504 00000100:00100000:3.0:1790771165.631926:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704064 00010000:00010000:2.0:1790771165.631927:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1790771165.631933:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704064 00010000:00010000:2.0:1790771165.631934:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0ad44 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d8c expref: 72 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.631945:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af400, rc 0) 00010000:00010000:1.0:1790771165.631953:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.631960:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.631967:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5506 00000100:00100000:2.0:1790771165.631977:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14470:x1877759533702528:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 901us (2139us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.631979:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14464:x1877759533704064:12345-192.168.204.50@tcp:101:touch.0 00000100:00100000:0.0:1790771165.631987:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.631998:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5500 00000100:00100000:2.0:1790771165.632021:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704448 00000100:00100000:2.0:1790771165.632026:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704448 00000100:00100000:0.0:1790771165.632031:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.632049:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704704 00000100:00100000:2.0:1790771165.632054:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704704 00010000:00010000:3.0:1790771165.632060:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.632072:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0adad lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dbd expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632076:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.632082:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5507 00000100:00100000:2.0:1790771165.632095:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13956:x1877759533704448:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:0.0:1790771165.632102:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.632106:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.632117:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0adb4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dcb expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632127:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.632144:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771165.632145:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10744 00010000:00010000:2.0:1790771165.632155:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632156:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:1.0:1790771165.632158:0:6508:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 165837671098ns, next at 166837668236ns, rc = 0 00010000:00010000:3.0:1790771165.632164:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632176:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632177:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533706496 00010000:00010000:2.0:1790771165.632177:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632184:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533706496 00010000:00010000:2.0:1790771165.632194:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632199:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632202:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632206:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.632211:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x14:0x0] (4194304->8388607) req@ffff8bfb057b6a00 x1877759533706496/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.632214:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632229:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632232:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.632250:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b6a00 with x1877759533706496 ext(4194304->8388607) 00010000:00010000:3.0:1790771165.632258:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.632259:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb057b6a00 00010000:00010000:2.0:1790771165.632261:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632262:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632279:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 368 00010000:00010000:1.0:1790771165.632285:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.632289:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.632293:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533706496:12345-192.168.204.50@tcp:3:dd.0 00010000:00010000:1.0:1790771165.632306:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632314:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632319:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632321:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00010000:00010000:3.0:1790771165.632322:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632329:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771165.632335:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632346:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632346:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632347:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0ac10 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.632375:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006464848 reply state 000000004ec12eb8 transno 4294969128 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632375:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.632379:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00000004:00200000:3.0:1790771165.632387:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.632399:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632401:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.632404:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1790771165.632416:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632419:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000004:00010000:2.0:1790771165.632421:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632428:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771165.632429:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632434:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.632435:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632443:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632444:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632453:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632454:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632456:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632478:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632479:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632506:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4bc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.632509:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632514:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632527:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632528:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533f000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.632530:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771165.632534:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632537:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.632545:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 98 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632554:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632563:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.632572:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632573:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 98 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632575:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.632582:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.632587:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632591:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632598:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 98 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632608:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0adc2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632616:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.632623:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.632627:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632634:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632634:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0adbb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632636:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 98 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632658:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632664:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539716096:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771165.632690:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632693:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632707:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632708:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632717:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03194000 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.632722:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.632726:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.632727:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632730:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632737:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632740:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704832 00010000:00010000:3.0:1790771165.632740:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632748:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704832 00010000:00010000:2.0:1790771165.632750:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc29009f00) 00010000:00010000:2.0:1790771165.632757:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.632760:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632762:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x61bf1dfb (ffff8bfc20109100) 00010000:00010000:3.0:1790771165.632769:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.632770:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0add0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632772:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632774:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705088 00000100:00100000:1.0:1790771165.632780:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705088 00010000:00010000:3.0:1790771165.632786:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0adc9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632800:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0adb4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dcb expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632801:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705216 00000100:00100000:1.0:1790771165.632805:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705216 00010000:00010000:3.0:1790771165.632819:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0adad lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dbd expref: 73 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632822:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dcb expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.632827:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5508 00010000:00010000:2.0:1790771165.632838:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00000100:00100000:1.0:1790771165.632841:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14341:x1877759533704704:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.632844:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.632845:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dbd expref: 72 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632849:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02800, rc 0) 00010000:00010000:1.0:1790771165.632852:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.632861:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771165.632863:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0ade5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dd9 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632865:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1790771165.632871:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687200, rc 0) 00000100:00100000:2.0:1790771165.632876:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5509 00000100:00100000:2.0:1790771165.632885:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14282:x1877759533704832:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771165.632892:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632894:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.632902:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632907:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0adf3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34de0 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632911:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.632918:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5510 00000100:00100000:3.0:1790771165.632931:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14430:x1877759533705088:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:1.0:1790771165.632934:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632940:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.632941:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632942:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632952:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ae08 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dee expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.632966:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632966:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632985:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.632992:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.632995:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633011:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633014:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633023:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633024:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633030:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633043:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633050:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633055:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633072:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633073:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.633074:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 1310720 00000004:00200000:1.0:1790771165.633080:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.633091:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633099:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633105:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633111:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633115:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633123:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633131:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633139:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633146:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633150:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633163:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633169:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.633170:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633176:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.633179:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633182:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633191:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.633194:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4325376 00000004:00200000:3.0:1790771165.633200:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.633201:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633209:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.633211:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633214:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.633221:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.633226:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.633226:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633227:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633233:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633247:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633251:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0adec lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633254:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633281:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633281:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.633288:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.633292:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633293:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633294:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633318:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ae01 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633318:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633319:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633341:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633344:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.633353:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633353:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633353:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.633360:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633375:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633378:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633379:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633388:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc8b04d25 (ffff8bfb0321ad00) 00010000:00010000:1.0:1790771165.633396:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.633400:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633403:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633404:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.633406:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.633410:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.633412:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633415:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633425:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0adfa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633432:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633435:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ae0f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633458:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xea196397 (ffff8bfc310f1300) 00010000:00010000:2.0:1790771165.633462:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.633462:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633467:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633472:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633475:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0ade5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd9 expref: 107 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633476:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ae1d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633513:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633519:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.633525:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633538:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633546:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd9 expref: 107 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633547:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa5ec40c9 (ffff8bfc20109000) 00010000:00010000:2.0:1790771165.633555:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0adf3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34de0 expref: 107 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.633555:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.633560:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771165.633562:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633568:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771165.633574:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0400, rc 0) 00010000:00010000:3.0:1790771165.633576:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0ae24 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633583:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34de0 expref: 106 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.633591:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:2.0:1790771165.633594:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771165.633598:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14341:x1877759533704704:12345-192.168.204.50@tcp:101:chown.0 Request processed in 759us (1566us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.633598:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02600, rc 0) 00010000:00010000:3.0:1790771165.633605:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ae08 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 107 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.633610:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5508 00010000:00010000:3.0:1790771165.633625:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 105 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.633630:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14282:x1877759533704832:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 743us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.633636:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5511 00010000:00010000:3.0:1790771165.633636:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771165.633644:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1790771165.633649:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14386:x1877759533705216:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.633649:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00000100:00100000:2.0:1790771165.633659:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5509 00010000:00010000:1.0:1790771165.633660:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.633671:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0ae39 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34df5 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633696:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14430:x1877759533705088:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 749us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.633702:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5510 00010000:00010000:1.0:1790771165.633714:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633726:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633738:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633738:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14464:x1877759533704064:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1762us (1841us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.633753:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5506 00010000:00010000:1.0:1790771165.633771:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633779:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633785:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633792:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.633810:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533703424 00000100:00100000:3.0:1790771165.633814:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533703424 00010000:00010000:1.0:1790771165.633821:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633828:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633834:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633838:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707008 00000100:00100000:3.0:1790771165.633841:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707008 00000004:00200000:1.0:1790771165.633852:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.633863:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.633873:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1391 00010000:00010000:1.0:1790771165.633876:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633883:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1392 00000100:00100000:2.0:1790771165.633885:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14597:x1877759533703424:12345-192.168.204.50@tcp:33:ln.0 00010000:00010000:1.0:1790771165.633891:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633898:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633903:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13269:x1877759533707008:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.633906:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633912:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633916:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc029cbc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.633918:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633923:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633929:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.633932:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1790771165.633932:0:6497:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00010000:00010000:1.0:1790771165.633936:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633942:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ae40 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633951:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633957:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633962:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.633966:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058af000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.633969:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.633973:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14597:x1877759533703424:12345-192.168.204.50@tcp:33:ln.0 Request processed in 90us (2577us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.633978:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.633986:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1391 00010000:00010000:1.0:1790771165.633988:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfb0321a100) 00010000:00010000:1.0:1790771165.633992:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.633997:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.633997:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13269:x1877759533707008:12345-192.168.204.50@tcp:35:ls.0 Request processed in 99us (202us total) trans 4294969129 rc 0/0 00010000:00010000:1.0:1790771165.634012:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0ae47 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634017:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1392 00010000:00010000:1.0:1790771165.634044:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0ae39 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 105 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.634055:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 104 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.634061:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771165.634063:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771165.634067:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00000100:00100000:2.0:1790771165.634073:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533699328:12345-192.168.204.50@tcp:4:cat.0 Request processed in 4260us (4507us total) trans 4294967580 rc 0/0 00000100:00100000:2.0:1790771165.634080:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 81 00002000:00100000:2.0:1790771165.634086:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (4231168->4232644) req@ffff8bfb069aa300 x1877759533699328/t4294967580(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 1968/448 e 0 to 0 dl 1790771176 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.634095:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069aa300 with x1877759533699328 ext(4231168->4232644) 00000100:00100000:1.0:1790771165.634102:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14386:x1877759533705216:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 450us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.634103:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.634107:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 26 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634119:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5511 00010000:00010000:2.0:1790771165.634125:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 26 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.634133:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb069aa300 00000100:00100000:3.0:1790771165.634146:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.634161:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533701888 00000100:00100000:2.0:1790771165.634165:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533701888 00000100:00100000:3.0:1790771165.634167:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533706368 00000100:00100000:3.0:1790771165.634171:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533706368 00010000:00010000:2.0:1790771165.634182:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 28 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634207:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 899 00000100:00100000:1.0:1790771165.634211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.634218:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533706368:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:2.0:1790771165.634228:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1522 00000100:00100000:2.0:1790771165.634238:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533701888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.634240:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705856 00000100:00100000:1.0:1790771165.634247:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705856 00010000:00010000:2.0:1790771165.634248:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790771165.634256:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size from disk: 0 -> 10289152 00002000:00010000:2.0:1790771165.634259:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime from disk: 1790771164 -> 1790771165 00002000:00010000:2.0:1790771165.634261:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks from disk: 0 -> 3712 00010000:00010000:2.0:1790771165.634266:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 28 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634278:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 28 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634285:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 900 00010000:00010000:2.0:1790771165.634296:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000245d5f24/0xfa0c505d97f08328 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8388608->8454143) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f54 expref: 28 pid: 13786 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634298:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533705856:12345-192.168.204.50@tcp:101:chown.0 00002000:00010000:3.0:1790771165.634299:0:13782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 47456 -> 47456 00002000:00010000:3.0:1790771165.634308:0:13782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00010000:00010000:1.0:1790771165.634316:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1790771165.634316:0:13782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 1790771160 -> 0 00010000:00010000:2.0:1790771165.634321:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(5 2) 00002000:00010000:3.0:1790771165.634322:0:13782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:1.0:1790771165.634329:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065bc4b23/0xfa0c505d97f0ae55 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e18 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634331:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(5 2) 00002000:00010000:3.0:1790771165.634331:0:13782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:2.0:1790771165.634347:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634358:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533706368:12345-192.168.204.50@tcp:2:chown.0 Request processed in 141us (213us total) trans 4294967582 rc 0/0 00010000:00010000:2.0:1790771165.634365:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634370:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 899 00000100:00100000:1.0:1790771165.634372:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539716224:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.634405:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634416:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 24 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.634427:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1877759539716352:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771165.634431:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03194c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.634431:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.634458:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2240 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.634479:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533692672 00000100:00100000:2.0:1790771165.634503:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533692672 00010000:00010000:2.0:1790771165.634519:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 123 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634524:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.634559:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533693568 00000100:00100000:2.0:1790771165.634562:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533693568 00000100:00100000:3.0:1790771165.634565:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1523 00000100:00100000:1.0:1790771165.634570:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.634577:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 124 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634581:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2398:x1877759533692672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.634589:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533700096 00000100:00100000:1.0:1790771165.634594:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533700096 00010000:00010000:3.0:1790771165.634595:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.634602:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 124 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.634607:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1524 00000100:00100000:2.0:1790771165.634623:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2398:x1877759533693568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.634623:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 124 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634627:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 901 00000100:00100000:1.0:1790771165.634640:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533700096:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:2.0:1790771165.634644:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.634648:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f09bb6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34734 expref: 124 pid: 12128 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634655:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 124 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.634660:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.634667:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.634690:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.634696:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.634702:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 123 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634712:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.634718:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:2398:x1877759533692672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (289us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.634724:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f09a20 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34718 expref: 123 pid: 6495 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.634731:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1523 00010000:00010000:2.0:1790771165.634744:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.634748:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.634754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.634760:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634765:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.634782:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.634807:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2398:x1877759533693568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 190us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.634808:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.634817:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1524 00000100:00100000:2.0:1790771165.634847:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707392 00000100:00100000:2.0:1790771165.634850:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707392 00002000:00100000:2.0:1790771165.634865:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (450560->454655) req@ffff8bfc3fb63100 x1877759533707392/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.634873:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb63100 with x1877759533707392 ext(450560->454655) 00000100:00100000:1.0:1790771165.634874:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707136 00002000:00010000:2.0:1790771165.634879:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb63100 00000100:00100000:1.0:1790771165.634880:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707136 00000100:00100000:2.0:1790771165.634900:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 369 00000100:00100000:2.0:1790771165.634908:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533707392:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771165.634910:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707264 00000100:00100000:1.0:1790771165.634914:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707264 00000100:00100000:1.0:1790771165.634935:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5512 00000100:00100000:1.0:1790771165.634941:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14257:x1877759533707136:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771165.634949:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.634956:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.634959:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ae5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e3b expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.634972:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.634981:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533707392:12345-192.168.204.50@tcp:3:cat.0 Request processed in 72us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.634990:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 369 00002000:00100000:2.0:1790771165.635000:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (450560->454655) req@ffff8bfc3fb63100 x1877759533707392/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.635001:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635017:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.635022:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb63100 with x1877759533707392 ext(450560->454655) 00010000:00010000:1.0:1790771165.635027:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.635029:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb63100 00010000:00010000:1.0:1790771165.635044:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635051:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.635052:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000976849c2 reply state 000000007d361623 transno 4294969130 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.635064:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5513 00010000:00010000:1.0:1790771165.635066:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.635073:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.635079:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14220:x1877759533707264:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771165.635086:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.635089:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.635090:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.635091:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.635102:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ae71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e42 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635116:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.635123:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14299:x1877759533687680:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 57761us (57926us total) trans 4294969130 rc 0/0 00010000:00010000:1.0:1790771165.635127:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635133:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.635134:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5456 00010000:00010000:1.0:1790771165.635137:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635157:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635165:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635179:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635184:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635190:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.635197:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.635201:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1790771165.635212:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635223:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635225:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635244:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635248:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635262:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635263:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635284:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635289:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.635292:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.635296:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x56:0x0]: returning size 5 00010000:00010000:1.0:1790771165.635299:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.635300:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.635318:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000004:00010000:2.0:1790771165.635318:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635326:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.635332:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635337:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635344:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0ae63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635355:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635364:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635365:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635381:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635383:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635399:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635402:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635406:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.635412:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635415:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.635419:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635422:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635443:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771165.635444:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635448:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.635454:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635462:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfb0321af00) 00010000:00010000:2.0:1790771165.635462:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0ae7f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635469:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.635475:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635503:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0ae6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635506:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635514:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635518:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635523:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.635526:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635532:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ae5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e3b expref: 126 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635534:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635557:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc310f1200) 00010000:00010000:2.0:1790771165.635561:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.635562:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e3b expref: 125 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635566:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635584:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0ae86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.635587:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb0321a400) 00010000:00010000:1.0:1790771165.635594:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.635598:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669800, rc 0) 00000100:00100000:1.0:1790771165.635620:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14257:x1877759533707136:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 679us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.635628:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5512 00010000:00010000:2.0:1790771165.635633:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ae71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e42 expref: 126 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635656:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e42 expref: 124 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.635665:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:2.0:1790771165.635669:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.635673:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00000100:00100000:2.0:1790771165.635708:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14220:x1877759533707264:12345-192.168.204.50@tcp:101:rm.0 Request processed in 633us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.635718:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5513 00000100:00100000:0.0:1790771165.635719:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13956:x1877759533704448:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 3623us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.635728:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5507 00000001:00080000:0.0:1790771165.636522:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967582 is committed 00000001:00080000:0.0:1790771165.636535:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967580 is committed 00000001:00080000:0.0:1790771165.636543:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967579 is committed 00000100:00100000:1.0:1790771165.636641:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2398:x1877759533700096:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2003us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.636648:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 901 00000100:00100000:2.0:1790771165.639925:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.639998:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707648 00000100:00100000:0.0:1790771165.640004:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707648 00000100:00100000:0.0:1790771165.640046:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5514 00000100:00100000:0.0:1790771165.640054:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14376:x1877759533707648:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:0.0:1790771165.640064:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.640073:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0ae94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e49 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640119:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640128:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640135:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640147:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640152:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640157:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771165.640381:0:13772:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x24:0x0], index 0: 0 00000100:00100000:1.0:1790771165.640448:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.640471:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640479:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640512:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640535:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640541:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640546:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.640554:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.640555:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.640560:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.640566:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707776 00010000:00010000:0.0:1790771165.640569:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.640571:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707776 00010000:00010000:0.0:1790771165.640580:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.640582:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.640585:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640589:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ae9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.640600:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000067b3524 reply state 000000009639f7fc transno 4294969131 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.640605:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5515 00010000:00010000:0.0:1790771165.640614:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.640619:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13459:x1877759533707776:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1790771165.640625:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfb0321a600) 00010000:00010000:0.0:1790771165.640628:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.640630:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.640632:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.640645:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0aeb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e50 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640648:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0ae94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e49 expref: 103 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640674:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e49 expref: 103 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.640696:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f0aebe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.640697:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:0.0:1790771165.640703:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.640707:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8200, rc 0) 00010000:00010000:2.0:1790771165.640711:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f0aebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.640723:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f0aebe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.640739:0:13770:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000009e907048 x1877759539715584) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 1/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 71 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.640750:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14376:x1877759533707648:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 695us (822us total) trans 4294969131 rc 0/0 00010000:00010000:1.0:1790771165.640756:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ab68 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cdd expref: 71 pid: 13763 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.640758:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533707904 00000100:00100000:0.0:1790771165.640762:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5514 00000100:00100000:3.0:1790771165.640765:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533707904 00000100:00100000:1.0:1790771165.640780:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee0700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715584:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.640802:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0aeb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e50 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.640806:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 902 00000100:00100000:3.0:1790771165.640822:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533707904:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771165.640827:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72a00/0xfa0c505d97f0aebe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x31:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e50 expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.640832:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.640836:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x31:0x0].0x0 (ffff8bfc2900af00) 00010000:00010000:2.0:1790771165.640840:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.640842:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72a00, rc 0) 00010000:00010000:3.0:1790771165.640845:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0aec5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e57 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.640870:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13459:x1877759533707776:12345-192.168.204.50@tcp:101:dd.0 Request processed in 254us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.640878:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5515 00000100:00100000:1.0:1790771165.640924:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715712:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.641049:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539716480:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.641365:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63000 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.641371:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.641412:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708288 00000100:00100000:2.0:1790771165.641417:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708288 00010000:00010000:2.0:1790771165.641435:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 71 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.641439:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d60700 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539715840:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.641474:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771165.641477:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1525 00010000:00010000:3.0:1790771165.641480:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.641515:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2396:x1877759533708288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.641525:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.641530:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 71 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.641722:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.641733:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 71 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.641823:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.641830:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0a80b lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c12 expref: 71 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.641840:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.641843:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.641850:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.641856:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.641888:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2396:x1877759533708288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 402us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.641897:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1525 00000100:00100000:0.0:1790771165.642591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.642624:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708416 00000100:00100000:2.0:1790771165.642631:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708416 00010000:00010000:2.0:1790771165.642649:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 103 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.642692:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1526 00000100:00100000:2.0:1790771165.642699:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:2399:x1877759533708416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.642705:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.642709:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 103 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642717:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 103 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642729:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f086af lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3406c expref: 103 pid: 13772 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642738:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.642741:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642746:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642751:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.642767:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.642792:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:2399:x1877759533708416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.642795:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.642800:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1526 00010000:00010000:3.0:1790771165.642808:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.643913:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968552 is committed 00000001:00080000:0.0:1790771165.643924:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968551 is committed 00000020:00080000:0.0:1790771165.643938:0:7423:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 17 batchid updated 00010000:00010000:2.0:1790771165.643939:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.643947:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.643950:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.643954:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968540 is committed 00010000:00010000:2.0:1790771165.643954:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.643967:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771165.643968:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17 00010000:00010000:2.0:1790771165.643978:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.643986:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.643989:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644005:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.644009:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644010:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.644017:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfc35f94a80 with version 37 00010000:00010000:1.0:1790771165.644028:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644034:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x1d91fb2c (ffff8bfc29009500) 00010000:00010000:2.0:1790771165.644038:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1790771165.644038:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 17 cancel update log [0x200000401:0x2:0x0].17: rc = 0 00010000:00010000:1.0:1790771165.644040:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:2.0:1790771165.644044:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644049:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00080000:0.0:1790771165.644051:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 37 rpc_version 37 00010000:00010000:2.0:1790771165.644053:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0a740 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x67:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644056:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644069:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0a9fc lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1790771165.644073:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1790771165.644082:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.644083:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb057b4000 x1877759539716736/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1790771165.644086:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 17 cancel update log [0x240000400:0x2:0x0].17: rc = 0 00010000:00010000:1.0:1790771165.644093:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771165.644099:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17 00010000:00010000:2.0:1790771165.644100:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644116:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.644119:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539716736:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1790771165.644120:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.644121:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ebcb72b reply state 000000005235021a transno 4294968552 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644127:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644143:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.644148:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.644149:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.644150:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644155:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644172:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.644173:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771165.644180:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.644182:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.644188:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.644194:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.644196:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.644202:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:0.0:1790771165.644206:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87180 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.644206:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.644209:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644210:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc29009f00) 00010000:00010000:1.0:1790771165.644218:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.644221:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0accd lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644222:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.644231:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539716736 00000100:00100000:0.0:1790771165.644238:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539716736 00010000:00080000:3.0:1790771165.644238:0:13770:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771165.644244:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0aad5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.644251:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:14363:x1877759533700864:12345-192.168.204.50@tcp:36:chown.0 Request processed in 15453us (15597us total) trans 4294968552 rc 0/0 00010000:00010000:2.0:1790771165.644252:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644265:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644269:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.644276:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1790771165.644283:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5493 00000100:00100000:0.0:1790771165.644290:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7438:x1877759539716736:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1790771165.644290:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644292:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644313:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644314:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.644322:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644323:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.644329:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644341:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644342:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644361:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:1.0:1790771165.644365:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.644366:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.644370:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644370:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.644376:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.644378:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0aadc lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x2e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.644389:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0acb1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.644393:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7438:x1877759539716736:12345-0@lo:1000:osp_up0-1.0 Request processed in 105us (230us total) trans 4294969132 rc 0/0 00000100:00100000:0.0:1790771165.644408:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:0.0:1790771165.644445:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b4000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539716736:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1790771165.647102:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.647126:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.647144:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.647147:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704960 00000100:00100000:1.0:1790771165.647155:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704960 00000100:00100000:3.0:1790771165.647167:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.647179:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708800 00000100:00100000:0.0:1790771165.647186:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708800 00000100:00100000:2.0:1790771165.647195:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533704576 00000100:00100000:3.0:1790771165.647196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.647199:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709056 00000100:00100000:2.0:1790771165.647202:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533704576 00000100:00100000:1.0:1790771165.647205:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709056 00000100:00100000:0.0:1790771165.647226:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705728 00000100:00100000:0.0:1790771165.647230:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705728 00000100:00100000:2.0:1790771165.647244:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5516 00000100:00100000:2.0:1790771165.647254:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14577:x1877759533704960:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:1.0:1790771165.647265:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5517 00010000:00010000:2.0:1790771165.647265:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.647274:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5518 00010000:00010000:2.0:1790771165.647276:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0aecc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34de7 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.647283:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14541:x1877759533708800:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771165.647288:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14479:x1877759533704576:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771165.647305:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.647317:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aed3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dd2 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647324:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647325:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.647330:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.647342:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647354:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647355:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647357:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f08e42 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e341f4 expref: 60 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647380:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647387:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647388:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771165.647390:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647397:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.647408:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647415:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647416:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647418:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647442:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647447:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 59 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647449:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647452:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.647469:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533706112 00010000:00010000:2.0:1790771165.647471:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.647476:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533706112 00010000:00010000:1.0:1790771165.647477:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647481:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647507:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.647511:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647525:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647529:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647534:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:3.0:1790771165.647534:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5519 00010000:00010000:2.0:1790771165.647541:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.647545:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647548:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647549:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 60 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647563:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647567:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aeda lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647585:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 60 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647590:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.647600:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.647603:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647611:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.647613:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.647615:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539716864:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.647619:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.647625:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647631:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647650:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647653:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647659:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.647666:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14507:x1877759533709056:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.647687:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc310f1200) 00010000:00010000:0.0:1790771165.647688:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.647690:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a79c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.647692:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.647694:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.647701:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647702:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.647705:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0af04 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e73 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647709:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647718:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aee8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.647720:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5520 00010000:00010000:0.0:1790771165.647733:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.647740:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14491:x1877759533705728:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771165.647745:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.647748:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.647751:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647752:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.647753:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0af0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647757:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0aecc lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34de7 expref: 60 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647765:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0af12 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e11 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647767:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0aee1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.647778:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647786:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.647795:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647795:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.647799:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0af0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647803:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0aecc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34de7 expref: 61 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647815:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647822:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.647828:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72000, rc 0) 00010000:00010000:0.0:1790771165.647833:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.647838:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.647844:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.647845:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647846:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.647852:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.647859:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14577:x1877759533704960:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 603us (754us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771165.647862:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647864:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.647873:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0af04 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e73 expref: 126 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.647883:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5516 00010000:00010000:0.0:1790771165.647884:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfc3607d100) 00010000:00010000:0.0:1790771165.647891:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.647895:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647899:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.647911:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5521 00010000:00010000:0.0:1790771165.647916:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0aef6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.647922:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0af0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e73 expref: 125 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.647924:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.647930:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+59:14395:x1877759533706112:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771165.647941:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0aed3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 60 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.647946:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:2.0:1790771165.647950:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.647951:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.647954:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.647959:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00010000:00010000:2.0:1790771165.647966:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0af27 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e26 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.647967:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 59 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.647985:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14507:x1877759533709056:12345-192.168.204.50@tcp:101:chown.0 Request processed in 323us (816us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.647991:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771165.647994:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771165.647998:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5519 00010000:00010000:0.0:1790771165.647999:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ae00, rc 0) 00010000:00010000:1.0:1790771165.648008:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648021:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648021:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.648029:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14479:x1877759533704576:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 745us (882us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.648043:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648047:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.648048:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5518 00010000:00010000:2.0:1790771165.648064:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648081:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648087:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648094:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.648105:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x36:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.648109:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1790771165.648121:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648129:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648133:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648135:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648149:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648150:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648167:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648168:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648182:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.648186:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648192:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.648197:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x67:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.648199:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000004:00200000:2.0:1790771165.648202:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.648204:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.648208:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.648214:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648215:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0af19 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648235:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648237:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648248:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648250:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648262:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648264:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648276:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.648277:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.648280:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648282:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648293:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648296:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648306:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd6e9df9d (ffff8bfb0321af00) 00010000:00010000:1.0:1790771165.648310:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.648314:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648314:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc310f1300) 00010000:00010000:2.0:1790771165.648322:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.648324:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0af20 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648329:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648338:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af35 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648344:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0af12 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 60 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648355:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648363:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 59 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648364:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648383:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfb0321a100) 00010000:00010000:2.0:1790771165.648383:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.648391:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.648394:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc800, rc 0) 00010000:00010000:2.0:1790771165.648396:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.648400:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648405:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648413:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x1d91fb2c (ffff8bfc310f1f00) 00010000:00010000:2.0:1790771165.648415:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.648417:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648421:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af3c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.648426:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+59:14491:x1877759533705728:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 692us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.648435:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5520 00010000:00010000:2.0:1790771165.648452:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0af27 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e26 expref: 59 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648469:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e26 expref: 58 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.648474:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:2.0:1790771165.648476:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.648478:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03e00, rc 0) 00000100:00100000:2.0:1790771165.648533:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:14395:x1877759533706112:12345-192.168.204.50@tcp:101:rm.0 Request processed in 611us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.648540:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5521 00000100:00100000:3.0:1790771165.654072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.654138:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708160 00000100:00100000:0.0:1790771165.654144:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708160 00000100:00100000:0.0:1790771165.654176:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5522 00000100:00100000:0.0:1790771165.654182:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:13894:x1877759533708160:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771165.654191:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.654199:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0af4a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e5e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.654248:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0af51 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.654257:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0af51 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.654263:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0af51 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.654269:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.654319:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0af4a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e5e expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.654330:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0af51 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e5e expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.654345:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:0.0:1790771165.654348:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.654350:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a800, rc 0) 00000100:00100000:0.0:1790771165.654377:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:13894:x1877759533708160:12345-192.168.204.50@tcp:101:rm.0 Request processed in 195us (308us total) trans 4294968553 rc 0/0 00000100:00100000:0.0:1790771165.654382:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5522 00000100:00100000:0.0:1790771165.654887:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.654910:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.654937:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709824 00000100:00100000:1.0:1790771165.654943:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709824 00000100:00100000:2.0:1790771165.654949:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710080 00000100:00100000:2.0:1790771165.654957:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710080 00000100:00100000:1.0:1790771165.654980:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5523 00000100:00100000:1.0:1790771165.654991:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14326:x1877759533709824:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:2.0:1790771165.654998:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 903 00000100:00100000:2.0:1790771165.655011:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533710080:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:1.0:1790771165.655051:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14326:x1877759533709824:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 63us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.655059:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5523 00002000:00010000:2.0:1790771165.655113:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 32696 -> 32696 00002000:00010000:2.0:1790771165.655116:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1790771165.655118:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771165.655120:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 0 -> 1790771165 00002000:00010000:2.0:1790771165.655121:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:2.0:1790771165.655148:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533710080:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 142us (236us total) trans 4294967583 rc 0/0 00000100:00100000:2.0:1790771165.655153:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 903 00000100:00100000:0.0:1790771165.655471:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.655523:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709312 00000100:00100000:2.0:1790771165.655528:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709312 00000100:00100000:2.0:1790771165.655558:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5524 00000100:00100000:2.0:1790771165.655566:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14545:x1877759533709312:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.655574:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.655582:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af5f lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e7a expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655610:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655620:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655631:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655649:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.655652:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.655663:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655673:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.655684:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708928 00000100:00100000:0.0:1790771165.655691:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708928 00000100:00100000:3.0:1790771165.655696:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.655720:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705344 00000100:00100000:0.0:1790771165.655723:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705344 00010000:00010000:2.0:1790771165.655726:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655734:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655740:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.655747:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5525 00000100:00100000:0.0:1790771165.655759:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:13958:x1877759533708928:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:1.0:1790771165.655759:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5526 00000004:00200000:2.0:1790771165.655760:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 38336 00000004:00200000:2.0:1790771165.655767:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.655773:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.655775:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14482:x1877759533705344:12345-192.168.204.50@tcp:101:truncate.0 00000004:00010000:2.0:1790771165.655778:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655785:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0af7b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e6c expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655786:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.655787:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655797:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0af82 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34dfc expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655808:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655818:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655822:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655824:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655843:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655844:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655844:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.655851:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655866:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655876:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655885:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655892:0:13770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 4/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655898:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:1.0:1790771165.655900:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655907:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.655914:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.655920:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655926:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655929:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0af66 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655945:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655954:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655954:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655973:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655978:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655982:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.655986:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.655993:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.655996:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f0af9e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656012:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f0af9e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656021:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f0af9e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.656021:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0xcdd6ff3 (ffff8bfc310f1300) 00010000:00010000:2.0:1790771165.656030:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.656036:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.656037:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x45:0x0]: returning size 5 00010000:00010000:2.0:1790771165.656047:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0af6d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.656052:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f0af9e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656060:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656066:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.656070:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0af5f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 64 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656074:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.656083:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 63 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656084:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfca00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.656089:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.656097:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771165.656100:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.656101:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.656106:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03c00, rc 0) 00010000:00010000:1.0:1790771165.656114:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.656118:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.656120:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656125:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0af90 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656132:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656137:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.656139:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:14545:x1877759533709312:12345-192.168.204.50@tcp:101:chown.0 Request processed in 574us (667us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.656149:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.656154:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5524 00010000:00010000:1.0:1790771165.656161:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfce00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.656164:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656172:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656178:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x18618557 (ffff8bfb0321af00) 00010000:00010000:1.0:1790771165.656180:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.656182:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656186:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0af97 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656206:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0af82 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dfc expref: 95 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656213:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfdc00/0xfa0c505d97f0af9e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dfc expref: 94 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.656218:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x45:0x0].0x0 (ffff8bfb0321ad00) 00010000:00010000:1.0:1790771165.656219:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.656220:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfdc00, rc 0) 00000100:00100000:1.0:1790771165.656250:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14482:x1877759533705344:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 482us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.656256:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5526 00000100:00100000:0.0:1790771165.656551:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.656578:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705472 00000100:00100000:3.0:1790771165.656584:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705472 00000100:00100000:0.0:1790771165.656595:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.656620:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539715968:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.656627:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5527 00000100:00100000:2.0:1790771165.656630:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710464 00000100:00100000:2.0:1790771165.656637:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710464 00010000:00010000:1.0:1790771165.656640:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.656642:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14536:x1877759533705472:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.656660:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.656671:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0afa5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e03 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.656693:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1393 00000100:00100000:2.0:1790771165.656704:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533710464:12345-192.168.204.50@tcp:49:touch.0 00010000:00010000:3.0:1790771165.656731:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656741:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656749:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.656757:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14277:x1877759533710464:12345-192.168.204.50@tcp:49:touch.0 Request processed in 55us (161us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771165.656763:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1393 00010000:00010000:3.0:1790771165.656764:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656773:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656779:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656808:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656814:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656818:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.656874:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000004:00200000:3.0:1790771165.656876:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.656884:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656891:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656897:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656901:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656909:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656913:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656917:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.656919:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656923:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656928:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.656930:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.656932:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656936:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0afac lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656942:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656947:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656951:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656954:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.656956:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656960:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.656964:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc10471200) 00010000:00010000:3.0:1790771165.657018:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.657020:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657025:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0afb3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.657047:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.657047:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0afa5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 96 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657059:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 95 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657065:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771165.657068:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.657070:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00000100:00100000:0.0:1790771165.657075:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.657083:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705600 00000100:00100000:1.0:1790771165.657088:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705600 00000100:00100000:3.0:1790771165.657102:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14536:x1877759533705472:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 465us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.657111:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5527 00000100:00100000:2.0:1790771165.657113:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709184 00000100:00100000:0.0:1790771165.657116:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.657121:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709184 00000100:00100000:3.0:1790771165.657137:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5528 00000100:00100000:3.0:1790771165.657148:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14580:x1877759533705600:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.657155:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.657163:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 715 00010000:00010000:3.0:1790771165.657164:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0afc1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e0a expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.657173:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:2396:x1877759533709184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.657182:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.657190:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657192:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0ad36 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d9a expref: 63 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657210:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:2.0:1790771165.657213:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.657240:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:2396:x1877759533709184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.657244:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533708544 00010000:00010000:3.0:1790771165.657245:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.657250:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 715 00000100:00100000:1.0:1790771165.657251:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533708544 00010000:00010000:3.0:1790771165.657261:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657274:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657281:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.657289:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.657299:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 904 00000100:00100000:1.0:1790771165.657310:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759533708544:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771165.657319:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.657329:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073a8e612/0xfa0c505d97f0afd6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e65 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657339:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657352:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657362:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.657363:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539716992:192.168.204.50@tcp:106: 00000004:00010000:2.0:1790771165.657382:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657390:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657402:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657414:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657420:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.657421:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a7d80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.657427:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.657431:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657436:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657445:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.657447:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.657450:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657454:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0afc8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657463:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657468:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657472:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657475:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.657478:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657518:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657525:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc10471100) 00010000:00010000:2.0:1790771165.657527:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.657529:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657534:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0afcf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657552:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0afc1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e0a expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657563:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e0a expref: 96 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.657568:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:2.0:1790771165.657571:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.657573:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03800, rc 0) 00000100:00100000:2.0:1790771165.657598:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14580:x1877759533705600:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 454us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.657605:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5528 00000100:00100000:0.0:1790771165.658512:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.658543:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533706880 00000100:00100000:2.0:1790771165.658548:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533706880 00000100:00100000:2.0:1790771165.658575:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5529 00000100:00100000:2.0:1790771165.658583:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14517:x1877759533706880:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:2.0:1790771165.658591:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.658598:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0afe4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e34 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658629:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658639:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658648:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658663:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658672:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658690:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658737:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658744:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658749:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.658755:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00010000:00010000:2.0:1790771165.658762:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658767:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658771:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658774:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.658776:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658780:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658785:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771165.658786:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.658788:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658792:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0aff9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658799:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658804:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658809:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658812:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658816:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c72000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.658819:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658822:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658826:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.658828:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.658829:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658833:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0afeb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658838:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658841:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658846:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658851:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.658854:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658860:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658873:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x61bf1dfb (ffff8bfc310f1f00) 00010000:00010000:2.0:1790771165.658876:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.658879:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658886:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0aff2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658908:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0afe4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e34 expref: 97 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658919:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.658921:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.658925:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0afe4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e34 expref: 97 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.658934:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00000100:00100000:2.0:1790771165.658967:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14517:x1877759533706880:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 385us (454us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771165.658972:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5529 00000100:00100000:0.0:1790771165.659300:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.659334:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.659338:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710336 00000100:00100000:2.0:1790771165.659345:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710336 00000100:00100000:0.0:1790771165.659363:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.659368:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 103 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.659368:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533705984 00000100:00100000:1.0:1790771165.659369:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539716096:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771165.659376:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533705984 00010000:00010000:1.0:1790771165.659393:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.659394:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.659402:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0aac0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.659409:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1527 00000100:00100000:3.0:1790771165.659419:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710848 00000100:00100000:2.0:1790771165.659420:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:2396:x1877759533710336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00010000:1.0:1790771165.659421:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006464848 reply state 000000004ec12eb8 transno 4294969128 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.659425:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710848 00000100:00100000:0.0:1790771165.659437:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.659445:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659445:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.659454:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 104 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659456:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc22108000) 00000100:00100000:3.0:1790771165.659458:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533706240 00010000:00010000:1.0:1790771165.659465:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.659465:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533706240 00000100:00100000:1.0:1790771165.659469:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1790771165.659475:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 104 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.659476:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771165.659477:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000006464848 reply state 000000004ec12eb8 transno 4294969128 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.659532:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5530 00010000:00010000:1.0:1790771165.659543:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.659552:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14404:x1877759533705984:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:1.0:1790771165.659553:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc22108b00) 00010000:00010000:2.0:1790771165.659553:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0a2c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a60 expref: 104 pid: 13766 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659561:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.659565:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1790771165.659571:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.659574:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771165.659577:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659580:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659586:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.659586:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b007 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e1f expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659590:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.659596:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.659609:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659614:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659636:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659643:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659647:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659649:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.659663:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790771165.659664:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.659694:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.659699:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2396:x1877759533710336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 281us (397us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.659716:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.659717:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13997:x1877759533690752:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 70195us (70507us total) trans 4294969128 rc 0/0 00000100:00100000:2.0:1790771165.659718:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1527 00000100:00100000:0.0:1790771165.659737:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759533706496:12345-192.168.204.50@tcp:3:dd.0 Request processed in 27444us (27583us total) trans 0 rc 4194304/4194304 00000100:00100000:1.0:1790771165.659737:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 33 00000100:00100000:2.0:1790771165.659738:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710976 00000100:00100000:2.0:1790771165.659744:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710976 00010000:00010000:3.0:1790771165.659747:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.659752:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 368 00010000:00010000:3.0:1790771165.659763:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.659764:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x14:0x0] (4194304->8388607) req@ffff8bfb057b6a00 x1877759533706496/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771165.659779:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 716 00010000:00010000:3.0:1790771165.659786:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.659788:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b6a00 with x1877759533706496 ext(4194304->8388607) 00000100:00100000:2.0:1790771165.659794:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:2396:x1877759533710976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1790771165.659796:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb057b6a00 00010000:00010000:1.0:1790771165.659797:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771165.659807:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659810:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.659818:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfc000 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771165.659822:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659826:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ae2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34de0 expref: 99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659831:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659839:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:3.0:1790771165.659841:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659845:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.659847:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x42:0x0].0x0 (ffff8bfc3600fa00) 00010000:00010000:1.0:1790771165.659854:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790771165.659860:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659861:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.659876:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:2396:x1877759533710976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (401us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.659883:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b000 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x42:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.659883:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.659891:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 716 00010000:00010000:1.0:1790771165.659910:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.659914:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.659915:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771165.659926:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533711104 00000100:00100000:1.0:1790771165.659930:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533711104 00010000:00010000:2.0:1790771165.659936:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.659946:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.659961:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5531 00000100:00100000:1.0:1790771165.659969:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14282:x1877759533710848:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771165.659971:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.659977:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.659979:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5532 00010000:00010000:2.0:1790771165.659980:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.659985:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00010000:00010000:1.0:1790771165.659987:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b023 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34eab expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.659995:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14512:x1877759533706240:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771165.659997:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660010:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.660010:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.660017:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660024:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b02a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e2d expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660028:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.660029:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.660046:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660060:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660066:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771165.660073:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771165.660076:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660078:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660085:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660094:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660102:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0ad98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.660106:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660109:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660121:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660136:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660138:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660154:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660155:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.660156:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14203:x1877759533703680:12345-192.168.204.50@tcp:55:cp.0 Request processed in 28563us (28643us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790771165.660177:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5505 00010000:00010000:0.0:1790771165.660180:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.660180:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.660180:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:1.0:1790771165.660187:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1790771165.660189:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.660197:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5533 00010000:00010000:3.0:1790771165.660206:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.660210:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14597:x1877759533711104:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771165.660212:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b023 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eab expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660218:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660226:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.660235:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.660240:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b04d lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34eb2 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660241:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660241:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.660245:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eab expref: 102 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660249:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660267:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660275:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b00e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.660277:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771165.660285:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.660285:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0b054 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.660292:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.660292:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfca00, rc 0) 00010000:00010000:2.0:1790771165.660296:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0b054 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.660298:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.660298:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.660311:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660318:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0b054 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660322:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.660325:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14282:x1877759533710848:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 353us (930us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.660332:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.660346:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5531 00010000:00010000:3.0:1790771165.660350:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660354:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.660363:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.660366:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771165.660370:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1790771165.660371:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660373:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660386:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660392:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660393:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.660397:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b04d lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb2 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660399:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660415:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfc10471800) 00010000:00010000:0.0:1790771165.660421:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660422:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.660428:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660433:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0b054 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb2 expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660434:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.660437:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b015 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660440:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.660446:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.660455:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710720 00010000:00010000:2.0:1790771165.660458:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f1300) 00000100:00100000:1.0:1790771165.660461:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710720 00010000:00010000:0.0:1790771165.660466:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b038 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.660466:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.660471:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02a00, rc 0) 00010000:00010000:0.0:1790771165.660481:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660515:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.660520:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1394 00010000:00010000:0.0:1790771165.660527:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.660531:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14597:x1877759533711104:12345-192.168.204.50@tcp:101:ln.0 Request processed in 324us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.660535:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13208:x1877759533710720:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:3.0:1790771165.660537:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b007 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e1f expref: 99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660546:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.660552:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.660553:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5533 00010000:00010000:0.0:1790771165.660562:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660568:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e1f expref: 98 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660572:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771165.660579:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.660579:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6a:0x0].0x0 (ffff8bfc2900ad00) 00010000:00010000:0.0:1790771165.660582:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.660583:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.660588:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9200, rc 0) 00010000:00010000:0.0:1790771165.660591:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b03f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660616:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b02a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.660627:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:14404:x1877759533705984:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 1081us (1291us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.660629:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 98 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.660648:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:3.0:1790771165.660650:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5530 00010000:00010000:0.0:1790771165.660652:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.660656:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00000100:00100000:0.0:1790771165.660699:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14512:x1877759533706240:12345-192.168.204.50@tcp:101:rm.0 Request processed in 711us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.660704:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5532 00000100:00100000:2.0:1790771165.667973:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.668001:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.668016:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533711232 00000100:00100000:0.0:1790771165.668023:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533711232 00000100:00100000:2.0:1790771165.668040:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.668058:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533711872 00000100:00100000:3.0:1790771165.668058:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533711488 00000100:00100000:0.0:1790771165.668064:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533711872 00000100:00100000:3.0:1790771165.668066:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533711488 00000100:00100000:0.0:1790771165.668097:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5534 00000100:00100000:0.0:1790771165.668108:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14396:x1877759533711232:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:3.0:1790771165.668114:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5535 00010000:00010000:0.0:1790771165.668118:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.668124:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5536 00000100:00100000:3.0:1790771165.668126:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:14386:x1877759533711872:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771165.668129:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b05b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34eb9 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.668139:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:14430:x1877759533711488:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771165.668166:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b062 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.668175:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b062 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.668179:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.668184:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b062 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.668187:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.668195:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 98 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.668211:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.668213:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 98 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.668218:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.668226:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771165.668233:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 61 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.668239:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.668243:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 98 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.668249:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b05b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb9 expref: 128 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.668259:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 98 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.668263:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 61 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.668268:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b062 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb9 expref: 127 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.668281:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539717120:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.668306:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f1300) 00010000:00010000:0.0:1790771165.668310:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.668311:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 61 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.668313:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00030200, rc 0) 00000100:00100000:2.0:1790771165.668331:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539717248:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.668338:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.668344:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14396:x1877759533711232:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 238us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.668350:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5534 00010000:00010000:2.0:1790771165.668380:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 98 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.668389:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 98 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.668397:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562f480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539717376:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.668425:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.672569:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.672594:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.672610:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533713408 00000100:00100000:1.0:1790771165.672616:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533713408 00000100:00100000:0.0:1790771165.672627:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714048 00000100:00100000:0.0:1790771165.672634:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714048 00000100:00100000:1.0:1790771165.672651:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5537 00000100:00100000:1.0:1790771165.672660:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13265:x1877759533713408:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.672673:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.672693:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5538 00010000:00010000:1.0:1790771165.672705:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b077 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34edc expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.672710:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14351:x1877759533714048:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:2.0:1790771165.672726:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.672736:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0b07e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ee3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672751:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672763:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672769:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672779:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672785:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672789:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672795:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672804:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672813:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672825:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672830:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672836:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.672845:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.672852:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b0a1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672863:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b0a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672871:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b0a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672882:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672890:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672898:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672905:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672913:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672920:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.672923:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672929:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672929:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672946:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672951:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672952:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.672956:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672974:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771165.672975:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.672980:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.672987:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.672990:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.672996:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.673000:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673004:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673006:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b085 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673027:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673032:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673033:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673053:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673055:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673064:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.673067:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673068:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673083:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.673085:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673087:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673095:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb0321af00) 00010000:00010000:2.0:1790771165.673097:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673098:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.673103:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673123:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b08c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673124:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59d92b11 (ffff8bfc310f1f00) 00010000:00010000:2.0:1790771165.673131:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.673135:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673141:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b09a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673156:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b077 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34edc expref: 131 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673165:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.673168:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0b07e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ee3 expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673169:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.673176:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b077 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34edc expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.673186:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b0a1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ee3 expref: 130 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673187:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc000, rc 0) 00010000:00010000:2.0:1790771165.673196:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:2.0:1790771165.673199:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.673202:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00000100:00100000:1.0:1790771165.673222:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13265:x1877759533713408:12345-192.168.204.50@tcp:101:ls.0 Request processed in 563us (652us total) trans 4294969133 rc 301/301 00000100:00100000:2.0:1790771165.673228:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14351:x1877759533714048:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 523us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.673236:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5537 00000100:00100000:2.0:1790771165.673248:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5538 00000100:00100000:0.0:1790771165.673615:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.673639:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.673656:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709440 00000100:00100000:1.0:1790771165.673661:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709440 00000100:00100000:0.0:1790771165.673666:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.673706:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533712128 00000100:00100000:1.0:1790771165.673710:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709568 00000100:00100000:3.0:1790771165.673713:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533712128 00000100:00100000:1.0:1790771165.673716:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709568 00000100:00100000:2.0:1790771165.673717:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5539 00000100:00100000:2.0:1790771165.673728:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13737:x1877759533709440:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.673762:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5540 00000100:00100000:2.0:1790771165.673763:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1877759539716352:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771165.673774:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5541 00000100:00100000:3.0:1790771165.673779:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:14462:x1877759533712128:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771165.673782:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.673788:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:13890:x1877759533709568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.673798:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.673808:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b0af lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e88 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.673815:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2399:x1877759533701888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 39578us (39716us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771165.673816:0:13796:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime: 0 -> 1790771159 00010000:00010000:3.0:1790771165.673821:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.673834:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539716224:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.673840:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1522 00010000:00010000:3.0:1790771165.673852:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.673866:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673871:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.673872:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065bc4b23/0xfa0c505d97f0ae55 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e18 expref: 28 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.673884:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 5/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673909:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.673915:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065bc4b23/0xfa0c505d97f0ae55 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e18 expref: 28 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.673919:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.673923:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.673933:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391600, rc 0) 00010000:00010000:3.0:1790771165.673945:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 99 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.673953:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.673962:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.673964:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.673966:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539717504:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.673972:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533705856:12345-192.168.204.50@tcp:101:chown.0 Request processed in 39676us (39766us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.673977:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e81 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.673980:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.673982:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 900 00010000:00010000:2.0:1790771165.674016:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 100 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.674022:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b0af lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 65 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.674038:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 100 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.674046:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.674049:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 64 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.674050:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.674055:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72000, rc 0) 00010000:00010000:1.0:1790771165.674065:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.674065:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 100 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.674073:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.674079:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38800, rc 0) 00010000:00010000:3.0:1790771165.674080:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 100 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.674090:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:13737:x1877759533709440:12345-192.168.204.50@tcp:101:ls.0 Request processed in 364us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.674099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5539 00000100:00100000:1.0:1790771165.674118:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:13890:x1877759533709568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 332us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.674123:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539717632:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.674129:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5541 00000100:00100000:2.0:1790771165.674180:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f94300 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.677733:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.677757:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.677777:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.677790:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533712896 00000100:00100000:2.0:1790771165.677796:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533712896 00000100:00100000:0.0:1790771165.677800:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.677821:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533713664 00000100:00100000:1.0:1790771165.677828:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533713664 00000100:00100000:2.0:1790771165.677829:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533713152 00000100:00100000:0.0:1790771165.677834:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.677836:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533713152 00000100:00100000:3.0:1790771165.677846:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5542 00002000:00010000:1.0:1790771165.677859:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/25 (0->18446744073709551615) 00000100:00100000:3.0:1790771165.677860:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14220:x1877759533712896:12345-192.168.204.50@tcp:36:rm.0 00002000:00100000:1.0:1790771165.677868:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790e00 with x1877759533713664 ext(0->18446744073709551615) 00000100:00100000:0.0:1790771165.677874:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.677875:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5543 00002000:00010000:1.0:1790771165.677882:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790e00. 00000100:00100000:2.0:1790771165.677891:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14257:x1877759533713152:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:3.0:1790771165.677896:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1790771165.677904:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533713536 00000100:00100000:1.0:1790771165.677909:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533713536 00000100:00100000:0.0:1790771165.677914:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.677917:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ae8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x56:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e42 expref: 130 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.677926:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/18 (11504->18446744073709551615) 00002000:00100000:1.0:1790771165.677930:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793b80 with x1877759533713536 ext(11504->18446744073709551615) 00002000:00010000:1.0:1790771165.677936:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb06793b80. 00000100:00100000:0.0:1790771165.677945:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.677946:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f02056 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x56:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31ccb expref: 129 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.677951:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533713792 00000100:00100000:1.0:1790771165.677956:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533713792 00010000:00010000:3.0:1790771165.677965:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00002000:00010000:1.0:1790771165.677968:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/25 (0->18446744073709551615) 00010000:00010000:3.0:1790771165.677971:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1790771165.677972:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793100 with x1877759533713792 ext(0->18446744073709551615) 00010000:00010000:1.0:1790771165.677981:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 26 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.677989:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.677993:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 26 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.678005:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.678013:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.678016:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb06793100. 00000100:00100000:2.0:1790771165.678016:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14257:x1877759533713152:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 126us (254us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771165.678029:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714176 00000100:00100000:1.0:1790771165.678035:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714176 00000100:00100000:2.0:1790771165.678038:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5543 00000100:00100000:0.0:1790771165.678044:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.678051:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771165.678054:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (454656->458751) req@ffff8bfb06792300 x1877759533714176/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771165.678061:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710208 00000100:00100000:2.0:1790771165.678069:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710208 00000100:00100000:0.0:1790771165.678073:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1790771165.678080:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06792300 with x1877759533714176 ext(454656->458751) 00010000:00010000:3.0:1790771165.678082:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.678085:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06792300 00010000:00010000:3.0:1790771165.678096:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.678103:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714432 00000100:00100000:2.0:1790771165.678104:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714560 00000100:00100000:0.0:1790771165.678107:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.678110:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714432 00000100:00100000:2.0:1790771165.678111:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714560 00010000:00010000:3.0:1790771165.678115:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.678131:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (31645->18446744073709551615) 00002000:00100000:1.0:1790771165.678136:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793800 with x1877759533714432 ext(31645->18446744073709551615) 00000100:00100000:0.0:1790771165.678139:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.678142:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714688 00010000:00010000:1.0:1790771165.678146:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 26 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678147:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714688 00010000:00010000:1.0:1790771165.678164:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 26 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.678173:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.678174:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714816 00010000:00010000:3.0:1790771165.678176:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678179:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714816 00002000:00010000:1.0:1790771165.678185:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06793800. 00010000:00010000:3.0:1790771165.678193:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.678205:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.678205:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678209:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714944 00000100:00100000:1.0:1790771165.678214:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 82 00000100:00100000:2.0:1790771165.678215:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714944 00000100:00100000:1.0:1790771165.678233:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533713792:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:2.0:1790771165.678233:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715072 00000100:00100000:2.0:1790771165.678238:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715072 00000100:00100000:0.0:1790771165.678245:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.678258:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715200 00000100:00100000:2.0:1790771165.678261:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715200 00000100:00100000:0.0:1790771165.678264:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715456 00000100:00100000:0.0:1790771165.678272:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715456 00000100:00100000:2.0:1790771165.678274:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715328 00000100:00100000:2.0:1790771165.678278:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715328 00000100:00100000:2.0:1790771165.678306:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5544 00000100:00100000:0.0:1790771165.678316:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5545 00000100:00100000:2.0:1790771165.678318:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:14362:x1877759533710208:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771165.678331:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14358:x1877759533714560:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771165.678331:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.678343:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.678346:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e9d expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678354:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b0e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ef1 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678371:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 101 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678382:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 101 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678388:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678389:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.678395:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.678399:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73200, rc 0) 00010000:00010000:0.0:1790771165.678403:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771165.678413:0:13761:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10808 00010000:00010000:0.0:1790771165.678415:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678424:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14362:x1877759533710208:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 109us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.678430:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5544 00010000:00010000:0.0:1790771165.678434:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678441:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678448:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678454:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5546 00010000:00010000:3.0:1790771165.678460:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678465:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14281:x1877759533714688:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.678475:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678476:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.678508:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b103 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ef8 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678513:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678514:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678537:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678538:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678538:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678557:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678566:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678566:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678567:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678591:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678604:0:13761:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00200000:0.0:1790771165.678607:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2c:0x0]: returning size 19586 00010000:00010000:2.0:1790771165.678610:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00200000:0.0:1790771165.678611:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.678617:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678617:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.678624:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678635:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678647:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678648:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678652:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:3.0:1790771165.678657:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.678662:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678663:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678665:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678696:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678698:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678713:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678722:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678722:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:2.0:1790771165.678729:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790771165.678735:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 1/0,0 mode: --/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678736:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678738:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x56:0x0].0x0 (ffff8bfc310f2d00) 00010000:00010000:3.0:1790771165.678746:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771165.678751:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678755:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b0fc lrc: 0/0,0 mode: --/PW res: [0x200000402:0x56:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678756:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.678762:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b0d9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x56:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678764:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.678771:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.678775:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.678779:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.678782:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678796:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.678798:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678800:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 83 00010000:00010000:0.0:1790771165.678804:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.678810:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678812:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.678816:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533714432:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:0.0:1790771165.678830:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b0ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678831:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678849:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678853:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.678858:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678858:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678873:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678876:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678880:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.678886:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.678891:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678893:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678897:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b0cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678909:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.678914:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.678915:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000770d2573 reply state 000000000c7c612a transno 4294969134 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678922:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.678925:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678933:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771165.678935:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc10471800) 00010000:00010000:0.0:1790771165.678938:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.678940:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.678943:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771165.678944:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.678951:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b0f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.678976:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14220:x1877759533712896:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1120us (1243us total) trans 4294969134 rc 0/0 00010000:00010000:0.0:1790771165.678982:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b0e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 114 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.678986:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5542 00010000:00010000:0.0:1790771165.679002:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 113 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679008:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00000100:00100000:3.0:1790771165.679011:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5547 00010000:00010000:0.0:1790771165.679013:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.679017:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78000, rc 0) 00000100:00100000:3.0:1790771165.679021:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14437:x1877759533714816:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.679029:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.679037:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b11f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34eff expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.679047:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14358:x1877759533714560:12345-192.168.204.50@tcp:101:ln.0 Request processed in 719us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.679054:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5545 00010000:00010000:3.0:1790771165.679063:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679071:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.679077:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5548 00010000:00010000:3.0:1790771165.679078:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.679086:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:12252:x1877759533714944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.679092:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679095:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.679101:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679107:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f06 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679108:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679142:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679151:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679158:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679164:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679172:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679177:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679180:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679196:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679196:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.679230:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.679233:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.679236:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.679244:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679245:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679263:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679265:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679274:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679290:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679297:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679301:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.679303:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679308:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.679312:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.679316:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000004:00200000:0.0:1790771165.679318:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.679319:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.679324:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679330:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.679333:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679341:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679343:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679348:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679355:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679357:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679369:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679369:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.679375:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679379:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679382:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679387:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.679392:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679393:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfc10471200) 00010000:00010000:3.0:1790771165.679400:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.679404:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679405:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679416:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b12d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679421:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.679428:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.679432:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679436:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b13b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679451:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b11f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 115 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679452:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679469:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679473:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679475:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 114 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679509:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:0.0:1790771165.679512:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058af000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.679512:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.679517:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83800, rc 0) 00010000:00010000:0.0:1790771165.679518:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679525:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679534:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfc3607db00) 00010000:00010000:0.0:1790771165.679536:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.679539:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.679544:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14437:x1877759533714816:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 522us (1474us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.679550:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b149 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.679556:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5547 00000100:00100000:3.0:1790771165.679581:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5549 00010000:00010000:0.0:1790771165.679582:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b134 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f06 expref: 114 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.679596:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14432:x1877759533715072:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771165.679598:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f06 expref: 113 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679612:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.679613:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771165.679617:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790771165.679619:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af400, rc 0) 00010000:00010000:3.0:1790771165.679623:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b157 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f0d expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.679642:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12252:x1877759533714944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 558us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.679648:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5548 00010000:00010000:3.0:1790771165.679648:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679659:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679666:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.679670:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5550 00000100:00100000:0.0:1790771165.679700:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14008:x1877759533715200:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.679704:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679708:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.679711:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679718:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679720:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b16c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f14 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679750:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679754:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679757:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679772:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679775:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679786:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.679789:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.679794:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.679805:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679808:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679815:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679819:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679822:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679835:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679838:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679856:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679864:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.679868:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679876:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679888:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.679891:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.679893:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05338000/0xfa0c505d97f0b188 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679896:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679914:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05338000/0xfa0c505d97f0b188 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679914:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b15e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.679938:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05338000/0xfa0c505d97f0b188 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679941:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679953:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679957:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679961:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.679964:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.679967:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.679973:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.679976:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.679985:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05338000/0xfa0c505d97f0b188 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.679986:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc8b04d25 (ffff8bfc10471f00) 00010000:00010000:3.0:1790771165.679992:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.679996:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680000:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680002:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b165 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680020:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680025:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680030:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680034:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.680038:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b157 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f0d expref: 115 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680039:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680055:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680066:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f0d expref: 114 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680068:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.680074:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.680078:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680080:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:3.0:1790771165.680086:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.680089:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b17a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680090:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a03a00, rc 0) 00010000:00010000:0.0:1790771165.680104:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680109:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680114:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.680116:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14432:x1877759533715072:12345-192.168.204.50@tcp:101:rm.0 Request processed in 525us (1979us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.680126:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.680130:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5549 00010000:00010000:0.0:1790771165.680132:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680138:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680146:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbc0ca3a9 (ffff8bfc3607d900) 00010000:00010000:0.0:1790771165.680148:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.680151:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.680151:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5551 00010000:00010000:0.0:1790771165.680159:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b181 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.680165:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14441:x1877759533715456:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771165.680178:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.680189:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b18f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f1b expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680201:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size from disk: 10289152 -> 0 00010000:00010000:0.0:1790771165.680203:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b16c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f14 expref: 115 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680206:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.680213:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:3.0:1790771165.680215:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680216:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:0.0:1790771165.680222:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05338000/0xfa0c505d97f0b188 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f14 expref: 114 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680223:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks from disk: 3712 -> 0 00010000:00010000:3.0:1790771165.680234:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680235:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.680241:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790771165.680246:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05338000, rc 0) 00010000:00010000:3.0:1790771165.680249:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680257:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533713792:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 2028us (2425us total) trans 4294967584 rc 0/0 00000100:00100000:1.0:1790771165.680263:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 82 00010000:00010000:3.0:1790771165.680265:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680267:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/25 (0->18446744073709551615) 00002000:00100000:1.0:1790771165.680273:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793100 with x1877759533713792 ext(0->18446744073709551615) 00000100:00100000:0.0:1790771165.680277:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14008:x1877759533715200:12345-192.168.204.50@tcp:101:ls.0 Request processed in 576us (2104us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.680284:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.680285:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 27 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.680296:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5550 00010000:00010000:3.0:1790771165.680303:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.680311:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 27 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680318:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb06793100. 00000100:00100000:0.0:1790771165.680326:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5552 00000100:00100000:0.0:1790771165.680336:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14460:x1877759533715328:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.680336:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680343:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 370 00010000:00010000:3.0:1790771165.680352:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680353:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.680360:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533713664:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:3.0:1790771165.680364:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680365:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b1ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f22 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.680392:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.680402:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680404:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680426:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680426:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680443:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680445:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680454:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680469:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680473:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680474:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680503:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.680506:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680515:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680516:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680529:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 371 00010000:00010000:0.0:1790771165.680535:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680539:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:1.0:1790771165.680544:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533713536:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:3.0:1790771165.680545:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.680550:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680553:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680557:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b196 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680564:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680571:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680573:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680577:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680585:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680587:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.680593:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680595:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680604:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680605:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.680612:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680618:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.680622:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.680622:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680627:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680636:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b1b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680640:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc10471b00) 00010000:00010000:3.0:1790771165.680645:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.680647:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680649:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680655:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680657:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb size from disk: 18111 -> 11504 00010000:00010000:3.0:1790771165.680662:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b19d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680664:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00010000:00010000:0.0:1790771165.680672:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680672:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb atime from disk: 1790771161 -> 1752421453 00002000:00010000:1.0:1790771165.680694:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.680699:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb blocks from disk: 16 -> 16 00010000:00010000:0.0:1790771165.680700:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3ab200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.680705:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680711:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680719:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b18f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 115 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.680720:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc20109500) 00000100:00100000:1.0:1790771165.680723:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533713536:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 183us (2921us total) trans 4294967585 rc 0/0 00010000:00010000:0.0:1790771165.680727:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.680732:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680744:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 371 00010000:00010000:0.0:1790771165.680748:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b1b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680749:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/18 (11504->18446744073709551615) 00010000:00010000:3.0:1790771165.680754:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 114 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771165.680756:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793b80 with x1877759533713536 ext(11504->18446744073709551615) 00002000:00010000:1.0:1790771165.680766:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb06793b80. 00010000:00010000:3.0:1790771165.680771:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfb03188100) 00010000:00010000:3.0:1790771165.680775:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.680779:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104e00, rc 0) 00010000:00010000:0.0:1790771165.680784:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b1ab lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f22 expref: 114 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680789:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 372 00000100:00100000:1.0:1790771165.680801:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533714176:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771165.680802:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771165.680808:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14441:x1877759533715456:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 643us (2600us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.680809:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.680816:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b1ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f22 expref: 114 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.680824:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5551 00010000:00010000:0.0:1790771165.680827:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339400, rc 0) 00000100:00100000:0.0:1790771165.680850:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14460:x1877759533715328:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 517us (2605us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.680859:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5552 00010000:00010000:3.0:1790771165.680897:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680909:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680917:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533714176:12345-192.168.204.50@tcp:3:cat.0 Request processed in 117us (3050us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.680923:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.680927:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 372 00002000:00100000:1.0:1790771165.680938:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (454656->458751) req@ffff8bfb06792300 x1877759533714176/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790771165.680946:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06792300 with x1877759533714176 ext(454656->458751) 00010000:00010000:3.0:1790771165.680949:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.680950:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06792300 00010000:00010000:3.0:1790771165.680962:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680971:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680979:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.680984:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.680994:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681007:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.681011:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.681015:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681024:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b111 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681039:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681048:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681056:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681063:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.681068:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681076:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681087:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc10471800) 00010000:00010000:3.0:1790771165.681091:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.681095:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681153:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b118 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681183:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b103 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef8 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681202:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.681206:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.681211:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b103 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef8 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.681224:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73e00, rc 0) 00000100:00100000:3.0:1790771165.681260:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14281:x1877759533714688:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 2797us (3220us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.681269:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5546 00000100:00100000:3.0:1790771165.681435:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.681596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.681635:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.681672:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771165.681719:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb size from disk: 10485760 -> 0 00000100:00100000:3.0:1790771165.681719:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716096 00000100:00100000:3.0:1790771165.681725:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716096 00002000:00010000:0.0:1790771165.681726:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.681732:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb atime from disk: 1790771161 -> 1790771161 00002000:00010000:0.0:1790771165.681735:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771165.681738:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb blocks from disk: 1152 -> 0 00000100:00100000:3.0:1790771165.681763:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1395 00000100:00100000:3.0:1790771165.681774:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14402:x1877759533716096:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:0.0:1790771165.681779:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533713664:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 1421us (3996us total) trans 4294967581 rc 0/0 00000100:00100000:0.0:1790771165.681792:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 370 00002000:00010000:0.0:1790771165.681796:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/25 (0->18446744073709551615) 00002000:00100000:0.0:1790771165.681799:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790e00 with x1877759533713664 ext(0->18446744073709551615) 00002000:00010000:0.0:1790771165.681806:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790e00. 00000100:00100000:0.0:1790771165.681929:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716736 00000100:00100000:0.0:1790771165.681933:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716736 00000100:00100000:0.0:1790771165.681966:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716224 00000100:00100000:0.0:1790771165.681969:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716224 00000100:00100000:3.0:1790771165.681996:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14402:x1877759533716096:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 222us (400us total) trans 4294969135 rc 0/0 00000100:00100000:0.0:1790771165.681997:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 905 00000100:00100000:0.0:1790771165.682008:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759533716736:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1790771165.682013:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1395 00010000:00010000:0.0:1790771165.682018:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.682030:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039b8c285/0xfa0c505d97f0b1c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f45 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.682040:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 906 00002000:00010000:0.0:1790771165.682044:0:13782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:1.0:1790771165.682052:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533716224:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.682056:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=165s v=(0 0) 00010000:00010000:1.0:1790771165.682060:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.682062:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790771165.682069:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039b8c285/0xfa0c505d97f0b1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f45 expref: 24 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682071:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0b1c7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x24:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f30 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.682092:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039b8c285/0xfa0c505d97f0b1c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f45 expref: 25 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682095:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771165.682103:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771165.682113:0:8676:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0b1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f30 expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.682126:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3abc00, rc 0) 00010000:00010000:1.0:1790771165.682130:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f94bcc1e/0xfa0c505d97f0b1c7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f30 expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682144:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38200, rc 0) 00000100:00100000:0.0:1790771165.682152:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533716736:12345-192.168.204.50@tcp:101:cat.0 Request processed in 145us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.682159:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 905 00000100:00100000:1.0:1790771165.682176:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533716224:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 126us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.682183:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 906 00000100:00100000:0.0:1790771165.682213:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13208:x1877759533710720:12345-192.168.204.50@tcp:37:ls.0 Request processed in 21682us (22850us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.682222:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1394 00000100:00100000:1.0:1790771165.682228:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715712 00000100:00100000:1.0:1790771165.682233:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715712 00000100:00100000:1.0:1790771165.682268:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5553 00000100:00100000:1.0:1790771165.682278:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14465:x1877759533715712:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.682313:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682331:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 108 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682340:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682369:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 108 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.682384:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 108 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.682398:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539717760:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.682456:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1010c0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1790771165.682558:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4232645 -> 31645 00002000:00010000:2.0:1790771165.682562:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.682564:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771163 -> 1752421453 00002000:00010000:2.0:1790771165.682565:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.682567:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8272 -> 64 00000100:00100000:2.0:1790771165.682593:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533714432:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 3783us (4682us total) trans 4294967582 rc 0/0 00000100:00100000:2.0:1790771165.682599:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 83 00002000:00010000:2.0:1790771165.682602:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (31645->18446744073709551615) 00002000:00100000:2.0:1790771165.682605:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06793800 with x1877759533714432 ext(31645->18446744073709551615) 00010000:00010000:2.0:1790771165.682611:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 27 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.682622:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 27 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.682638:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06793800. 00000100:00100000:0.0:1790771165.747710:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.747734:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539716864:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.747737:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539716480:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.747739:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.747748:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.747770:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.747781:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0aec5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e57 expref: 26 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.747782:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.747801:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716864 00010000:00010000:1.0:1790771165.747806:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0aec5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e57 expref: 26 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.747809:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716864 00000100:00100000:0.0:1790771165.747820:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.747822:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597400, rc 0) 00000100:00100000:0.0:1790771165.747839:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.747854:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 64 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.747876:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533707904:12345-192.168.204.50@tcp:101:cp.0 Request processed in 107058us (107388us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.747876:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533718272 00000100:00100000:1.0:1790771165.747885:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 902 00000100:00100000:2.0:1790771165.747892:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716992 00000100:00100000:0.0:1790771165.747898:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.747899:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716992 00000100:00100000:3.0:1790771165.747937:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533718272 00000100:00100000:1.0:1790771165.747946:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1528 00000100:00100000:2.0:1790771165.747957:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 717 00000100:00100000:1.0:1790771165.747958:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:2396:x1877759533716864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.747973:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2399:x1877759533716992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.747975:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.747985:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 64 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.747989:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.747994:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748006:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 64 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748014:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0af0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e73 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.748025:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0ad21 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d93 expref: 64 pid: 13774 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748030:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.748040:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771165.748045:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771165.748045:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.748052:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748060:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748066:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.748074:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2399:x1877759533716992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (328us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.748077:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.748083:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 717 00010000:00010000:1.0:1790771165.748090:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.748113:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.748119:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748130:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.748139:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:2396:x1877759533716864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 183us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.748141:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.748150:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1528 00000100:00100000:0.0:1790771165.748189:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.748212:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533718656 00000100:00100000:1.0:1790771165.748215:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533718656 00000100:00100000:1.0:1790771165.748240:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 907 00000100:00100000:1.0:1790771165.748247:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533718656:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:2.0:1790771165.748259:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748266:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748272:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748276:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.748280:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748286:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748295:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771165.748296:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533718656:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 48us (160us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.748301:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771165.748306:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 907 00010000:00010000:2.0:1790771165.748307:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748317:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748325:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.748337:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533717248 00000100:00100000:1.0:1790771165.748342:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533717248 00000100:00100000:0.0:1790771165.748343:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.748353:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748361:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0aeef lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.748365:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533717504 00000100:00100000:1.0:1790771165.748369:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533717504 00000100:00100000:1.0:1790771165.748391:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533717760 00000100:00100000:1.0:1790771165.748395:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533717760 00000100:00100000:3.0:1790771165.748395:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533718016 00000100:00100000:3.0:1790771165.748403:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533718016 00000100:00100000:2.0:1790771165.748406:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14541:x1877759533708800:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 101130us (101277us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771165.748414:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5517 00000100:00100000:1.0:1790771165.748417:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709952 00000100:00100000:1.0:1790771165.748421:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709952 00000100:00100000:2.0:1790771165.748435:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533709696 00000100:00100000:2.0:1790771165.748440:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533709696 00000100:00100000:1.0:1790771165.748443:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533719808 00000100:00100000:1.0:1790771165.748448:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533719808 00000100:00100000:2.0:1790771165.748463:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533710592 00000100:00100000:2.0:1790771165.748467:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533710592 00000100:00100000:1.0:1790771165.748475:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5554 00000100:00100000:1.0:1790771165.748519:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14643:x1877759533718272:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:2.0:1790771165.748533:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5555 00000100:00100000:0.0:1790771165.748534:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748534:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.748549:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14507:x1877759533717248:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771165.748556:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0b1d5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f4c expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748562:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.748578:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.748593:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0a2f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a75 expref: 131 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748601:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.748606:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:2.0:1790771165.748610:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.748618:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720192 00000100:00100000:3.0:1790771165.748625:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720192 00000100:00100000:0.0:1790771165.748626:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.748627:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.748641:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748649:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.748650:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720320 00000100:00100000:3.0:1790771165.748657:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720320 00010000:00010000:2.0:1790771165.748660:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748672:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.748694:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720576 00000100:00100000:3.0:1790771165.748700:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720576 00010000:00010000:1.0:1790771165.748705:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0b1e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.748717:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748720:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0b1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.748725:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533711616 00000100:00100000:3.0:1790771165.748733:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533711616 00000100:00100000:0.0:1790771165.748736:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748736:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0b1e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.748752:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.748758:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721216 00000100:00100000:0.0:1790771165.748763:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.748781:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.748802:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.748817:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721216 00000100:00100000:0.0:1790771165.748831:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748844:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0b1d5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f4c expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.748865:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0b1e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f4c expref: 131 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.748873:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533712256 00000100:00100000:0.0:1790771165.748875:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.748879:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00000100:00100000:3.0:1790771165.748879:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533712256 00010000:00010000:1.0:1790771165.748885:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.748889:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39600, rc 0) 00000100:00100000:3.0:1790771165.748896:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721984 00000100:00100000:3.0:1790771165.748899:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721984 00000100:00100000:0.0:1790771165.748911:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.748916:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533712640 00000100:00100000:3.0:1790771165.748920:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533712640 00000100:00100000:1.0:1790771165.748923:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14643:x1877759533718272:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 437us (1302us total) trans 4294969136 rc 0/0 00000100:00100000:1.0:1790771165.748934:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5554 00010000:00010000:2.0:1790771165.748951:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.748954:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5556 00000100:00100000:1.0:1790771165.748965:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5557 00010000:00010000:2.0:1790771165.748966:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.748967:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14367:x1877759533717504:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:1.0:1790771165.748980:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14479:x1877759533717760:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771165.748983:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.749016:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749021:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749024:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749035:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749041:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749042:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749057:0:13771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.749065:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749072:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0af7b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e6c expref: 70 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749073:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749087:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.749090:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749099:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e6c expref: 69 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749106:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771165.749109:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.749112:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ba00, rc 0) 00000100:00100000:1.0:1790771165.749113:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721600 00000100:00100000:1.0:1790771165.749118:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721600 00000100:00100000:2.0:1790771165.749141:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:13958:x1877759533708928:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 93386us (93571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.749150:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721728 00000100:00100000:2.0:1790771165.749153:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5525 00000100:00100000:1.0:1790771165.749154:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721728 00000100:00100000:0.0:1790771165.749157:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.749186:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533718528 00000100:00100000:2.0:1790771165.749187:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533714304 00000100:00100000:1.0:1790771165.749189:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533724928 00000100:00100000:3.0:1790771165.749192:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533718528 00000100:00100000:2.0:1790771165.749193:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533714304 00000100:00100000:1.0:1790771165.749194:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533724928 00010000:00010000:1.0:1790771165.749221:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 109 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.749228:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533724800 00000100:00100000:0.0:1790771165.749233:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.749233:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720704 00000100:00100000:2.0:1790771165.749234:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533724800 00000100:00100000:3.0:1790771165.749240:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720704 00000100:00100000:1.0:1790771165.749244:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533725056 00000100:00100000:1.0:1790771165.749248:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533725056 00000100:00100000:2.0:1790771165.749266:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5558 00000100:00100000:0.0:1790771165.749274:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.749278:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:11972:x1877759533709952:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.749285:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1529 00010000:00010000:2.0:1790771165.749289:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.749295:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2396:x1877759533724928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.749302:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0b1ff lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e96 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749303:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.749310:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.749312:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533722112 00010000:00010000:1.0:1790771165.749313:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 109 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749319:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533722112 00010000:00010000:1.0:1790771165.749333:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 110 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749342:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533725312 00000100:00100000:0.0:1790771165.749343:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.749347:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533725312 00010000:00010000:1.0:1790771165.749349:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:1.0:1790771165.749354:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749360:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749362:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533725568 00010000:00010000:2.0:1790771165.749365:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749368:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533725568 00010000:00010000:1.0:1790771165.749371:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749378:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.749386:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1396 00010000:00010000:1.0:1790771165.749397:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.749400:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749402:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14395:x1877759533718528:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:0.0:1790771165.749412:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.749420:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749421:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533724928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 127us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.749436:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1529 00010000:00010000:2.0:1790771165.749447:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749450:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533725824 00000100:00100000:1.0:1790771165.749456:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533725824 00010000:00010000:2.0:1790771165.749458:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749466:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749477:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726336 00000100:00100000:1.0:1790771165.749481:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726336 00000100:00100000:0.0:1790771165.749515:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749523:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749540:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533725696 00000100:00100000:1.0:1790771165.749543:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533725696 00000100:00100000:0.0:1790771165.749557:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749561:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 74 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749565:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749576:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749577:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726208 00000100:00100000:3.0:1790771165.749577:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14395:x1877759533718528:12345-192.168.204.50@tcp:35:rm.0 Request processed in 176us (1550us total) trans 4294968555 rc 0/0 00000100:00100000:1.0:1790771165.749583:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726208 00000100:00100000:0.0:1790771165.749591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.749597:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 112 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749598:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749598:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1396 00000100:00100000:1.0:1790771165.749631:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726720 00000100:00100000:1.0:1790771165.749634:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726720 00000004:00200000:2.0:1790771165.749639:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.749644:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771165.749646:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726976 00000100:00100000:3.0:1790771165.749652:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726976 00010000:00010000:1.0:1790771165.749654:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 113 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749660:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771165.749662:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749698:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.749702:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749712:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749715:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1530 00000100:00100000:0.0:1790771165.749720:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533727104 00010000:00010000:2.0:1790771165.749724:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749726:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533727104 00000100:00100000:1.0:1790771165.749733:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759533726336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.749735:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.749738:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1397 00010000:00010000:2.0:1790771165.749742:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749748:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749749:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.749756:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14282:x1877759533720704:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:0.0:1790771165.749760:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1398 00010000:00010000:1.0:1790771165.749760:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 113 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749762:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.749769:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.749775:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.749776:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14404:x1877759533722112:12345-192.168.204.50@tcp:33:setfattr.0 00010000:00010000:1.0:1790771165.749780:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 113 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749793:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b206 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.749798:0:13778:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.749801:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000004:00200000:3.0:1790771165.749802:0:13778:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.749804:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749808:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.749813:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00010000:00010000:2.0:1790771165.749813:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749819:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749827:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749829:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.749835:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.749839:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.749843:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14282:x1877759533720704:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 93us (1169us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.749856:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749857:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759533726336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 128us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.749861:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1397 00000100:00100000:0.0:1790771165.749870:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14404:x1877759533722112:12345-192.168.204.50@tcp:33:setfattr.0 Request processed in 93us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.749877:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1530 00010000:00010000:2.0:1790771165.749883:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf7a5b27a (ffff8bfc310f1200) 00000100:00100000:3.0:1790771165.749883:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1399 00010000:00010000:2.0:1790771165.749891:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.749896:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1398 00000100:00100000:3.0:1790771165.749897:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:13265:x1877759533725312:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771165.749898:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749903:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1531 00010000:00010000:2.0:1790771165.749915:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b20d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.749919:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533725696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.749925:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1400 00010000:00010000:1.0:1790771165.749935:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.749941:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13737:x1877759533725568:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771165.749942:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 74 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749961:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 75 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749965:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0b1ff lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 75 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.749978:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:3.0:1790771165.749986:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:13265:x1877759533725312:12345-192.168.204.50@tcp:35:ls.0 Request processed in 89us (832us total) trans 4294969138 rc 0/0 00010000:00010000:1.0:1790771165.749988:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.749989:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.750003:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1399 00010000:00010000:1.0:1790771165.750009:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750015:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771165.750016:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.750021:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:3.0:1790771165.750026:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1401 00010000:00010000:2.0:1790771165.750028:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597000, rc 0) 00000100:00100000:3.0:1790771165.750035:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13986:x1877759533726976:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1790771165.750043:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533725696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 125us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750054:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1531 00000100:00100000:2.0:1790771165.750058:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:11972:x1877759533709952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 781us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.750066:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5558 00000100:00100000:1.0:1790771165.750080:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1532 00000100:00100000:2.0:1790771165.750084:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726464 00000100:00100000:2.0:1790771165.750088:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726464 00000100:00100000:1.0:1790771165.750093:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533726208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.750105:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.750108:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726592 00010000:00010000:1.0:1790771165.750112:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 111 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.750113:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726592 00010000:00010000:1.0:1790771165.750131:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 111 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.750132:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720448 00000100:00100000:2.0:1790771165.750136:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720448 00000100:00100000:3.0:1790771165.750150:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:13986:x1877759533726976:12345-192.168.204.50@tcp:35:cat.0 Request processed in 115us (564us total) trans 4294969139 rc 0/0 00010000:00010000:1.0:1790771165.750151:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:2.0:1790771165.750158:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5559 00010000:00010000:1.0:1790771165.750162:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.750163:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1401 00000100:00100000:2.0:1790771165.750170:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14428:x1877759533709696:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771165.750183:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.750186:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1402 00010000:00010000:1.0:1790771165.750190:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750195:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0b21b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34e8f expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.750198:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13890:x1877759533727104:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771165.750212:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750224:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750232:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750233:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750253:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750262:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.750262:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750279:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750284:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750290:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750294:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2397:x1877759533726208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750305:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1532 00000100:00100000:1.0:1790771165.750325:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1533 00010000:00010000:2.0:1790771165.750326:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750337:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533726720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.750340:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750346:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.750356:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 111 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750361:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750373:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 111 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.750384:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.750387:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000004:00200000:2.0:1790771165.750388:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.750396:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.750401:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750406:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750410:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750425:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750425:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750445:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750450:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.750453:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750454:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.750460:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750468:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.750472:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.750474:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533726720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (916us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.750476:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750506:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b222 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750521:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1533 00010000:00010000:2.0:1790771165.750530:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750536:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750541:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750545:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 718 00010000:00010000:2.0:1790771165.750549:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.750552:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750559:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2396:x1877759533721600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.750560:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750574:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc310f1f00) 00010000:00010000:1.0:1790771165.750577:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.750577:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.750581:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750586:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b229 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750595:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eab expref: 112 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750606:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0b21b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e8f expref: 75 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750610:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771165.750617:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.750626:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e8f expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750639:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533721600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 80us (1853us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.750651:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:1.0:1790771165.750654:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 718 00010000:00010000:2.0:1790771165.750657:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.750662:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597800, rc 0) 00000100:00100000:0.0:1790771165.750665:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533719936 00000100:00100000:0.0:1790771165.750669:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533719936 00000100:00100000:1.0:1790771165.750687:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 719 00000100:00100000:2.0:1790771165.750697:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14428:x1877759533709696:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 530us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750702:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533721728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.750709:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5559 00000100:00100000:0.0:1790771165.750716:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533718784 00010000:00010000:1.0:1790771165.750716:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.750722:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533718784 00010000:00010000:1.0:1790771165.750731:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0afdd lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e0a expref: 111 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.750731:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5560 00000100:00100000:2.0:1790771165.750746:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14536:x1877759533719808:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.750747:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00000100:00100000:0.0:1790771165.750751:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 908 00010000:00010000:1.0:1790771165.750756:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.750766:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2399:x1877759533719936:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771165.750774:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.750775:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2396:x1877759533721728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750783:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 719 00010000:00010000:2.0:1790771165.750783:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.750787:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bda7fc9/0xfa0c505d97f0b23e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f6f expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750803:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 720 00010000:00010000:2.0:1790771165.750806:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 73 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750816:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:2396:x1877759533725056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.750830:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.750832:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 109 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.750839:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 5/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750842:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b062 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb9 expref: 135 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.750855:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f1300) 00010000:00010000:1.0:1790771165.750858:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.750867:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539717888:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.750873:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 109 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750874:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533725056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 60us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750890:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 720 00010000:00010000:2.0:1790771165.750901:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 109 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750908:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 721 00000100:00100000:1.0:1790771165.750919:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533725824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.750932:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.750933:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.750938:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539718016:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.750948:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b0a1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ee3 expref: 133 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.750953:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.750965:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:1.0:1790771165.750968:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.750983:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 74 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.750985:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2397:x1877759533725824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.750998:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 721 00010000:00010000:2.0:1790771165.751010:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 74 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.751025:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562d880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539718144:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.751039:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 909 00000100:00100000:3.0:1790771165.751040:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.751050:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.751052:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2399:x1877759533718784:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771165.751060:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.751070:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042f7c623/0xfa0c505d97f0b245 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f53 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.751091:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533719552 00000100:00100000:1.0:1790771165.751095:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539718272:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.751096:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533719552 00000100:00100000:0.0:1790771165.751125:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533712512 00000100:00100000:0.0:1790771165.751128:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533712512 00000100:00100000:1.0:1790771165.751139:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63000 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.751148:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5561 00000100:00100000:0.0:1790771165.751157:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14341:x1877759533710592:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.751165:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1790771165.751169:0:13781:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime: 0 -> 1790771157 00010000:00010000:0.0:1790771165.751176:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ea4 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751182:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539716992:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.751204:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 111 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751211:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073a8e612/0xfa0c505d97f0afd6 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e65 expref: 31 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751227:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073a8e612/0xfa0c505d97f0afd6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e65 expref: 31 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751236:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfcc00, rc 0) 00010000:00010000:0.0:1790771165.751252:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 111 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751256:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2396:x1877759533708544:12345-192.168.204.50@tcp:101:ln.0 Request processed in 93947us (94144us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.751259:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.751272:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 904 00010000:00010000:0.0:1790771165.751276:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.751281:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.751285:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339e00, rc 0) 00010000:00010000:1.0:1790771165.751301:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ae32 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dee expref: 111 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.751316:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14341:x1877759533710592:12345-192.168.204.50@tcp:101:chown.0 Request processed in 157us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.751323:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539717120:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.751330:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5561 00010000:00010000:1.0:1790771165.751344:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.751351:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533719040 00010000:00010000:1.0:1790771165.751352:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.751358:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533719040 00000100:00100000:3.0:1790771165.751359:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.751367:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.751383:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533726080 00000100:00100000:0.0:1790771165.751386:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533726080 00000100:00100000:0.0:1790771165.751405:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5562 00000100:00100000:0.0:1790771165.751416:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14491:x1877759533718016:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.751428:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751434:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751440:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751445:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfce00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.751447:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.751455:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751455:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.751456:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0a9bd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c97 expref: 111 pid: 6494 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751480:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00000100:00100000:2.0:1790771165.751503:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d67800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539717504:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.751504:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 75 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751508:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.751514:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.751519:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.751520:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0a5db lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b40 expref: 110 pid: 13773 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751529:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b069 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.751553:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d65180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539717632:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.751560:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 75 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.751570:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 75 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.751572:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751579:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14430:x1877759533711488:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 83442us (83574us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771165.751593:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539718400:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.751596:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751598:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5536 00010000:00010000:2.0:1790771165.751609:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751623:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5563 00000100:00100000:1.0:1790771165.751631:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14203:x1877759533720192:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:0.0:1790771165.751636:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87900 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.751641:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.751659:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751667:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751686:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.751700:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.751747:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716480 00000100:00100000:3.0:1790771165.751747:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.751753:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716480 00000100:00100000:1.0:1790771165.751756:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533727488 00000100:00100000:1.0:1790771165.751761:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533727488 00000100:00100000:1.0:1790771165.751790:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533719296 00000100:00100000:1.0:1790771165.751794:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533719296 00000100:00100000:3.0:1790771165.751795:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.751819:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533716608 00000100:00100000:1.0:1790771165.751822:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533716608 00000100:00100000:0.0:1790771165.751833:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5564 00000100:00100000:0.0:1790771165.751845:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:13894:x1877759533720320:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:1.0:1790771165.751851:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5565 00000100:00100000:3.0:1790771165.751855:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771165.751860:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070768336 reply state 000000004241494b transno 4294968556 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.751864:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14580:x1877759533720576:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:1.0:1790771165.751877:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.751882:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.751888:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.751889:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b261 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f84 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.751895:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771165.751904:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.751905:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b268 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f76 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.751910:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.751931:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.751940:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.751946:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751946:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 2/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.751949:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14462:x1877759533712128:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 78173us (78306us total) trans 4294968556 rc 0/0 00010000:00010000:1.0:1790771165.751969:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 4/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.751973:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.751974:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5540 00010000:00010000:0.0:1790771165.751993:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.751993:0:7771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752002:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533720960 00000100:00100000:2.0:1790771165.752009:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533720960 00010000:00010000:1.0:1790771165.752015:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752023:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752031:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752038:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752039:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533715840 00000100:00100000:2.0:1790771165.752044:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533715840 00000100:00100000:2.0:1790771165.752067:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5566 00000004:00010000:1.0:1790771165.752071:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000733c2932 reply state 000000000c478824 transno 4294969140 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752078:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752083:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14444:x1877759533711616:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771165.752085:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.752089:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.752100:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752100:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.752101:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771165.752108:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771165.752112:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.752112:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ec0 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752114:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752138:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14203:x1877759533720192:12345-192.168.204.50@tcp:36:cp.0 Request processed in 507us (3610us total) trans 4294969140 rc 0/0 00000100:00100000:3.0:1790771165.752143:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.752146:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 109 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.752148:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x48:0x0]: returning size 5 00000100:00100000:1.0:1790771165.752155:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5563 00000004:00200000:0.0:1790771165.752156:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.752168:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 109 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.752170:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752174:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533729792 00000100:00100000:1.0:1790771165.752180:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533729792 00010000:00010000:2.0:1790771165.752196:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771165.752199:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5567 00010000:00010000:2.0:1790771165.752203:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.752206:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752207:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73c00, rc 0) 00000100:00100000:1.0:1790771165.752213:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14337:x1877759533721216:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:0.0:1790771165.752220:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752227:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752231:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752233:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14444:x1877759533711616:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 158us (3516us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.752235:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.752247:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.752249:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5566 00010000:00010000:0.0:1790771165.752252:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752253:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5000/0xfa0c505d97f091ad lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e343f3 expref: 109 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752271:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5568 00010000:00010000:0.0:1790771165.752274:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752277:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc3da48e00) 00000100:00100000:2.0:1790771165.752282:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14551:x1877759533712256:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:1.0:1790771165.752290:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.752296:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.752297:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.752299:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:0.0:1790771165.752304:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.752309:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752310:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0b292 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ec7 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752326:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b276 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752337:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752344:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752344:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752369:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14337:x1877759533721216:12345-192.168.204.50@tcp:36:ln.0 Request processed in 157us (3632us total) trans 0 rc -17/-17 00010000:00010000:0.0:1790771165.752370:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752370:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.752373:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.752390:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5567 00010000:00010000:2.0:1790771165.752394:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752396:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aea00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.752405:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752409:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733120 00010000:00010000:2.0:1790771165.752411:0:12030:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752413:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733120 00010000:00010000:0.0:1790771165.752422:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.752426:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752438:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5569 00010000:00010000:0.0:1790771165.752445:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0xf7a5b27a (ffff8bfc3607d100) 00000100:00100000:3.0:1790771165.752446:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.752451:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.752453:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14597:x1877759533721984:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771165.752457:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752461:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.752463:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b27d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752474:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0b2a0 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fa7 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752520:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752522:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b268 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f76 expref: 80 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752533:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752544:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f76 expref: 79 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752544:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752563:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x48:0x0].0x0 (ffff8bfb0321e300) 00010000:00010000:0.0:1790771165.752566:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.752569:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af000, rc 0) 00000004:00200000:1.0:1790771165.752574:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.752579:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1790771165.752590:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:13894:x1877759533720320:12345-192.168.204.50@tcp:101:rm.0 Request processed in 750us (3963us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.752599:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0b2a0 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 80 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.752604:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5564 00010000:00010000:1.0:1790771165.752621:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 78 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.752625:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533731840 00010000:00010000:1.0:1790771165.752631:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000100:00100000:0.0:1790771165.752632:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533731840 00010000:00010000:1.0:1790771165.752637:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.752640:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00010000:00010000:2.0:1790771165.752647:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0aefd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd2 expref: 78 pid: 13765 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.752658:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5570 00000100:00100000:1.0:1790771165.752663:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14597:x1877759533721984:12345-192.168.204.50@tcp:101:ln.0 Request processed in 214us (3830us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.752690:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539717248:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.752691:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5569 00000100:00100000:3.0:1790771165.752691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.752692:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14452:x1877759533712640:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.752707:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.752718:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ed5 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752718:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5571 00000100:00100000:1.0:1790771165.752731:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14354:x1877759533714304:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.752738:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 108 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752739:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.752739:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0ae4e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34df5 expref: 108 pid: 13768 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752749:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34eea expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.752754:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.752767:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 107 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.752773:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562f480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539717376:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.752781:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752789:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.752792:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.752795:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031000, rc 0) 00010000:00010000:1.0:1790771165.752798:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752806:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.752808:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.752810:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752812:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00000100:00100000:0.0:1790771165.752820:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14452:x1877759533712640:12345-192.168.204.50@tcp:101:chown.0 Request processed in 150us (3962us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.752824:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.752831:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5570 00000100:00100000:1.0:1790771165.752836:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14354:x1877759533714304:12345-192.168.204.50@tcp:101:chown.0 Request processed in 107us (3857us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.752839:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752846:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5571 00000100:00100000:0.0:1790771165.752857:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5572 00000100:00100000:1.0:1790771165.752865:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5573 00000100:00100000:0.0:1790771165.752871:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14396:x1877759533724800:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:1.0:1790771165.752877:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14592:x1877759533726464:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771165.752887:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.752888:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.752894:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0b2bc lrc: 2/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35048 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752901:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b2c3 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35033 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752910:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752920:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752925:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 4/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752933:0:13764:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 4/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752940:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b2d1 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.752941:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.752959:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.752967:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.752971:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b2d1 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.752972:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533732352 00000100:00100000:1.0:1790771165.752977:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533732352 00010000:00010000:2.0:1790771165.752992:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.752993:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.752999:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771165.753008:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.753009:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 722 00010000:00010000:2.0:1790771165.753021:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.753023:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533732352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.753024:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b2c3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35033 expref: 79 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.753043:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.753046:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.753048:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753053:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b2d1 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35033 expref: 78 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.753057:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753060:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b150 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f06 expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753072:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:0.0:1790771165.753076:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.753079:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00010000:00010000:1.0:1790771165.753082:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:1.0:1790771165.753086:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.753096:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771165.753101:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771165.753102:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14396:x1877759533724800:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 234us (4079us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.753104:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.753109:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759533732352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.753119:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5572 00000100:00100000:1.0:1790771165.753127:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 722 00010000:00010000:2.0:1790771165.753128:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.753134:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.753139:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.753143:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533732608 00000100:00100000:0.0:1790771165.753147:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533732608 00000100:00100000:1.0:1790771165.753163:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5574 00000100:00100000:3.0:1790771165.753170:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.753176:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14257:x1877759533726592:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1790771165.753179:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.753183:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5575 00010000:00010000:1.0:1790771165.753187:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.753193:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0b070 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.753199:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14383:x1877759533720448:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1790771165.753202:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b2d8 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3504f expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753215:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.753226:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f7d expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.753237:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533729920 00010000:00010000:1.0:1790771165.753238:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.753243:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533729920 00010000:00010000:0.0:1790771165.753244:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 108 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753252:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753260:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753263:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.753272:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533732992 00000100:00100000:2.0:1790771165.753276:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533732992 00010000:00010000:0.0:1790771165.753284:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.753288:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.753291:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753293:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79e00, rc 0) 00010000:00010000:1.0:1790771165.753302:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.753304:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1403 00000100:00100000:3.0:1790771165.753307:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.753317:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.753325:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14383:x1877759533720448:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 124us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.753326:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13208:x1877759533729920:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:0.0:1790771165.753338:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5575 00000100:00100000:0.0:1790771165.753357:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5576 00010000:00010000:1.0:1790771165.753363:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.753369:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14509:x1877759533719552:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:1.0:1790771165.753374:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753379:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.753382:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753389:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.753391:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b2fb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f68 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.753401:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x11:0x0]: returning size 0 00000004:00200000:1.0:1790771165.753405:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.753416:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753416:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.753427:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753434:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753439:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753445:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753450:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753455:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b302 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753459:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.753464:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753469:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b302 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753471:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753482:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.753520:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb0321ae00) 00010000:00010000:0.0:1790771165.753521:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b302 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753526:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.753530:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.753534:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 38336 00010000:00010000:1.0:1790771165.753536:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b2e6 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753546:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753550:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753554:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753559:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.753562:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753567:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753571:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733376 00000100:00100000:3.0:1790771165.753577:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733376 00010000:00010000:1.0:1790771165.753579:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0xbc0ca3a9 (ffff8bfb0321a800) 00010000:00010000:1.0:1790771165.753583:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.753585:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 2/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753589:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b2ed lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753591:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b2fb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f68 expref: 82 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753611:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b302 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f68 expref: 81 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753616:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b2d8 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3504f expref: 135 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753624:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:0.0:1790771165.753629:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.753632:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00000100:00100000:3.0:1790771165.753635:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1404 00010000:00010000:1.0:1790771165.753639:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373a00/0xfa0c505d97f0b2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3504f expref: 134 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753647:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x11:0x0].0x0 (ffff8bfc4205d400) 00000100:00100000:3.0:1790771165.753647:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14326:x1877759533732992:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:1.0:1790771165.753654:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771165.753657:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373a00, rc 0) 00000100:00100000:0.0:1790771165.753662:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14509:x1877759533719552:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 296us (2711us total) trans 4294968557 rc 0/0 00000100:00100000:0.0:1790771165.753668:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5576 00000100:00100000:1.0:1790771165.753696:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14257:x1877759533726592:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 522us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.753697:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733632 00000100:00100000:0.0:1790771165.753703:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733632 00000100:00100000:1.0:1790771165.753704:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5574 00000100:00100000:1.0:1790771165.753724:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5577 00000100:00100000:0.0:1790771165.753735:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5578 00000100:00100000:1.0:1790771165.753736:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14400:x1877759533712512:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771165.753746:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.753749:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14277:x1877759533719040:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:1.0:1790771165.753757:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b310 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ece expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753759:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.753772:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0b317 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f5a expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753782:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14326:x1877759533732992:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 137us (612us total) trans 4294968558 rc 0/0 00000100:00100000:3.0:1790771165.753788:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1404 00000100:00100000:3.0:1790771165.753803:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1405 00010000:00010000:1.0:1790771165.753805:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0b31e lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753814:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14282:x1877759533733376:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:1.0:1790771165.753816:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0b31e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753824:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0b31e lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.753830:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 32696 00010000:00010000:0.0:1790771165.753838:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.753844:0:13790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.753851:0:13790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.753861:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753873:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.753878:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733248 00010000:00010000:1.0:1790771165.753882:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b310 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ece expref: 113 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753884:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14282:x1877759533733376:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 72us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.753886:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733248 00010000:00010000:0.0:1790771165.753890:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753902:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1405 00010000:00010000:1.0:1790771165.753909:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0b31e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ece expref: 112 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.753911:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.753914:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.753921:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533727616 00010000:00010000:1.0:1790771165.753926:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:3.0:1790771165.753928:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533727616 00010000:00010000:1.0:1790771165.753934:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:0.0:1790771165.753935:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.753939:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4bc00, rc 0) 00000100:00100000:3.0:1790771165.753957:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 910 00000100:00100000:1.0:1790771165.753967:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14400:x1877759533712512:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 234us (2932us total) trans 4294968559 rc 0/0 00000100:00100000:3.0:1790771165.753968:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533727616:12345-192.168.204.50@tcp:101:chown.0 00000004:00200000:0.0:1790771165.753970:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00000100:00100000:2.0:1790771165.753974:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733760 00000100:00100000:2.0:1790771165.753982:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733760 00010000:00010000:3.0:1790771165.753983:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.753984:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.753984:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5577 00010000:00010000:0.0:1790771165.753994:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.753996:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0b33a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3505d expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754003:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754006:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.754008:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5579 00000100:00100000:1.0:1790771165.754022:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:13261:x1877759533726080:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.754023:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.754031:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754035:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.754036:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539718528:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.754040:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754047:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b341 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35041 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.754053:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1534 00000100:00100000:2.0:1790771165.754068:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533733248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.754077:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.754081:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.754081:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.754082:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35c00 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.754088:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754090:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754093:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754101:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533730560 00010000:00010000:0.0:1790771165.754106:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0b325 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754107:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533730560 00010000:00010000:2.0:1790771165.754120:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 120 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754131:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754133:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754140:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00000100:00100000:3.0:1790771165.754142:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 373 00010000:00010000:0.0:1790771165.754144:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754151:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754155:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754158:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2398:x1877759533730560:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:0.0:1790771165.754165:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754176:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754181:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.754184:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754186:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754186:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754205:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754208:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754214:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.754217:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754220:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc3607db00) 00010000:00010000:0.0:1790771165.754224:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.754226:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754231:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b333 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.754238:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533733248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 173us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.754250:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1534 00000004:00200000:1.0:1790771165.754261:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.754268:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1535 00010000:00010000:0.0:1790771165.754271:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0b317 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f5a expref: 111 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.754278:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533733760:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.754292:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.754293:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.754294:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754302:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.754308:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754309:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754310:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0b317 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f5a expref: 111 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754328:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754341:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669600, rc 0) 00010000:00010000:1.0:1790771165.754342:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754348:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754350:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.754355:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.754365:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14277:x1877759533719040:12345-192.168.204.50@tcp:101:touch.0 Request processed in 617us (3109us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.754375:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0a3ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34abb expref: 25 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.754383:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5578 00010000:00010000:1.0:1790771165.754385:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754401:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(5 2) 00010000:00010000:1.0:1790771165.754404:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.754407:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(5 2) 00010000:00010000:1.0:1790771165.754408:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:3.0:1790771165.754410:0:13795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 31645 -> 31645 00000100:00100000:0.0:1790771165.754413:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5580 00010000:00010000:1.0:1790771165.754414:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.754415:0:13795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00010000:00010000:2.0:1790771165.754419:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.754424:0:13795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771165.754431:0:13795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00000100:00100000:0.0:1790771165.754434:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14441:x1877759533727488:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.754436:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b348 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.754439:0:13795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 64 -> 32 00010000:00010000:2.0:1790771165.754451:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754457:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754464:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754467:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2398:x1877759533730560:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 310us (2095us total) trans 4294967583 rc 0/0 00010000:00010000:0.0:1790771165.754474:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754476:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754477:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754503:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.754509:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754523:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754529:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754533:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 373 00000100:00100000:2.0:1790771165.754549:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539718656:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.754554:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb0321a200) 00010000:00010000:0.0:1790771165.754555:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 119 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754559:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.754564:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5581 00010000:00010000:1.0:1790771165.754565:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.754571:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 5/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754574:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b34f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.754580:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.754581:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14368:x1877759533716480:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:3.0:1790771165.754597:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.754608:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f37 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754614:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b341 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35041 expref: 135 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754626:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.754628:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.754632:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b341 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35041 expref: 135 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754640:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a400, rc 0) 00000100:00100000:1.0:1790771165.754659:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:13261:x1877759533726080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 640us (3305us total) trans 4294969141 rc 301/301 00010000:00010000:3.0:1790771165.754660:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b36b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.754669:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5579 00010000:00010000:3.0:1790771165.754690:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b36b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.754699:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969139 is committed 00010000:00010000:3.0:1790771165.754700:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b36b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754709:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.754712:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969138 is committed 00000004:00200000:3.0:1790771165.754714:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 5134 00010000:00010000:1.0:1790771165.754722:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.754729:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969132 is committed 00010000:00010000:1.0:1790771165.754730:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754737:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.754741:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771165.754746:0:6473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:1.0:1790771165.754751:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754761:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc20109500) 00010000:00010000:1.0:1790771165.754763:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.754766:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754774:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0ac87 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.754774:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0b364 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f37 expref: 117 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.754779:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 45 batchid updated 00010000:00010000:3.0:1790771165.754804:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02200/0xfa0c505d97f0b36b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f37 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754808:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754811:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.754813:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:3.0:1790771165.754821:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:3.0:1790771165.754825:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02200, rc 0) 00010000:00010000:2.0:1790771165.754830:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754832:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754845:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754845:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754846:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14368:x1877759533716480:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 272us (3243us total) trans 4294969142 rc 0/0 00000100:00100000:3.0:1790771165.754865:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5581 00010000:00010000:1.0:1790771165.754866:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.754869:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.754871:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754876:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754878:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754888:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5582 00010000:00010000:2.0:1790771165.754899:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.754899:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14015:x1877759533719296:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771165.754903:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfb0321a600) 00010000:00010000:1.0:1790771165.754913:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.754913:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.754919:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754922:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc22108b00) 00010000:00010000:3.0:1790771165.754922:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b379 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f61 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754931:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.754937:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0aea2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754939:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754957:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0aae3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754963:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754970:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.754975:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754976:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.754980:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.754997:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.755004:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755004:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755004:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755027:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755031:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755032:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755037:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771165.755045:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.755050:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755052:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.755058:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755069:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0ab3e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755070:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755072:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755092:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755095:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755098:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc22108000) 00010000:00010000:1.0:1790771165.755105:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755106:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.755113:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755114:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755115:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755130:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0aace lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755136:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.755141:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755146:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755151:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755155:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:2.0:1790771165.755157:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755160:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.755160:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755166:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755172:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755183:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755185:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ac17 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1f:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755191:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.755198:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755205:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755208:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755212:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.755214:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x42:0x0]: returning size 11504 00010000:00010000:1.0:1790771165.755225:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755228:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771165.755234:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755234:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790771165.755237:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755245:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.755249:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0ab06 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755250:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755251:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.755263:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13737:x1877759533725568:12345-192.168.204.50@tcp:37:ls.0 Request processed in 5323us (6032us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.755274:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.755287:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1400 00010000:00010000:1.0:1790771165.755287:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.755292:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2c94fbe reply state 00000000f07cb001 transno 4294969137 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755293:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755308:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.755312:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.755314:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.755321:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755324:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755324:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755344:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0ac79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755350:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755352:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771165.755356:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755360:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.755365:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755367:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771165.755368:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755375:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.755383:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755383:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755384:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755402:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02000/0xfa0c505d97f0b380 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755408:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.755409:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755414:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755415:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755431:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755433:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.755435:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.755441:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.755443:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfb0321a600) 00010000:00010000:1.0:1790771165.755449:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.755451:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755452:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755470:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0ac9c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755472:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00080000:2.0:1790771165.755473:0:6495:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000001:00080000:0.0:1790771165.755477:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968555 is committed 00010000:00010000:3.0:1790771165.755481:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755507:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755520:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14507:x1877759533717248:12345-192.168.204.50@tcp:36:chown.0 Request processed in 6973us (7737us total) trans 4294969137 rc 0/0 00010000:00010000:3.0:1790771165.755523:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755526:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755539:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5555 00010000:00010000:1.0:1790771165.755546:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755549:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc10471b00) 00000100:00100000:0.0:1790771165.755552:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5583 00010000:00010000:3.0:1790771165.755557:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.755560:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.755562:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755563:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5584 00010000:00010000:1.0:1790771165.755566:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.755568:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14234:x1877759533716608:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:2.0:1790771165.755581:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13742:x1877759533720960:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.755584:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.755588:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755595:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b39c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f3e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755598:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.755599:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0b387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755610:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.755612:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b3a3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f8b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755619:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.755623:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755633:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0aa03 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755648:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0b379 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 117 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755649:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755650:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755670:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 116 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755672:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755688:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755705:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:1.0:1790771165.755708:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755709:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.755711:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755713:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8e00, rc 0) 00000004:00200000:2.0:1790771165.755714:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.755725:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.755729:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755734:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.755736:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14015:x1877759533719296:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 838us (3990us total) trans 4294969143 rc 0/0 00010000:00010000:0.0:1790771165.755738:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755748:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc10471800) 00000100:00100000:3.0:1790771165.755755:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5582 00010000:00010000:1.0:1790771165.755756:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.755758:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755762:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755768:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.755770:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b0d2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755772:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b3a3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f8b expref: 116 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.755779:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5585 00000100:00100000:3.0:1790771165.755793:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14458:x1877759533715840:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.755799:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188700) 00010000:00010000:3.0:1790771165.755802:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.755803:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000020:00080000:1.0:1790771165.755809:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 45 00010000:00010000:2.0:1790771165.755810:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b3a3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f8b expref: 116 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755812:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b3bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f29 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755819:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755837:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996400, rc 0) 00010000:00010000:0.0:1790771165.755839:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755851:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.755859:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb04b8bcc0 with version 73 00010000:00010000:3.0:1790771165.755859:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755866:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13742:x1877759533720960:12345-192.168.204.50@tcp:101:ls.0 Request processed in 287us (4016us total) trans 4294969144 rc 301/301 00000020:00080000:1.0:1790771165.755872:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 43 cancel update log [0x240000401:0x3:0x0].34: rc = 0 00010000:00010000:3.0:1790771165.755872:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.755874:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.755883:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5584 00000004:00200000:0.0:1790771165.755884:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.755896:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.755904:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755908:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.755912:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5586 00010000:00010000:0.0:1790771165.755917:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755926:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755927:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.755930:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 43 cancel update log [0x200000400:0x3:0x0].34: rc = 0 00000100:00100000:2.0:1790771165.755931:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14320:x1877759533729792:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:0.0:1790771165.755949:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.755953:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.755956:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.755958:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:1.0:1790771165.755960:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb04b8b780 with version 74 00010000:00010000:0.0:1790771165.755964:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.755967:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 44 cancel update log [0x240000401:0x3:0x0].35: rc = 0 00010000:00010000:2.0:1790771165.755969:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b3db lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350c6 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.755984:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.755995:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 44 cancel update log [0x200000400:0x3:0x0].35: rc = 0 00010000:00010000:0.0:1790771165.755997:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.756001:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.756004:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.756006:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 45 00010000:00010000:3.0:1790771165.756011:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756021:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b3aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756023:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539718784:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790771165.756028:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756044:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756045:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756051:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756054:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.756066:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 2272 00010000:00010000:0.0:1790771165.756068:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756069:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.756072:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771165.756073:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1790771165.756085:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756091:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.756094:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756096:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756097:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756099:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790771165.756109:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539718912:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1790771165.756119:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756122:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756123:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756137:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756139:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771165.756145:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc3607d600) 00010000:00010000:0.0:1790771165.756153:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.756158:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756160:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756161:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756165:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539719168:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790771165.756178:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b3b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756185:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756191:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.756194:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.756195:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756204:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756210:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b39c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 116 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756211:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756214:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:1.0:1790771165.756215:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1790771165.756223:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.756226:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539719040:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1790771165.756228:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756236:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756251:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b3cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756254:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771165.756259:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756262:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756272:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.756277:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 73 rpc_version 73 00010000:00010000:0.0:1790771165.756294:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000004:00200000:2.0:1790771165.756295:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 2272 00010000:00010000:3.0:1790771165.756295:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1790771165.756296:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1790771165.756305:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.756308:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756309:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb04972a00 x1877759539719424/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1790771165.756311:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73400, rc 0) 00010000:00010000:3.0:1790771165.756327:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.756332:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756338:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04972a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539719424:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771165.756341:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.756344:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14234:x1877759533716608:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 778us (4548us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.756346:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756359:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc10471f00) 00010000:00010000:3.0:1790771165.756366:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.756367:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5583 00010000:00010000:2.0:1790771165.756369:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756371:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.756373:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756389:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756390:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b3d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756392:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.756395:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5587 00000100:00100000:1.0:1790771165.756409:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539719424 00010000:00010000:2.0:1790771165.756413:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.756414:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14351:x1877759533733120:12345-192.168.204.50@tcp:101:file_concat.sh.0 00000100:00100000:1.0:1790771165.756414:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539719424 00010000:00010000:3.0:1790771165.756426:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b3bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 115 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756429:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.756434:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.756435:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756443:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756446:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 114 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756448:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00010000:00010000:0.0:1790771165.756449:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b405 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3503a expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756461:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7768:x1877759539719424:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1790771165.756466:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.756475:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.756476:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771165.756479:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756480:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.756507:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82600, rc 0) 00010000:00010000:2.0:1790771165.756510:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b3e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756523:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.756529:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.756530:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14458:x1877759533715840:12345-192.168.204.50@tcp:101:chown.0 Request processed in 739us (4595us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.756532:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756546:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.756548:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5585 00010000:00010000:0.0:1790771165.756549:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b405 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3503a expref: 77 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756563:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.756568:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756569:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:3.0:1790771165.756573:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5588 00010000:00010000:0.0:1790771165.756577:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.756584:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756586:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b405 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3503a expref: 77 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.756590:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14511:x1877759533731840:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:1.0:1790771165.756592:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539719424:12345-0@lo:1000:osp_up1-0.0 Request processed in 130us (219us total) trans 4294968560 rc 0/0 00010000:00010000:3.0:1790771165.756605:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.756608:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc10471f00) 00010000:00010000:2.0:1790771165.756611:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.756615:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00010000:00010000:0.0:1790771165.756618:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72a00, rc 0) 00010000:00010000:3.0:1790771165.756618:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b40c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35121 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756619:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756642:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b3f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.756643:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14351:x1877759533733120:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 233us (4349us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.756645:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539718784 00000100:00100000:1.0:1790771165.756653:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539718784 00010000:00010000:3.0:1790771165.756657:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.756666:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5587 00010000:00010000:3.0:1790771165.756670:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756692:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756698:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539718912 00000100:00100000:1.0:1790771165.756704:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539718912 00000100:00100000:0.0:1790771165.756706:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5589 00010000:00010000:2.0:1790771165.756707:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b3db lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 115 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.756709:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.756716:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.756724:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14017:x1877759533732608:12345-192.168.204.50@tcp:101:dd.0 00000004:00010000:3.0:1790771165.756730:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756731:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539719168 00010000:00010000:0.0:1790771165.756734:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.756735:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 114 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756739:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1790771165.756739:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539719168 00010000:00010000:2.0:1790771165.756752:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771165.756755:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.756759:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0a858 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c19 expref: 75 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756759:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fe00, rc 0) 00000100:00100000:1.0:1790771165.756763:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539719040 00010000:00010000:3.0:1790771165.756764:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b40c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 115 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.756770:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539719040 00000100:00100000:2.0:1790771165.756781:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14320:x1877759533729792:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 855us (4702us total) trans 4294969145 rc 0/0 00010000:00010000:0.0:1790771165.756783:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc29009b00) 00010000:00010000:3.0:1790771165.756792:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 114 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.756800:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.756802:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5586 00000100:00100000:1.0:1790771165.756804:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00010000:00010000:3.0:1790771165.756804:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.756810:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.756811:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b41a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fa0 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.756813:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83e00, rc 0) 00000100:00100000:1.0:1790771165.756821:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3624:x1877759539718784:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.756826:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5590 00000100:00100000:3.0:1790771165.756836:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14511:x1877759533731840:12345-192.168.204.50@tcp:101:rm.0 Request processed in 251us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.756842:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14376:x1877759533733632:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771165.756843:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1790771165.756844:0:13787:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:16 count 1 00000100:00100000:3.0:1790771165.756849:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5588 00010000:00010000:0.0:1790771165.756864:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756864:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1790771165.756872:0:13787:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x6abcffd9, atime: 0x6abcffd9, ctime: 0x6abcffd9, blocks: 0x0 00010000:00010000:0.0:1790771165.756878:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756879:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f0b42f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3513d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.756881:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.756909:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=165s v=(0 0) 00010000:00010000:1.0:1790771165.756913:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771165.756919:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.756935:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756935:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f0b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3513d expref: 114 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.756963:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756968:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f800/0xfa0c505d97f0b42f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3513d expref: 114 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.756986:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.756998:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:2.0:1790771165.757003:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771165.757007:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f800, rc 0) 00010000:00010000:1.0:1790771165.757014:0:13787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790771165.757022:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771165.757029:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.757034:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14376:x1877759533733632:12345-192.168.204.50@tcp:101:cat.0 Request processed in 195us (3615us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.757045:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:2.0:1790771165.757049:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5590 00010000:00010000:0.0:1790771165.757051:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.757059:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.757070:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.757075:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c19a27e/0xfa0c505d97f0b428 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.757097:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.757099:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.757101:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.757105:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.757109:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757117:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757125:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.757128:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.757133:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3624:x1877759539718784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 315us (1061us total) trans 4294967586 rc 0/0 00010000:00010000:2.0:1790771165.757136:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757155:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000100:00100000:1.0:1790771165.757157:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00010000:00010000:2.0:1790771165.757160:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.757164:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757169:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0b1dc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.757187:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:1.0:1790771165.757198:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3624:x1877759539718912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.757202:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14386:x1877759533711872:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 89078us (89162us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771165.757211:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5535 00002000:00010000:1.0:1790771165.757270:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x20:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790771165.757275:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x20:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00002000:00010000:1.0:1790771165.757280:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x20:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:1.0:1790771165.757283:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x20:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.757286:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x20:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1790771165.757291:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000872be02f reply state 000000007039791b transno 4294968554 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757301:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757309:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.757313:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.757316:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771165.757322:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.757330:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3624:x1877759539718912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (1194us total) trans 4294967587 rc 0/0 00000100:00100000:1.0:1790771165.757341:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00010000:00080000:2.0:1790771165.757358:0:13773:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790771165.757365:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1790771165.757372:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14367:x1877759533717504:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 8409us (9553us total) trans 4294968554 rc 0/0 00000100:00100000:1.0:1790771165.757379:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3627:x1877759539719168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.757386:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5556 00000100:00100000:2.0:1790771165.757435:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1790771165.757443:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3627:x1877759539719040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.757561:0:7768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968540 gen 2 00000004:00080000:2.0:1790771165.757566:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968540 committed transno 4294968540 00000020:00080000:2.0:1790771165.757571:0:7768:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb061a20c0 refcount 2 committed 0 result 0 batchid 46 00000020:00080000:2.0:1790771165.757574:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc2d0da800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb061a2540 00000020:00080000:2.0:1790771165.757577:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].36 00000020:00080000:2.0:1790771165.757579:0:7768:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc1834fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06b65800 00000020:00080000:2.0:1790771165.757582:0:7768:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].36 00000100:00100000:2.0:1790771165.757604:0:7768:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb04972a00 x1877759539719424/t4294968560(4294968560) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1790771181 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790771165.757619:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04972a00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539719424:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1790771165.757628:0:13763:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x17:0x0], index 0: 0 00000004:00080000:2.0:1790771165.757631:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 74 rpc_version 74 00000004:00080000:0.0:1790771165.757636:0:13763:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x17:0x0], index 1: 0 00000020:00100000:2.0:1790771165.757648:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1790771165.757655:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb0562ea00 x1877759539719680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790771165.757687:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539719680:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1790771165.757724:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1790771165.757739:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 88 off9496 00000004:00080000:0.0:1790771165.757748:0:13763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 165963261952ns, next at 166289701276ns, rc = 0 00000100:00100000:2.0:1790771165.757750:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.757773:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:13890:x1877759533727104:12345-192.168.204.50@tcp:37:ls.0 Request processed in 7579us (8117us total) trans 0 rc 0/0 00000040:00080000:0.0:1790771165.757779:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 88 off9584 00000100:00100000:3.0:1790771165.757782:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1402 00000004:00080000:0.0:1790771165.757798:0:13763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 165963311073ns, next at 166289701276ns, rc = 0 00010000:00010000:2.0:1790771165.757814:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.757815:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539719680 00000100:00100000:3.0:1790771165.757820:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539719680 00010000:00010000:2.0:1790771165.757825:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790771165.757839:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 88 off9520 00000004:00080000:0.0:1790771165.757848:0:13763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 165963361013ns, next at 165824614272ns, rc = 0 00000100:00100000:3.0:1790771165.757852:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:3.0:1790771165.757861:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539719680:12345-0@lo:1000:osp_up1-0.0 00002000:00010000:1.0:1790771165.757880:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x21:0x0] updating lvb size from disk: 13172736 -> 13172736 00000040:00080000:0.0:1790771165.757882:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 88 off9608 00002000:00010000:1.0:1790771165.757886:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x21:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000004:00080000:0.0:1790771165.757891:0:13763:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 165963404297ns, next at 165824614272ns, rc = 0 00002000:00010000:1.0:1790771165.757892:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x21:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790771165.757897:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x21:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.757901:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x21:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1790771165.757909:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce7635d7 reply state 00000000b5daa313 transno 4294968561 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757924:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757932:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771165.757935:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.757939:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.757949:0:13771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.757951:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3627:x1877759539719040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 507us (1698us total) trans 4294967588 rc 0/0 00000100:00100000:3.0:1790771165.757957:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539719680:12345-0@lo:1000:osp_up1-0.0 Request processed in 95us (231us total) trans 4294968562 rc 0/0 00010000:00010000:2.0:1790771165.757970:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.757974:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1790771165.757975:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1790771165.758005:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.758018:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ea00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539719680:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771165.758028:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967555 gen 2 00000100:00100000:2.0:1790771165.758045:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14479:x1877759533717760:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 9069us (10202us total) trans 4294968561 rc 0/0 00000100:00100000:1.0:1790771165.758046:0:3627:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb05a0df80 x1877759539719040/t4294967588(4294967588) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1790771165.758050:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.758058:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5557 00010000:00010000:0.0:1790771165.758059:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.758071:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.758080:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05a0df80/2, rc 0, transno 4294967588 00010000:00010000:2.0:1790771165.758087:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.758100:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.758101:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539719040:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1790771165.758101:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.758102:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 113 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.758105:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.758130:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb029c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539719808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.758131:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b261 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 114 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.758144:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05a0d180/2, rc 0, transno 4294967587 00010000:00010000:3.0:1790771165.758150:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 113 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.758156:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539718912:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1790771165.758158:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771165.758166:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.758169:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687400, rc 0) 00000004:00080000:1.0:1790771165.758180:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05a0dc00/2, rc 0, transno 4294967586 00010000:00010000:2.0:1790771165.758183:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0b292 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec7 expref: 107 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.758191:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539718784:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790771165.758194:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14580:x1877759533720576:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 6332us (9546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.758212:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5565 00010000:00010000:2.0:1790771165.758221:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec7 expref: 106 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.758227:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771165.758230:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.758232:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02e00, rc 0) 00010000:00010000:3.0:1790771165.758262:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0a9f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ce4 expref: 112 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.758263:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14551:x1877759533712256:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 5984us (9500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.758277:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5568 00000100:00100000:3.0:1790771165.758294:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539717760:192.168.204.50@tcp:104: 00000020:00080000:1.0:1790771165.758297:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 46 committed batchid 45 00010000:00010000:3.0:1790771165.758315:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.758325:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771165.758329:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 45 00010000:00010000:3.0:1790771165.758330:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.758452:0:13761:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969146 00000004:00010000:3.0:1790771165.758479:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007bab2f39 reply state 000000007f9fb983 transno 4294969147 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.758574:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.758579:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 47456 -> 47456 00002000:00010000:1.0:1790771165.758584:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:1.0:1790771165.758587:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790771165.758590:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771165.758592:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:0.0:1790771165.758610:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 112 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.758623:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.758629:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539719936:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.758630:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3627:x1877759539719168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1254us (2435us total) trans 4294967589 rc 0/0 00000100:00100000:1.0:1790771165.758641:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000001:00080000:0.0:1790771165.758665:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968563 is committed 00000004:00080000:1.0:1790771165.758670:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b00700/2, rc 0, transno 4294967589 00010000:00010000:3.0:1790771165.758670:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00000004:00080000:0.0:1790771165.758672:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 11 committed 00010000:00010000:3.0:1790771165.758686:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771165.758691:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771165.758699:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539719168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1790771165.758701:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 10 committed 00000004:00080000:0.0:1790771165.758709:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 11 committed 00000004:00080000:0.0:1790771165.758721:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 10 committed 00000001:00080000:0.0:1790771165.758729:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968562 is committed 00000100:00100000:3.0:1790771165.758730:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14465:x1877759533715712:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 76452us (77297us total) trans 4294969147 rc 0/0 00000100:00100000:3.0:1790771165.758740:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5553 00000001:00080000:0.0:1790771165.758744:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968559 is committed 00000020:00080000:3.0:1790771165.758745:0:13761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771165.758777:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539720320:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790771165.758794:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539720192:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790771165.758805:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa0 expref: 71 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.758814:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc3607d900) 00000100:00100000:3.0:1790771165.758816:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771165.758819:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1790771165.758831:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b41a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa0 expref: 71 pid: 13763 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.758833:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720064:0@lo:6:osp-syn-1-1.0 00000100:00100000:3.0:1790771165.758848:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539720832:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1790771165.758863:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771165.758864:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa0 expref: 70 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.758880:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771165.758892:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720576:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771165.758895:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc3607d900) 00010000:00010000:0.0:1790771165.758900:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1790771165.758902:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72800, rc 0) 00000100:00100000:2.0:1790771165.758909:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720320 00000100:00100000:2.0:1790771165.758916:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720320 00000100:00100000:3.0:1790771165.758946:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790771165.758950:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720064 00000100:00100000:2.0:1790771165.758955:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720064 00000100:00100000:3.0:1790771165.758957:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539720448:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1790771165.758958:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771165.758959:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14017:x1877759533732608:12345-192.168.204.50@tcp:101:dd.0 Request processed in 2239us (6142us total) trans 4294968563 rc 0/0 00000100:00100000:0.0:1790771165.758970:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5589 00000100:00100000:1.0:1790771165.758992:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790771165.758994:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720832 00000100:00100000:3.0:1790771165.758999:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771165.759001:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720832 00000100:00100000:1.0:1790771165.759002:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720704:0@lo:2:osp-syn-0-1.0 00000100:00100000:1.0:1790771165.759040:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771165.759042:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720576 00000100:00100000:2.0:1790771165.759046:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720576 00000100:00100000:3.0:1790771165.759050:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720448 00000100:00100000:3.0:1790771165.759055:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720448 00000100:00100000:2.0:1790771165.759069:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720704 00000100:00100000:2.0:1790771165.759074:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720704 00000100:00100000:0.0:1790771165.759081:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87000 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.759081:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1790771165.759094:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3626:x1877759539720320:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.759102:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00002000:00080000:1.0:1790771165.759106:0:13796:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:21 count 1 00000100:00100000:2.0:1790771165.759115:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+10:3624:x1877759539720064:12345-0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1790771165.759120:0:13796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.759122:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00002000:00080000:2.0:1790771165.759129:0:13782:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:19 count 1 00000100:00100000:3.0:1790771165.759135:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:0.0:1790771165.759137:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3626:x1877759539720832:12345-0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1790771165.759141:0:13796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.759147:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.759148:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+10:3624:x1877759539720576:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1790771165.759156:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x15:0x0].0x0 since=2s v=(4 0) 00010000:00010000:1.0:1790771165.759165:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(1 4) 00010000:00010000:1.0:1790771165.759170:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.759173:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 27 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.759192:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790771165.759195:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771165.759196:0:13796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.759199:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 4/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.759213:0:13796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.759224:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539720960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.759230:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 27 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.759231:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+7:3626:x1877759539720832:12345-0@lo:2:osp-syn-0-1.0 Request processed in 97us (350us total) trans 4294967590 rc 0/0 00000100:00100000:0.0:1790771165.759247:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00010000:00010000:2.0:1790771165.759252:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 27 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.759253:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.759260:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+11:3624:x1877759539720576:12345-0@lo:2:osp-syn-1-1.0 Request processed in 115us (303us total) trans 4294967584 rc 0/0 00000100:00100000:0.0:1790771165.759270:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1790771165.759273:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539721088:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.759279:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1790771165.759284:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+6:3624:x1877759539720704:12345-0@lo:2:osp-syn-0-1.0 00000100:00100000:3.0:1790771165.759286:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1790771165.759292:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3626:x1877759539720448:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:2.0:1790771165.759305:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.759319:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967579 gen 2 00000004:00080000:3.0:1790771165.759324:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb03020e00, transno 4294967576 00000004:00080000:3.0:1790771165.759331:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc29017b80, transno 4294967577 00000004:00080000:3.0:1790771165.759335:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb03023b80, transno 4294967578 00000004:00080000:3.0:1790771165.759338:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb03020700, transno 4294967579 00000100:00100000:3.0:1790771165.759345:0:3626:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb0562df80 x1877759539720832/t4294967590(4294967590) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790771165.759352:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb0562df80/2, rc 0, transno 4294967590 00000100:00100000:3.0:1790771165.759358:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539720832:0@lo:2:osp-syn-0-1.0 00002000:00010000:0.0:1790771165.759374:0:13793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790771165.759378:0:13793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.759381:0:13793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.759383:0:13793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1790771165.759385:0:13793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x15:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771165.759397:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+11:3626:x1877759539720448:12345-0@lo:2:osp-syn-1-1.0 Request processed in 109us (400us total) trans 4294967585 rc 0/0 00000100:00100000:1.0:1790771165.759404:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00100000:0.0:1790771165.759431:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+7:3624:x1877759539720704:12345-0@lo:2:osp-syn-0-1.0 Request processed in 149us (390us total) trans 4294967591 rc 0/0 00000004:00080000:1.0:1790771165.759439:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb04973480/2, rc 0, transno 4294967585 00000100:00100000:0.0:1790771165.759444:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:2.0:1790771165.759446:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771165.759448:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539720448:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1790771165.759471:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539720192 00000100:00100000:0.0:1790771165.759476:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539720192 00000004:00080000:3.0:1790771165.759527:0:8655:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0001: 0 changes, 2 in progress, 1 in flight, 4 done 00000100:00100000:0.0:1790771165.759543:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1790771165.759554:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3db7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3625:x1877759539720192:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1790771165.759563:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb0562c380/2, rc 0, transno 4294967591 00000100:00100000:1.0:1790771165.759570:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720704:0@lo:2:osp-syn-0-1.0 00010000:00010000:3.0:1790771165.759572:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759581:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.759588:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb04973800/2, rc 0, transno 4294967584 00010000:00010000:3.0:1790771165.759588:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.759594:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720576:0@lo:2:osp-syn-1-1.0 00010000:00010000:3.0:1790771165.759596:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.759601:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759607:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759616:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.759618:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.759621:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759625:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0b1f1 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759635:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759640:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759645:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759648:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.759650:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759658:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759665:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771165.759667:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.759669:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759687:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b0b6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759699:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759704:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759708:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759712:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfde00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.759715:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759719:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.759720:0:13793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 47456 -> 47456 00002000:00010000:0.0:1790771165.759727:0:13793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:0.0:1790771165.759730:0:13793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:3.0:1790771165.759731:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00002000:00010000:0.0:1790771165.759733:0:13793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:3.0:1790771165.759734:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00002000:00010000:0.0:1790771165.759737:0:13793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 72 -> 72 00010000:00010000:3.0:1790771165.759739:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.759749:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b1f8 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.759772:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+11:3625:x1877759539720192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 222us (331us total) trans 4294967592 rc 0/0 00000100:00100000:0.0:1790771165.759778:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000004:00080000:2.0:1790771165.759800:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb0562e300/2, rc 0, transno 4294967592 00000100:00100000:2.0:1790771165.759812:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539720192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771165.760944:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.760977:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.761011:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733504 00000100:00100000:1.0:1790771165.761017:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733504 00000100:00100000:3.0:1790771165.761039:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734016 00002000:00100000:1.0:1790771165.761040:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (458752->462847) req@ffff8bfb05a0c700 x1877759533733504/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771165.761045:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734016 00002000:00100000:1.0:1790771165.761053:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05a0c700 with x1877759533733504 ext(458752->462847) 00002000:00010000:1.0:1790771165.761058:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05a0c700 00000100:00100000:1.0:1790771165.761084:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 374 00000100:00100000:1.0:1790771165.761094:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759533733504:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.761110:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5591 00000100:00100000:3.0:1790771165.761120:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14661:x1877759533734016:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.761129:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.761139:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b444 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3514b expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.761163:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0b44b lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.761170:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0b44b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.761177:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0b44b lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.761195:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.761198:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1790771165.761210:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759533733504:12345-192.168.204.50@tcp:3:cat.0 Request processed in 118us (266us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.761217:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b444 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3514b expref: 115 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.761223:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 374 00002000:00100000:1.0:1790771165.761234:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (458752->462847) req@ffff8bfb05a0c700 x1877759533733504/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.761238:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0b44b lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3514b expref: 114 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771165.761255:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05a0c700 with x1877759533733504 ext(458752->462847) 00010000:00010000:3.0:1790771165.761258:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfc10471200) 00002000:00010000:1.0:1790771165.761260:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05a0c700 00010000:00010000:3.0:1790771165.761261:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.761266:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa600, rc 0) 00000100:00100000:3.0:1790771165.761332:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14661:x1877759533734016:12345-192.168.204.50@tcp:101:ln.0 Request processed in 214us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.761337:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5591 00000100:00100000:0.0:1790771165.761670:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:13208:x1877759533729920:12345-192.168.204.50@tcp:37:ls.0 Request processed in 8354us (9530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.761689:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1403 00000100:00100000:2.0:1790771165.762653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.762691:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734656 00000100:00100000:0.0:1790771165.762696:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734656 00000100:00100000:0.0:1790771165.762718:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5592 00000100:00100000:0.0:1790771165.762726:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12252:x1877759533734656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.762733:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.762741:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b452 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35056 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.762775:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.762813:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b452 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35056 expref: 116 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.762825:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771165.762827:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.762832:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b452 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35056 expref: 116 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.762840:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2c00, rc 0) 00000100:00100000:2.0:1790771165.762857:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.762882:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:12252:x1877759533734656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 155us (229us total) trans 4294969148 rc 301/301 00000100:00100000:3.0:1790771165.762888:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734144 00000100:00100000:0.0:1790771165.762894:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5592 00000100:00100000:3.0:1790771165.762896:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734144 00000100:00100000:3.0:1790771165.762941:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5593 00000100:00100000:3.0:1790771165.762952:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13265:x1877759533734144:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.762966:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.762988:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.763005:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734528 00010000:00010000:3.0:1790771165.763010:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.763013:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.763013:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734528 00010000:00010000:3.0:1790771165.763024:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0b460 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35152 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.763028:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734784 00000100:00100000:0.0:1790771165.763035:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734784 00000100:00100000:1.0:1790771165.763041:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.763054:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721344 00000100:00100000:2.0:1790771165.763060:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721344 00000100:00100000:0.0:1790771165.763067:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533734912 00010000:00010000:3.0:1790771165.763068:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.763071:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533734912 00000100:00100000:1.0:1790771165.763081:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5594 00010000:00010000:3.0:1790771165.763086:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.763094:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:12016:x1877759533734528:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.763096:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5595 00000100:00100000:0.0:1790771165.763110:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5596 00010000:00010000:1.0:1790771165.763110:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.763111:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.763112:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14533:x1877759533734784:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771165.763123:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b46e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35160 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.763127:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.763128:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14382:x1877759533721344:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771165.763139:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b475 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35167 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.763142:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.763144:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1790771165.763150:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.763156:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f92 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.763167:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.763168:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763176:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 102 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.763179:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.763193:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.763213:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.763213:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763214:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 102 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.763214:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0b460 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35152 expref: 116 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.763240:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763243:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.763250:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:1.0:1790771165.763254:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.763255:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00000004:00200000:1.0:1790771165.763262:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.763273:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35152 expref: 115 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.763274:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.763278:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.763285:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.763294:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14382:x1877759533721344:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 167us (276us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.763295:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771165.763301:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00010000:2.0:1790771165.763302:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.763305:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ae00, rc 0) 00010000:00010000:1.0:1790771165.763307:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b46e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35160 expref: 72 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.763312:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5596 00000100:00100000:3.0:1790771165.763335:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:13265:x1877759533734144:12345-192.168.204.50@tcp:101:ls.0 Request processed in 382us (476us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.763337:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35160 expref: 72 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.763345:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5597 00010000:00010000:2.0:1790771165.763345:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b475 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 72 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.763358:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:3.0:1790771165.763361:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5593 00000100:00100000:0.0:1790771165.763364:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13057:x1877759533734912:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771165.763366:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.763371:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596800, rc 0) 00010000:00010000:0.0:1790771165.763377:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.763382:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 71 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763389:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b491 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3516e expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.763390:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.763394:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771165.763400:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:12016:x1877759533734528:12345-192.168.204.50@tcp:101:ls.0 Request processed in 308us (432us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.763400:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fa00, rc 0) 00000100:00100000:1.0:1790771165.763411:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5594 00010000:00010000:0.0:1790771165.763425:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0b498 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.763434:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14533:x1877759533734784:12345-192.168.204.50@tcp:101:ln.0 Request processed in 325us (442us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.763443:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0b498 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.763448:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5595 00010000:00010000:0.0:1790771165.763459:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0b498 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763587:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b491 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3516e expref: 71 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763604:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0b498 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3516e expref: 70 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763610:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771165.763613:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771165.763616:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3400, rc 0) 00002000:00010000:1.0:1790771165.763619:0:13786:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size: 0 -> 38336 00002000:00010000:1.0:1790771165.763623:0:13786:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1790771165.763633:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539717888:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.763650:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:13057:x1877759533734912:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 290us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.763656:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5597 00010000:00010000:1.0:1790771165.763660:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bda7fc9/0xfa0c505d97f0b23e lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f6f expref: 29 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.763667:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.763694:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bda7fc9/0xfa0c505d97f0b23e lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f6f expref: 29 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.763704:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339c00, rc 0) 00000100:00100000:3.0:1790771165.763721:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533721472 00000100:00100000:3.0:1790771165.763727:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533721472 00000100:00100000:1.0:1790771165.763739:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533719936:12345-192.168.204.50@tcp:101:ln.0 Request processed in 12975us (15178us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.763745:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 908 00000100:00100000:2.0:1790771165.763769:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539718016:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.763784:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539718144:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.763794:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539718272:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.763798:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763816:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042f7c623/0xfa0c505d97f0b245 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f53 expref: 27 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763828:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042f7c623/0xfa0c505d97f0b245 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f53 expref: 27 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.763837:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc000, rc 0) 00000100:00100000:3.0:1790771165.763847:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5598 00000100:00100000:0.0:1790771165.763867:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533718784:12345-192.168.204.50@tcp:101:chown.0 Request processed in 12815us (15263us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.763876:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 909 00000100:00100000:3.0:1790771165.763919:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14412:x1877759533721472:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771165.763927:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.763934:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34f99 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.763949:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 103 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.763987:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 103 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.763993:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.763995:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.763997:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b400, rc 0) 00000100:00100000:3.0:1790771165.764019:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14412:x1877759533721472:12345-192.168.204.50@tcp:101:ln.0 Request processed in 166us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.764024:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5598 00000100:00100000:2.0:1790771165.770867:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.770931:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533722496 00000100:00100000:3.0:1790771165.770937:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533722496 00000100:00100000:3.0:1790771165.770964:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5599 00000100:00100000:3.0:1790771165.770970:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13734:x1877759533722496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.770983:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.770995:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0b4a6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fb5 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.771050:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.771096:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0b4a6 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fb5 expref: 105 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.771104:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.771106:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.771109:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0b4a6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fb5 expref: 105 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.771117:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00000100:00100000:3.0:1790771165.771145:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13734:x1877759533722496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 176us (280us total) trans 4294968564 rc 301/301 00000100:00100000:3.0:1790771165.771151:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5599 00000100:00100000:0.0:1790771165.771353:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.771393:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735424 00000100:00100000:2.0:1790771165.771398:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735424 00000100:00100000:2.0:1790771165.771423:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5600 00000100:00100000:2.0:1790771165.771430:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13741:x1877759533735424:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.771438:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.771446:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b4b4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fbc expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.771510:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.771528:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.771556:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b4b4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fbc expref: 106 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.771557:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736064 00000100:00100000:0.0:1790771165.771564:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736064 00000100:00100000:3.0:1790771165.771564:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.771575:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.771579:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.771583:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b4b4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fbc expref: 106 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.771594:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996000, rc 0) 00000100:00100000:3.0:1790771165.771598:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.771610:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1406 00000100:00100000:1.0:1790771165.771620:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735040 00000100:00100000:0.0:1790771165.771624:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13755:x1877759533736064:12345-192.168.204.50@tcp:35:dd.0 00000100:00100000:1.0:1790771165.771625:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735040 00000100:00100000:3.0:1790771165.771633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.771647:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 106 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.771661:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13741:x1877759533735424:12345-192.168.204.50@tcp:101:ls.0 Request processed in 227us (307us total) trans 4294968565 rc 301/301 00000100:00100000:3.0:1790771165.771670:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.771690:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5600 00000100:00100000:1.0:1790771165.771695:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735808 00000100:00100000:1.0:1790771165.771701:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735808 00000100:00100000:2.0:1790771165.771712:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736320 00000100:00100000:2.0:1790771165.771718:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736320 00000100:00100000:1.0:1790771165.771733:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735168 00000100:00100000:1.0:1790771165.771739:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735168 00000100:00100000:2.0:1790771165.771753:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5601 00010000:00010000:1.0:1790771165.771759:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 72 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.771765:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.771767:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14377:x1877759533736320:12345-192.168.204.50@tcp:101:mrename.0 00000001:00080000:0.0:1790771165.771783:0:13790:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969149 00010000:00010000:2.0:1790771165.771784:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.771794:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b4c2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3517c expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.771802:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1536 00000100:00100000:1.0:1790771165.771815:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:2397:x1877759533735040:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.771828:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.771830:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.771836:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 105 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.771841:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.771863:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.771864:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:13755:x1877759533736064:12345-192.168.204.50@tcp:35:dd.0 Request processed in 241us (331us total) trans 4294969150 rc 0/0 00010000:00010000:1.0:1790771165.771864:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 105 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.771864:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.771882:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1406 00000020:00080000:0.0:1790771165.771889:0:13790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771165.771894:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0afba lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e03 expref: 105 pid: 7771 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.771903:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736448 00010000:00010000:1.0:1790771165.771906:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:2.0:1790771165.771909:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736448 00010000:00010000:1.0:1790771165.771912:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.771923:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.771930:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.771934:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 74 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.771955:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0e680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539718400:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.771961:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2397:x1877759533735040:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.771970:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1537 00010000:00010000:0.0:1790771165.771977:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.771981:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1536 00000100:00100000:2.0:1790771165.771984:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533735168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.771998:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.772002:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533722240 00000100:00100000:1.0:1790771165.772006:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1538 00000100:00100000:0.0:1790771165.772008:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533722240 00010000:00010000:2.0:1790771165.772008:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 74 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.772014:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.772022:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533736448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.772031:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 74 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772035:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736704 00010000:00010000:1.0:1790771165.772039:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.772042:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736704 00010000:00010000:1.0:1790771165.772047:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 74 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772051:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0a739 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34bbe expref: 74 pid: 13762 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772070:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5602 00010000:00010000:1.0:1790771165.772072:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 73 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772074:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:0.0:1790771165.772082:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14512:x1877759533722240:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:3.0:1790771165.772083:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5603 00010000:00010000:2.0:1790771165.772084:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.772094:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.772095:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772100:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0af2e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e11 expref: 73 pid: 13769 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772102:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.772111:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fae expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772123:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772128:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfb0321a100) 00000100:00100000:3.0:1790771165.772133:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14597:x1877759533736704:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:1.0:1790771165.772139:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.772144:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 105 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772149:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772152:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.772157:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 105 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772158:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772161:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.772169:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.772173:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.772176:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72a00, rc 0) 00010000:00010000:3.0:1790771165.772178:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0b054 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eb2 expref: 115 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.772180:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:2397:x1877759533735168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (512us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.772184:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.772194:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1537 00000100:00100000:0.0:1790771165.772209:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14512:x1877759533722240:12345-192.168.204.50@tcp:101:rm.0 Request processed in 127us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.772209:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533736448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 189us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.772214:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 723 00000100:00100000:0.0:1790771165.772226:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5602 00000100:00100000:1.0:1790771165.772226:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1538 00000100:00100000:2.0:1790771165.772227:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533735808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.772239:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.772252:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b230 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e8f expref: 70 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772263:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc310f1300) 00010000:00010000:2.0:1790771165.772268:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.772269:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772274:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.772275:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.772282:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.772283:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.772296:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2397:x1877759533735808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.772304:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 723 00000100:00100000:0.0:1790771165.772338:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.772342:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772353:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772354:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772372:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772400:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.772420:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771165.772440:0:13766:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfb04b8b300 with version 0 00000004:00010000:2.0:1790771165.772440:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000023b7cd43 reply state 00000000148276fb transno 4294968566 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772454:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.772458:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772460:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772463:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772476:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771165.772502:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.772504:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772512:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772513:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772521:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772532:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736832 00010000:00010000:2.0:1790771165.772534:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772535:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772537:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736832 00010000:00010000:1.0:1790771165.772538:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772557:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.772562:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736960 00010000:00010000:1.0:1790771165.772564:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772565:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736960 00000100:00100000:2.0:1790771165.772574:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771165.772582:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772589:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1407 00010000:00010000:1.0:1790771165.772595:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfb0321a100) 00000100:00100000:0.0:1790771165.772599:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13057:x1877759533736832:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:1.0:1790771165.772599:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.772603:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.772613:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14536:x1877759533719808:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 21869us (24424us total) trans 4294968566 rc 0/0 00010000:00010000:1.0:1790771165.772614:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b253 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x36:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.772629:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5560 00000004:00200000:0.0:1790771165.772640:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.772645:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771165.772650:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533733888 00000100:00100000:2.0:1790771165.772656:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533733888 00000100:00100000:1.0:1790771165.772669:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14491:x1877759533718016:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 21254us (24775us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771165.772696:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13057:x1877759533736832:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 99us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.772696:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5562 00000100:00100000:2.0:1790771165.772704:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5604 00000100:00100000:0.0:1790771165.772709:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1407 00000100:00100000:2.0:1790771165.772719:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13978:x1877759533733888:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771165.772729:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.772733:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1408 00000100:00100000:1.0:1790771165.772735:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737216 00000100:00100000:1.0:1790771165.772739:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737216 00010000:00010000:2.0:1790771165.772740:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b4e5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35144 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.772746:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14237:x1877759533736960:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771165.772763:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.772770:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 724 00010000:00010000:2.0:1790771165.772774:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.772782:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759533737216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.772784:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.772786:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.772793:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.772797:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.772811:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b2d1 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35033 expref: 70 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772823:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000100:00100000:0.0:1790771165.772824:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14237:x1877759533736960:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 84us (490us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.772827:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.772832:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1408 00000100:00100000:1.0:1790771165.772846:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2397:x1877759533737216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.772854:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 724 00000004:00200000:3.0:1790771165.772858:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x97:0x0]: returning size 8 00010000:00010000:3.0:1790771165.772868:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772872:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b4e5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 108 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772878:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772885:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.772903:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772905:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772909:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 107 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.772926:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772936:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771165.772936:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.772940:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.772943:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.772951:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f200, rc 0) 00010000:00010000:3.0:1790771165.772951:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.772979:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13978:x1877759533733888:12345-192.168.204.50@tcp:101:dd.0 Request processed in 265us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.772988:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5604 00010000:00010000:1.0:1790771165.773001:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0b2bc lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 68 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.773002:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc10471b00) 00010000:00010000:3.0:1790771165.773009:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.773013:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.773019:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b4d7 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773025:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 67 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773030:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.773033:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000099da05dd reply state 000000004cc5f362 transno 4294969151 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773039:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771165.773048:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.773052:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773053:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686e00, rc 0) 00010000:00010000:2.0:1790771165.773064:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773084:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.773092:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14592:x1877759533726464:12345-192.168.204.50@tcp:101:chown.0 Request processed in 20216us (23820us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.773093:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773109:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773117:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.773119:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5573 00010000:00010000:2.0:1790771165.773121:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773128:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773134:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771165.773136:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.773139:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773144:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b4c9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773154:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773159:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773164:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773168:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.773171:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773175:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773184:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc310f2900) 00000100:00100000:0.0:1790771165.773185:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.773190:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.773194:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773199:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b4f3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.773211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.773221:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b4c2 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3517c expref: 66 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.773229:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.773232:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735680 00010000:00010000:2.0:1790771165.773236:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771165.773238:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735680 00010000:00010000:2.0:1790771165.773239:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.773243:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737088 00010000:00010000:2.0:1790771165.773246:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b4c2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3517c expref: 66 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.773248:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737088 00010000:00010000:2.0:1790771165.773258:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996400, rc 0) 00000100:00100000:0.0:1790771165.773269:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5605 00000100:00100000:1.0:1790771165.773276:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5606 00000100:00100000:0.0:1790771165.773278:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13736:x1877759533735680:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.773283:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14396:x1877759533737088:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.773288:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.773290:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14377:x1877759533736320:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 1527us (1658us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771165.773294:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.773298:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b4fa lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fc3 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.773299:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5601 00010000:00010000:1.0:1790771165.773307:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b501 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35183 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773338:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.773346:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.773349:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773360:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.773374:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xea196397 (ffff8bfc10471500) 00010000:00010000:3.0:1790771165.773379:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.773385:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771165.773386:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771165.773387:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.773393:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1790771165.773400:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b4fa lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fc3 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.773412:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:1.0:1790771165.773414:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737344 00010000:00010000:0.0:1790771165.773415:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771165.773417:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737344 00010000:00010000:0.0:1790771165.773420:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b4fa lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fc3 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.773430:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73800, rc 0) 00000100:00100000:1.0:1790771165.773450:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 922 00000100:00100000:1.0:1790771165.773459:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533737344:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771165.773465:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13736:x1877759533735680:12345-192.168.204.50@tcp:101:ls.0 Request processed in 188us (285us total) trans 4294968567 rc 301/301 00010000:00010000:1.0:1790771165.773467:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.773474:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.773479:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5605 00010000:00010000:1.0:1790771165.773479:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4462d94/0xfa0c505d97f0b516 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3518a expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.773533:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737472 00000100:00100000:0.0:1790771165.773537:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737472 00000100:00100000:1.0:1790771165.773550:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539721216:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.773564:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14597:x1877759533736704:12345-192.168.204.50@tcp:36:ln.0 Request processed in 1432us (1551us total) trans 4294969151 rc 0/0 00000100:00100000:0.0:1790771165.773570:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5607 00000100:00100000:3.0:1790771165.773582:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5603 00000100:00100000:0.0:1790771165.773585:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14509:x1877759533737472:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:0.0:1790771165.773596:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.773607:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b51d lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35191 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.773614:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.773622:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.773627:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.773639:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.773645:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737856 00000100:00100000:3.0:1790771165.773651:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737856 00010000:00010000:0.0:1790771165.773657:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.773693:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5608 00000100:00100000:2.0:1790771165.773704:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14395:x1877759533737856:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:2.0:1790771165.773725:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790771165.773738:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0af43 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e26 expref: 68 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.773747:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b51d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 68 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773747:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b501 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773755:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0a1f2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x67:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a4b expref: 67 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773769:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:0.0:1790771165.773773:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 65 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773773:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773773:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.773785:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 3/0,1 mode: --/CW res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.773786:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:0.0:1790771165.773787:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771165.773793:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.773794:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771165.773798:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72000, rc 0) 00010000:00010000:1.0:1790771165.773798:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597200, rc 0) 00010000:00010000:2.0:1790771165.773807:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773814:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773824:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773829:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773834:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.773836:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14396:x1877759533737088:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 552us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.773841:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14509:x1877759533737472:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 260us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.773848:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5606 00000100:00100000:0.0:1790771165.773855:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5607 00010000:00010000:2.0:1790771165.773895:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773909:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 107 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773919:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773943:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 107 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.773955:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 107 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.773970:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539721344:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.774005:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2540 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.784607:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.784629:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.784645:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.784664:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737728 00000100:00100000:0.0:1790771165.784670:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533739776 00000100:00100000:3.0:1790771165.784684:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.784685:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737728 00000100:00100000:0.0:1790771165.784687:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533739776 00000100:00100000:2.0:1790771165.784704:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740032 00000100:00100000:2.0:1790771165.784710:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740032 00000100:00100000:0.0:1790771165.784729:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533736192 00000100:00100000:0.0:1790771165.784735:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533736192 00000100:00100000:1.0:1790771165.784739:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5609 00000100:00100000:3.0:1790771165.784749:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5610 00000100:00100000:1.0:1790771165.784752:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13271:x1877759533739776:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.784759:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5611 00000100:00100000:3.0:1790771165.784764:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13733:x1877759533737728:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.784774:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:11969:x1877759533740032:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.784778:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.784778:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.784783:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.784786:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5612 00010000:00010000:3.0:1790771165.784793:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b540 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fca expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784796:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b547 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351c9 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784797:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0b54e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35159 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.784799:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14008:x1877759533736192:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.784816:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.784828:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b555 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35064 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784862:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784868:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784868:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.784873:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b571 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784879:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784889:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.784902:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b571 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784909:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784912:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784912:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.784914:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b571 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784937:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.784938:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.784939:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784944:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784960:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784965:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784967:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784981:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.784981:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.784985:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.784995:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785003:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b540 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fca expref: 111 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785025:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b571 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fca expref: 110 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785032:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:3.0:1790771165.785034:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.785036:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82e00, rc 0) 00000004:00200000:1.0:1790771165.785052:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.785057:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.785067:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13733:x1877759533737728:12345-192.168.204.50@tcp:101:ls.0 Request processed in 309us (463us total) trans 4294968568 rc 0/0 00000004:00200000:2.0:1790771165.785069:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.785077:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5610 00010000:00010000:2.0:1790771165.785115:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785120:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785125:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785141:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785142:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785149:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785153:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785155:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785158:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.785165:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785179:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.785181:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785181:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785200:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.785202:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785203:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.785208:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785218:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785221:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785221:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b55c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785230:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.785236:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785245:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785247:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785262:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.785264:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785267:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.785272:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785274:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785285:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b563 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785286:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.785292:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785308:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785311:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785319:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785332:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc310f2900) 00010000:00010000:1.0:1790771165.785334:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785339:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.785341:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.785342:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785346:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785346:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.785351:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.785353:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785358:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785365:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0b578 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785376:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0b56a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785377:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785398:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7e200) 00010000:00010000:1.0:1790771165.785403:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.785403:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0b54e lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35159 expref: 67 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785407:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785411:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785423:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771165.785427:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0b57f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785430:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.785432:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785438:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0b54e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35159 expref: 67 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785460:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a800, rc 0) 00010000:00010000:1.0:1790771165.785465:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b547 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c9 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785477:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.785479:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.785482:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0b547 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c9 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.785520:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:11969:x1877759533740032:12345-192.168.204.50@tcp:101:ls.0 Request processed in 750us (871us total) trans 4294968569 rc 301/301 00000100:00100000:2.0:1790771165.785536:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5611 00010000:00010000:3.0:1790771165.785536:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.785542:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596a00, rc 0) 00010000:00010000:3.0:1790771165.785545:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.785550:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785556:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.785566:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7e200) 00010000:00010000:3.0:1790771165.785568:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.785571:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.785581:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:13271:x1877759533739776:12345-192.168.204.50@tcp:101:ls.0 Request processed in 829us (944us total) trans 4294969152 rc 301/301 00010000:00010000:3.0:1790771165.785581:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b58d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.785600:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5609 00002000:00010000:2.0:1790771165.785625:0:8408:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime: 0 -> 1790771165 00010000:00010000:3.0:1790771165.785627:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b555 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35064 expref: 119 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.785632:0:8408:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime: 0 -> 1790771165 00002000:00010000:2.0:1790771165.785639:0:8408:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime: 0 -> 1790771165 00010000:00010000:3.0:1790771165.785640:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.785645:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.785648:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b555 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35064 expref: 119 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.785657:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539718528:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771165.785657:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72e00, rc 0) 00010000:00010000:2.0:1790771165.785697:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0b33a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3505d expref: 25 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785710:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0b33a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3505d expref: 25 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.785719:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00000100:00100000:3.0:1790771165.785743:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14008:x1877759533736192:12345-192.168.204.50@tcp:101:ls.0 Request processed in 946us (1069us total) trans 4294969153 rc 301/301 00000100:00100000:2.0:1790771165.785744:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533727616:12345-192.168.204.50@tcp:101:chown.0 Request processed in 31779us (33073us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.785759:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5612 00000100:00100000:2.0:1790771165.785760:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 910 00000100:00100000:3.0:1790771165.785862:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539718656:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771165.785882:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.785920:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738240 00010000:00010000:3.0:1790771165.785921:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.785925:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738240 00000100:00100000:2.0:1790771165.785938:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.785957:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533733760:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 31680us (32478us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.785960:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 725 00000100:00100000:3.0:1790771165.785971:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1535 00000100:00100000:1.0:1790771165.785975:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:2398:x1877759533738240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.785984:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533739136 00010000:00010000:1.0:1790771165.785985:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.785991:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533739136 00010000:00010000:1.0:1790771165.786000:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b302 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f68 expref: 66 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786014:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771165.786016:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.786030:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1409 00000100:00100000:0.0:1790771165.786039:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:13261:x1877759533739136:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.786045:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2398:x1877759533738240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.786052:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 725 00000100:00100000:0.0:1790771165.786120:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13261:x1877759533739136:12345-192.168.204.50@tcp:35:ls.0 Request processed in 83us (184us total) trans 4294969154 rc 0/0 00000100:00100000:0.0:1790771165.786126:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1409 00000100:00100000:2.0:1790771165.786276:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.786298:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.786316:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738880 00000100:00100000:0.0:1790771165.786320:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738880 00000100:00100000:1.0:1790771165.786330:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533735296 00000100:00100000:1.0:1790771165.786335:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533735296 00000100:00100000:0.0:1790771165.786361:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 375 00000100:00100000:0.0:1790771165.786372:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533738880:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771165.786378:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5613 00000100:00100000:1.0:1790771165.786389:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14203:x1877759533735296:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771165.786397:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.786404:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0b5a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35175 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786420:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b5b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786428:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786434:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786518:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0b5a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35175 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786531:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35175 expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.786536:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771165.786538:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771165.786540:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597a00, rc 0) 00002000:00010000:0.0:1790771165.786566:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb size from disk: 5134 -> 5134 00000100:00100000:1.0:1790771165.786568:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14203:x1877759533735296:12345-192.168.204.50@tcp:101:cp.0 Request processed in 182us (269us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771165.786572:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb mtime from disk: 1790771163 -> 1790771163 00002000:00010000:0.0:1790771165.786576:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1790771165.786577:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5613 00002000:00010000:0.0:1790771165.786579:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb ctime from disk: 1790771164 -> 1790771164 00002000:00010000:0.0:1790771165.786582:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb blocks from disk: 0 -> 56 00000100:00100000:2.0:1790771165.786614:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.786623:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533738880:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 252us (344us total) trans 4294967593 rc 0/0 00000100:00100000:0.0:1790771165.786629:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 375 00000100:00100000:3.0:1790771165.786701:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533739520 00000100:00100000:3.0:1790771165.786706:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533739520 00000100:00100000:3.0:1790771165.786737:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5614 00000100:00100000:3.0:1790771165.786803:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14359:x1877759533739520:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:3.0:1790771165.786862:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14359:x1877759533739520:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 118us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.786871:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5614 00000100:00100000:2.0:1790771165.816753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.816783:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.816803:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.816823:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533739904 00000100:00100000:3.0:1790771165.816823:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738752 00000100:00100000:2.0:1790771165.816832:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.816834:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533739904 00000100:00100000:3.0:1790771165.816835:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738752 00000100:00100000:1.0:1790771165.816856:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740800 00000100:00100000:2.0:1790771165.816861:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740928 00000100:00100000:1.0:1790771165.816863:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740800 00000100:00100000:2.0:1790771165.816868:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740928 00002000:00010000:0.0:1790771165.816880:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (13777->18446744073709551615) 00002000:00100000:0.0:1790771165.816888:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c34000 with x1877759533739904 ext(13777->18446744073709551615) 00000100:00100000:3.0:1790771165.816900:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5615 00010000:00010000:0.0:1790771165.816906:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 29 pid: 8676 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.816913:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14383:x1877759533738752:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:1.0:1790771165.816923:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1410 00000100:00100000:2.0:1790771165.816925:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 923 00010000:00010000:0.0:1790771165.816930:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 29 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.816935:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1790771165.816939:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb05c34000. 00000100:00100000:1.0:1790771165.816943:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14234:x1877759533740800:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:2.0:1790771165.816945:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:13051:x1877759533740928:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1790771165.816953:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b5b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351bb expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.816958:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.816965:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 84 00010000:00010000:2.0:1790771165.816971:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351d7 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.816977:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759533739904:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:2.0:1790771165.817006:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.817007:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.817013:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.817023:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x19:0x0].0x0 since=1s v=(4 2) 00010000:00010000:3.0:1790771165.817025:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817029:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(5 2) 00010000:00010000:2.0:1790771165.817041:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [10485760->10551295] (req 10485760->10551295) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 30 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817043:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817064:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817075:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14234:x1877759533740800:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 140us (270us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.817083:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817084:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1410 00010000:00010000:2.0:1790771165.817099:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 27 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.817112:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539721472:192.168.204.50@tcp:104: 00000004:00200000:3.0:1790771165.817128:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.817133:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1790771165.817146:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817171:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b5b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351bb expref: 121 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817172:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.817174:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a2900 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.817198:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351bb expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.817199:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741056 00000100:00100000:2.0:1790771165.817204:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741056 00010000:00010000:3.0:1790771165.817220:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:3.0:1790771165.817225:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771165.817229:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82400, rc 0) 00000100:00100000:2.0:1790771165.817241:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 924 00000100:00100000:1.0:1790771165.817242:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.817254:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:14509:x1877759533741056:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:3.0:1790771165.817263:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14383:x1877759533738752:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 349us (472us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.817265:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1790771165.817267:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 31645 -> 13777 00002000:00010000:0.0:1790771165.817273:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771164 00002000:00010000:0.0:1790771165.817277:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:2.0:1790771165.817277:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351de expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817279:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5615 00002000:00010000:0.0:1790771165.817283:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771164 00002000:00010000:0.0:1790771165.817290:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 32 -> 16 00000100:00100000:1.0:1790771165.817292:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.817307:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533737984 00010000:00010000:2.0:1790771165.817313:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 31 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817314:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533737984 00010000:00010000:2.0:1790771165.817325:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000400:0xd:0x0].0x0 since=1s v=(1 0) 00000100:00100000:0.0:1790771165.817328:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2399:x1877759533739904:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 353us (578us total) trans 4294967586 rc 0/0 00010000:00010000:2.0:1790771165.817331:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00000100:00100000:3.0:1790771165.817339:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740160 00010000:00010000:2.0:1790771165.817344:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 4/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 29 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817344:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740160 00000100:00100000:0.0:1790771165.817347:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 84 00002000:00010000:0.0:1790771165.817355:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (13777->18446744073709551615) 00002000:00100000:0.0:1790771165.817361:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c34000 with x1877759533739904 ext(13777->18446744073709551615) 00000100:00100000:3.0:1790771165.817372:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5616 00010000:00010000:0.0:1790771165.817374:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 31 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817378:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 31 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817384:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.817388:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14400:x1877759533737984:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771165.817412:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 31 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817413:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 31 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817424:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771165.817441:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb05c34000. 00000100:00100000:2.0:1790771165.817445:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539721600:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.817447:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.817472:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741440 00010000:00010000:3.0:1790771165.817476:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.817477:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741440 00000100:00100000:2.0:1790771165.817529:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb056a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.817530:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.817534:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741568 00000100:00100000:0.0:1790771165.817538:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741568 00000100:00100000:0.0:1790771165.817564:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741696 00000100:00100000:0.0:1790771165.817566:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741696 00010000:00010000:3.0:1790771165.817586:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b5d3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3519f expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.817597:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5617 00000100:00100000:1.0:1790771165.817600:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.817609:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13742:x1877759533740160:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.817618:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.817626:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.817627:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b5da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351d0 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817649:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533742208 00000100:00100000:2.0:1790771165.817649:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741184 00000100:00100000:1.0:1790771165.817655:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533742208 00000100:00100000:2.0:1790771165.817657:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741184 00010000:00010000:3.0:1790771165.817670:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817694:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.817699:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.817701:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5618 00010000:00010000:3.0:1790771165.817704:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.817715:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5619 00000100:00100000:1.0:1790771165.817716:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14361:x1877759533741440:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:0.0:1790771165.817726:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.817732:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13975:x1877759533741568:12345-192.168.204.50@tcp:101:rm.0 00000004:00200000:3.0:1790771165.817737:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 32696 00000004:00200000:3.0:1790771165.817744:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771165.817747:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.817751:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.817751:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1790771165.817757:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817759:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b5ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351ec expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.817769:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0abbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d4d expref: 121 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817782:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b5d3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 112 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.817785:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771165.817793:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1790771165.817797:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.817801:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771165.817803:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817805:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 111 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.817814:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817820:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817828:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771165.817836:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.817840:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72e00, rc 0) 00010000:00010000:2.0:1790771165.817842:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.817850:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b5da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 123 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817867:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817872:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14400:x1877759533737984:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 487us (631us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.817873:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 122 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.817891:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817891:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5616 00010000:00010000:0.0:1790771165.817899:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:0.0:1790771165.817903:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.817906:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2c00, rc 0) 00010000:00010000:2.0:1790771165.817906:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817912:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5620 00010000:00010000:1.0:1790771165.817922:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.817923:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:13894:x1877759533741696:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771165.817938:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13742:x1877759533740160:12345-192.168.204.50@tcp:101:ls.0 Request processed in 330us (651us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.817948:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00000100:00100000:0.0:1790771165.817949:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5617 00010000:00010000:1.0:1790771165.817951:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.817962:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817966:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f05076 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x48:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32d1e expref: 65 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.817975:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5621 00010000:00010000:2.0:1790771165.817977:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.817987:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14701:x1877759533742208:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:2.0:1790771165.817991:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.817992:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b284 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f76 expref: 64 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.818001:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:1.0:1790771165.818004:0:13766:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969155 00010000:00010000:0.0:1790771165.818014:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351fa expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818018:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.818025:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f04e0e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32c5a expref: 63 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.818028:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000066c81963 reply state 000000000c8760d8 transno 4294969156 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.818043:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818052:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.818052:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.818056:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.818058:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.818058:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f04643 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x48:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32a23 expref: 62 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.818072:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818073:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:0.0:1790771165.818080:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818081:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.818086:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x48:0x0].0x0 (ffff8bfb0321e300) 00000100:00100000:1.0:1790771165.818087:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771165.818098:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.818102:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0a8dd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c43 expref: 61 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818110:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.818111:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.818114:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00000004:00200000:0.0:1790771165.818118:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.818123:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.818126:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.818133:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.818133:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14361:x1877759533741440:12345-192.168.204.50@tcp:36:dd.0 Request processed in 421us (753us total) trans 4294969156 rc 0/0 00010000:00010000:3.0:1790771165.818135:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818136:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.818155:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5618 00010000:00010000:2.0:1790771165.818160:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a400 already unused, calling callback (ffffffffc18aa4f0) 00000020:00080000:1.0:1790771165.818163:0:13766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771165.818165:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.818168:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 110 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.818169:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351fa expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.818181:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5622 00010000:00010000:2.0:1790771165.818182:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.818195:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14458:x1877759533741184:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771165.818201:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818207:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.818207:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771165.818208:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351fa expref: 124 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818214:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.818218:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b627 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351e5 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818221:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.818226:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:0.0:1790771165.818235:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.818236:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 110 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.818240:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00010000:00010000:2.0:1790771165.818243:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b5f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818254:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.818262:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 110 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.818270:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14701:x1877759533742208:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 284us (641us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.818282:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.818291:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5621 00010000:00010000:1.0:1790771165.818299:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818300:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.818304:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06192680 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539721728:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.818317:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533741952 00010000:00010000:1.0:1790771165.818320:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818321:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.818323:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533741952 00010000:00010000:2.0:1790771165.818338:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.818339:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c356c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.818344:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818355:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818364:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc310f2900) 00000100:00100000:0.0:1790771165.818366:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1411 00010000:00010000:2.0:1790771165.818368:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.818373:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.818379:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14320:x1877759533741952:12345-192.168.204.50@tcp:35:file_concat.sh.0 00010000:00010000:2.0:1790771165.818379:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b5fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818400:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0b627 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 123 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818417:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b5ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ec expref: 125 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818419:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 122 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.818437:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771165.818439:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771165.818442:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597800, rc 0) 00010000:00010000:2.0:1790771165.818443:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ec expref: 124 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.818455:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:2.0:1790771165.818458:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.818461:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f400, rc 0) 00000100:00100000:1.0:1790771165.818470:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14458:x1877759533741184:12345-192.168.204.50@tcp:101:chown.0 Request processed in 278us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.818477:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5622 00000100:00100000:2.0:1790771165.818519:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13975:x1877759533741568:12345-192.168.204.50@tcp:101:rm.0 Request processed in 791us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.818525:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5619 00000001:00080000:0.0:1790771165.818530:0:6497:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969157 00000100:00100000:0.0:1790771165.818599:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14320:x1877759533741952:12345-192.168.204.50@tcp:35:file_concat.sh.0 Request processed in 223us (1071us total) trans 4294969158 rc 0/0 00000100:00100000:0.0:1790771165.818605:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1411 00000020:00080000:0.0:1790771165.818608:0:6497:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790771165.818810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.818846:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533743232 00000100:00100000:2.0:1790771165.818852:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533743232 00000100:00100000:2.0:1790771165.818886:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1412 00000100:00100000:2.0:1790771165.818895:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13208:x1877759533743232:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.819010:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13208:x1877759533743232:12345-192.168.204.50@tcp:35:ls.0 Request processed in 113us (196us total) trans 4294968570 rc 0/0 00000100:00100000:2.0:1790771165.819019:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1412 00000100:00100000:0.0:1790771165.819241:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb029c3800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539719808:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.819268:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539720960:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.819269:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539719936:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.819281:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.819282:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539721088:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.819300:0:13796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.819308:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.819312:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.819315:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738112 00000100:00100000:1.0:1790771165.819320:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738112 00000100:00100000:1.0:1790771165.819351:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5623 00000100:00100000:1.0:1790771165.819357:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13737:x1877759533738112:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.819364:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.819373:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b635 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351a6 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819402:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819410:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819415:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.819432:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.819434:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.819441:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819452:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b635 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351a6 expref: 114 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819462:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351a6 expref: 113 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819468:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771165.819469:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.819471:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8800, rc 0) 00000100:00100000:1.0:1790771165.819516:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:13737:x1877759533738112:12345-192.168.204.50@tcp:101:ls.0 Request processed in 158us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.819522:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5623 00000100:00100000:3.0:1790771165.819827:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.819847:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.819864:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533743744 00000100:00100000:0.0:1790771165.819871:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533743744 00000100:00100000:1.0:1790771165.819878:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533743872 00000100:00100000:1.0:1790771165.819885:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533743872 00000100:00100000:0.0:1790771165.819907:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5624 00000100:00100000:0.0:1790771165.819915:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:14592:x1877759533743744:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:1.0:1790771165.819929:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5625 00000100:00100000:1.0:1790771165.819941:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:12123:x1877759533743872:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.819949:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819950:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.819963:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819964:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35216 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.819980:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819991:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.819999:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.820004:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.820006:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.820008:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9400, rc 0) 00000100:00100000:1.0:1790771165.820033:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:12123:x1877759533743872:12345-192.168.204.50@tcp:101:ls.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.820037:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5625 00000040:00080000:0.0:1790771165.820176:0:12030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 88 off9696 00000004:00080000:0.0:1790771165.820182:0:12030:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 166025695881ns, next at 167025694229ns, rc = 0 00000004:00010000:0.0:1790771165.820206:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002d4597c1 reply state 00000000e9b1516e transno 4294968571 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.820214:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.820223:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771165.820224:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771165.820226:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771165.820271:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14592:x1877759533743744:12345-192.168.204.50@tcp:36:chown.0 Request processed in 357us (443us total) trans 4294968571 rc 0/0 00000100:00100000:0.0:1790771165.820277:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5624 00000100:00100000:3.0:1790771165.823174:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.823203:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.823226:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.823243:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744000 00000100:00100000:3.0:1790771165.823249:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.823250:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744000 00000100:00100000:2.0:1790771165.823267:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744128 00000100:00100000:2.0:1790771165.823273:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744128 00000100:00100000:1.0:1790771165.823275:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738368 00000100:00100000:1.0:1790771165.823281:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738368 00000100:00100000:0.0:1790771165.823283:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738496 00000100:00100000:3.0:1790771165.823289:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.823290:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738496 00000100:00100000:2.0:1790771165.823307:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533743616 00000100:00100000:2.0:1790771165.823313:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533743616 00000100:00100000:1.0:1790771165.823326:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5626 00000100:00100000:3.0:1790771165.823336:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5627 00000100:00100000:1.0:1790771165.823338:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:11823:x1877759533744000:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.823348:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.823349:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5628 00000100:00100000:3.0:1790771165.823349:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:12119:x1877759533744128:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.823358:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3521d expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.823362:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5629 00010000:00010000:3.0:1790771165.823363:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.823369:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14362:x1877759533738368:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.823376:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35224 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.823381:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14452:x1877759533738496:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.823384:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.823386:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 66 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.823397:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.823400:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b65f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351ad expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823403:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 67 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.823408:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 67 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.823409:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b666 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351b4 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823437:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.823441:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.823443:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373400, rc 0) 00010000:00010000:3.0:1790771165.823447:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 67 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.823455:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771165.823457:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.823460:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1be00, rc 0) 00000100:00100000:1.0:1790771165.823472:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:11823:x1877759533744000:12345-192.168.204.50@tcp:101:ls.0 Request processed in 138us (298us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.823475:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.823481:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.823482:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5626 00000100:00100000:3.0:1790771165.823513:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:12119:x1877759533744128:12345-192.168.204.50@tcp:101:ls.0 Request processed in 141us (281us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.823528:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.823531:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5627 00010000:00010000:2.0:1790771165.823532:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.823544:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5630 00010000:00010000:0.0:1790771165.823546:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.823552:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.823558:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14382:x1877759533743616:12345-192.168.204.50@tcp:101:getfattr.0 00000004:00200000:0.0:1790771165.823566:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00000004:00200000:0.0:1790771165.823570:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771165.823572:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1790771165.823580:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 32696 00010000:00010000:1.0:1790771165.823583:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b67b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3520f expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771165.823584:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.823584:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.823599:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.823638:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b65f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 118 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823640:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.823643:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b666 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351b4 expref: 118 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823662:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.823668:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823688:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.823688:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351b4 expref: 116 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.823696:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771165.823706:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.823714:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771165.823715:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339c00, rc 0) 00010000:00010000:2.0:1790771165.823718:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.823722:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00000004:00200000:1.0:1790771165.823744:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.823748:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1790771165.823757:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.823759:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14362:x1877759533738368:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 397us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.823766:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14452:x1877759533738496:12345-192.168.204.50@tcp:101:chown.0 Request processed in 388us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.823779:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5628 00000100:00100000:2.0:1790771165.823787:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5629 00010000:00010000:1.0:1790771165.823790:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b67b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3520f expref: 124 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823805:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3520f expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.823811:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771165.823813:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.823816:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00000100:00100000:1.0:1790771165.823843:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14382:x1877759533743616:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 290us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.823849:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5630 00000100:00100000:3.0:1790771165.824182:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.824211:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.824214:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533746432 00000100:00100000:1.0:1790771165.824219:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533746432 00000100:00100000:3.0:1790771165.824242:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.824243:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533746688 00000100:00100000:1.0:1790771165.824247:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533746688 00000100:00100000:1.0:1790771165.824268:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1413 00000100:00100000:1.0:1790771165.824274:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13265:x1877759533746432:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771165.824279:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1414 00000100:00100000:2.0:1790771165.824292:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:13891:x1877759533746688:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771165.824313:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533739392 00000100:00100000:3.0:1790771165.824319:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533739392 00000100:00100000:3.0:1790771165.824350:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5631 00000100:00100000:3.0:1790771165.824357:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14444:x1877759533739392:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771165.824366:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.824376:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b689 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351c2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.824399:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:13891:x1877759533746688:12345-192.168.204.50@tcp:35:ls.0 Request processed in 111us (188us total) trans 4294968572 rc 0/0 00000100:00100000:2.0:1790771165.824405:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1414 00010000:00010000:3.0:1790771165.824420:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.824429:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.824436:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.824450:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4325376 00000004:00200000:3.0:1790771165.824453:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771165.824461:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.824476:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0b689 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.824552:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 116 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.824562:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771165.824564:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.824566:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00000100:00100000:3.0:1790771165.824593:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14444:x1877759533739392:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 237us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.824598:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5631 00000100:00100000:0.0:1790771165.825434:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.825522:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533747072 00000100:00100000:1.0:1790771165.825527:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533747072 00000100:00100000:1.0:1790771165.825562:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5632 00000100:00100000:1.0:1790771165.825570:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14437:x1877759533747072:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.825599:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825609:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 125 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825617:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825623:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825638:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825646:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 123 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.825654:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539721856:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.825721:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 125 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.825730:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 125 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.825738:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539721984:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.825758:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35fcf180 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.826162:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13265:x1877759533746432:12345-192.168.204.50@tcp:37:ls.0 Request processed in 1887us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.826168:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1413 00000100:00100000:0.0:1790771165.832404:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.832437:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.832458:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745152 00000100:00100000:2.0:1790771165.832464:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745152 00000100:00100000:0.0:1790771165.832473:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.832503:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 124 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.832517:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745536 00000100:00100000:3.0:1790771165.832523:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745536 00000100:00100000:0.0:1790771165.832529:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.832533:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745408 00000100:00100000:2.0:1790771165.832537:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745408 00000100:00100000:1.0:1790771165.832541:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1539 00010000:00010000:3.0:1790771165.832547:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.832558:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2396:x1877759533745152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.832559:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 125 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.832568:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.832576:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.832581:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745664 00010000:00010000:1.0:1790771165.832585:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 124 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.832587:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745664 00000100:00100000:2.0:1790771165.832597:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1540 00010000:00010000:1.0:1790771165.832604:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 124 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832606:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 31 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.832611:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1541 00000100:00100000:2.0:1790771165.832613:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533745536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.832630:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2396:x1877759533745408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.832634:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.832639:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0b1a4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f1b expref: 124 pid: 13761 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.832641:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.832646:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.832650:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1542 00010000:00010000:0.0:1790771165.832654:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 125 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.832661:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfb03188100) 00000100:00100000:3.0:1790771165.832666:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2396:x1877759533745664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.832684:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.832695:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832696:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.832701:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832705:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 31 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.832723:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.832729:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 125 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832739:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 31 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.832749:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000912db2d3/0xfa0c505d97f03120 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32323 expref: 25 pid: 12031 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.832751:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0a086 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349a3 expref: 125 pid: 13770 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.832758:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759533745152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 204us (353us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.832775:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024382bc3/0xfa0c505d97f08e34 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34313 expref: 31 pid: 8409 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.832780:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1539 00010000:00010000:2.0:1790771165.832781:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=1s v=(1 4) 00010000:00010000:0.0:1790771165.832783:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfb03188100) 00010000:00010000:2.0:1790771165.832792:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(1 4) 00010000:00010000:0.0:1790771165.832793:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.832799:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832799:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x13:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1790771165.832803:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832809:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771165.832819:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.832827:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.832827:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.832829:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 4/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.832841:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.832872:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.832872:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.832876:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.832897:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2396:x1877759533745664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 236us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.832904:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1542 00000100:00100000:0.0:1790771165.832910:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2396:x1877759533745408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 285us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.832918:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533745536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 309us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.832924:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1541 00010000:00010000:3.0:1790771165.832927:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.832937:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1540 00000100:00100000:1.0:1790771165.832943:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.832959:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748224 00000100:00100000:0.0:1790771165.832964:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748224 00000100:00100000:0.0:1790771165.832994:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748352 00000100:00100000:0.0:1790771165.832997:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748352 00010000:00010000:2.0:1790771165.833018:0:13796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.833024:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1415 00000100:00100000:1.0:1790771165.833035:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539721216:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.833039:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:13057:x1877759533748224:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771165.833044:0:13796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.833050:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833060:0:13796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.833064:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4462d94/0xfa0c505d97f0b516 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3518a expref: 29 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833072:0:13796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.833084:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4462d94/0xfa0c505d97f0b516 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3518a expref: 29 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.833089:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.833091:0:13796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00200000:0.0:1790771165.833097:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.833108:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.833114:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00010000:00010000:3.0:1790771165.833117:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.833135:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:13057:x1877759533748224:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 100us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.833136:0:13782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1790771165.833144:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533737344:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 59684us (59759us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.833161:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1415 00000100:00100000:1.0:1790771165.833161:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 922 00000100:00100000:0.0:1790771165.833187:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1416 00000100:00100000:0.0:1790771165.833196:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14237:x1877759533748352:12345-192.168.204.50@tcp:33:getfattr.0 00000004:00200000:0.0:1790771165.833221:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.833221:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3626:x1877759539720320:12345-0@lo:6:osp-syn-0-0.0 Request processed in 74129us (74406us total) trans 4294967594 rc 0/0 00000004:00200000:0.0:1790771165.833227:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00080000:1.0:1790771165.833228:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb0562dc00/2, rc 0, transno 4294967594 00000100:00100000:2.0:1790771165.833232:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1790771165.833243:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539720320:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790771165.833256:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14237:x1877759533748352:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 61us (316us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.833257:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790771165.833265:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.833266:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1416 00010000:00010000:2.0:1790771165.833277:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.833281:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833288:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833302:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833311:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce413f94/0xfa0c505d97f0b436 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.833321:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833328:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771165.833331:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833335:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833356:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771165.833359:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833365:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833375:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833381:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ade628be/0xfa0c505d97f0b43d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.833397:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771165.833400:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790771165.833401:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb04971180/2, rc 0, transno 4294967587 00010000:00010000:2.0:1790771165.833403:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771165.833413:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.833414:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539720064:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1790771165.833416:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748096 00000100:00100000:2.0:1790771165.833423:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748096 00010000:00010000:0.0:1790771165.833431:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.833439:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.833441:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+11:3624:x1877759539720064:12345-0@lo:6:osp-syn-1-1.0 Request processed in 74330us (74578us total) trans 4294967587 rc 0/0 00002000:00100000:2.0:1790771165.833448:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (462848->466943) req@ffff8bfb029c3800 x1877759533748096/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771165.833460:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.833460:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00010000:00010000:0.0:1790771165.833468:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.833469:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb029c3800 with x1877759533748096 ext(462848->466943) 00002000:00010000:2.0:1790771165.833476:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb029c3800 00010000:00010000:0.0:1790771165.833479:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.833521:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfb03188100) 00000100:00100000:2.0:1790771165.833526:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 376 00010000:00010000:0.0:1790771165.833528:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771165.833528:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.833535:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.833538:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533748096:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771165.833548:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0b35d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.833588:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.833601:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14441:x1877759533727488:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 79173us (81902us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771165.833609:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5580 00000100:00100000:0.0:1790771165.833633:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744512 00000100:00100000:1.0:1790771165.833636:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.833638:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744512 00000100:00100000:2.0:1790771165.833688:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533748096:12345-192.168.204.50@tcp:3:cat.0 Request processed in 140us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.833696:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 376 00010000:00010000:3.0:1790771165.833698:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771165.833701:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5633 00002000:00100000:2.0:1790771165.833705:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (462848->466943) req@ffff8bfb029c3800 x1877759533748096/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.833715:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:11826:x1877759533744512:12345-192.168.204.50@tcp:101:ls.0 00002000:00100000:2.0:1790771165.833716:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb029c3800 with x1877759533748096 ext(462848->466943) 00002000:00010000:2.0:1790771165.833725:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb029c3800 00010000:00010000:1.0:1790771165.833729:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.833740:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35239 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.833744:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748608 00000100:00100000:2.0:1790771165.833750:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748992 00000100:00100000:3.0:1790771165.833750:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748608 00000100:00100000:0.0:1790771165.833755:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.833757:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748992 00010000:00010000:1.0:1790771165.833759:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 68 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.833770:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 68 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.833776:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.833779:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.833782:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372200, rc 0) 00000100:00100000:3.0:1790771165.833795:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1417 00000100:00100000:2.0:1790771165.833803:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1418 00000100:00100000:1.0:1790771165.833808:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:11826:x1877759533744512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.833809:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14015:x1877759533748608:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:2.0:1790771165.833820:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14396:x1877759533748992:12345-192.168.204.50@tcp:35:chmod.0 00000100:00100000:1.0:1790771165.833826:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5633 00000100:00100000:1.0:1790771165.833851:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533747840 00000100:00100000:1.0:1790771165.833855:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533747840 00000100:00100000:0.0:1790771165.833879:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.833891:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533749376 00000100:00100000:1.0:1790771165.833896:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533749376 00010000:00010000:1.0:1790771165.833918:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 116 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.833938:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.833939:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14396:x1877759533748992:12345-192.168.204.50@tcp:35:chmod.0 Request processed in 120us (301us total) trans 4294969159 rc 0/0 00000100:00100000:1.0:1790771165.833948:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1543 00000100:00100000:2.0:1790771165.833955:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1418 00000100:00100000:1.0:1790771165.833961:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2396:x1877759533749376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.833968:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14015:x1877759533748608:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 163us (379us total) trans 4294969160 rc 0/0 00010000:00010000:1.0:1790771165.833974:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.833982:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 116 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.833982:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1417 00000100:00100000:0.0:1790771165.833988:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.834002:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 116 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.834013:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539721344:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.834016:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533749120 00010000:00010000:1.0:1790771165.834018:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f08b47 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x67:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34210 expref: 116 pid: 6493 timeout: 265 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834021:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533749120 00000100:00100000:0.0:1790771165.834031:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.834040:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:2.0:1790771165.834040:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834047:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834049:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533742336 00000100:00100000:3.0:1790771165.834054:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533742336 00010000:00010000:1.0:1790771165.834061:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834066:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834076:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744384 00000100:00100000:3.0:1790771165.834080:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744384 00010000:00010000:1.0:1790771165.834082:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.834087:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834094:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.834102:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.834114:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2396:x1877759533749376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.834120:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1543 00000100:00100000:1.0:1790771165.834137:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 726 00000100:00100000:1.0:1790771165.834148:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2398:x1877759533747840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.834153:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.834158:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.834170:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596800/0xfa0c505d97f0b483 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35160 expref: 69 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834172:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533732608 00000100:00100000:3.0:1790771165.834179:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533732608 00010000:00010000:1.0:1790771165.834183:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771165.834188:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.834189:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.834210:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2398:x1877759533747840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.834219:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 726 00000100:00100000:0.0:1790771165.834223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771165.834255:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x67:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.834259:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744256 00000100:00100000:1.0:1790771165.834263:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744256 00010000:00010000:2.0:1790771165.834267:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834275:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.834284:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.834286:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744640 00010000:00010000:2.0:1790771165.834286:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834291:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744640 00010000:00010000:2.0:1790771165.834294:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.834298:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834306:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834310:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533750656 00000100:00100000:1.0:1790771165.834314:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533750656 00000100:00100000:0.0:1790771165.834320:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.834321:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x67:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:2.0:1790771165.834327:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771165.834331:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834337:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5634 00010000:00010000:2.0:1790771165.834345:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b539 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x67:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834347:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14661:x1877759533749120:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:0.0:1790771165.834348:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533750400 00000100:00100000:0.0:1790771165.834356:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533750400 00000004:00100000:3.0:1790771165.834360:0:13762:0:(mdt_mds.c:171:ldlm_enqueue_hpreq_check()) @@@ lock 000000008771ae86 cookie 0x61116bf958e34fa0 req@ffff8bfb06542300 x1877759533732608/t0(0) o101->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 376/0 e 0 to 0 dl 1790771176 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000004:00010000:3.0:1790771165.834374:0:13762:0:(mdt_mds.c:175:ldlm_enqueue_hpreq_check()) ### hpreq resend ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa0 expref: 70 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834375:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.834380:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.834387:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533750528 00010000:00010000:1.0:1790771165.834392:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0b44b lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3514b expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.834393:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533750528 00010000:00010000:2.0:1790771165.834396:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834408:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834413:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfc10471200) 00010000:00010000:2.0:1790771165.834414:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834418:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 107 00010000:00010000:1.0:1790771165.834426:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.834427:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.834432:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.834433:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14017:x1877759533732608:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:0.0:1790771165.834442:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1419 00010000:00010000:2.0:1790771165.834448:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 5/0,0 mode: CW/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.834449:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.834454:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1790771165.834458:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14234:x1877759533750400:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:3.0:1790771165.834459:0:13762:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0a858) 00010000:00010000:2.0:1790771165.834461:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc310f2c00) 00010000:00010000:3.0:1790771165.834464:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.834469:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.834474:0:13762:0:(ldlm_lockd.c:1319:ldlm_handle_enqueue()) @@@ found existing lock cookie 0xfa0c505d97f0b421 req@ffff8bfb06542300 x1877759533732608/t0(0) o101->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 376/0 e 0 to 0 dl 1790771176 ref 1 fl Interpret:H/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771165.834475:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 3/0,0 mode: --/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834509:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b52b lrc: 0/0,0 mode: --/CW res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834517:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14661:x1877759533749120:12345-192.168.204.50@tcp:36:ln.0 Request processed in 139us (553us total) trans 0 rc -17/-17 00000004:00200000:0.0:1790771165.834520:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.834527:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.834531:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000022c45e51 reply state 0000000053f2b3d3 transno 4294968573 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.834537:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5634 00010000:00010000:2.0:1790771165.834546:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.834548:0:13762:0:(mdt_recovery.c:90:mdt_req_from_lrd()) @@@ restoring transno req@ffff8bfb06542300 x1877759533732608/t0(0) o101->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 376/816 e 0 to 0 dl 1790771176 ref 1 fl Interpret:H/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.834560:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5635 00000100:00100000:0.0:1790771165.834564:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14234:x1877759533750400:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 107us (343us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.834565:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x1d91fb2c (ffff8bfc310f2400) 00010000:00010000:2.0:1790771165.834571:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.834576:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14633:x1877759533742336:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:2.0:1790771165.834576:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00000400:3.0:1790771165.834583:0:13762:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff8bfb06542300 x1877759533732608/t4294968563(0) o101->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 376/816 e 0 to 0 dl 1790771176 ref 1 fl Interpret:H/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771165.834586:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1419 00010000:00010000:1.0:1790771165.834589:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.834601:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b6a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35201 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.834609:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1420 00000100:00100000:2.0:1790771165.834624:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13271:x1877759533750528:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771165.834631:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5636 00010000:00010000:1.0:1790771165.834637:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.834643:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:12118:x1877759533744384:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.834652:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834657:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.834660:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834685:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35232 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.834701:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 25161 00000004:00200000:1.0:1790771165.834705:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771165.834711:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 72 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.834717:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834730:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834731:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 72 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.834739:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13271:x1877759533750528:12345-192.168.204.50@tcp:35:ls.0 Request processed in 115us (418us total) trans 4294969161 rc 0/0 00010000:00010000:0.0:1790771165.834756:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771165.834760:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1420 00010000:00010000:1.0:1790771165.834762:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b6a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35201 expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834763:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.834768:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339000, rc 0) 00010000:00010000:1.0:1790771165.834781:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35201 expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.834787:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771165.834789:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771165.834792:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373c00, rc 0) 00000100:00100000:0.0:1790771165.834797:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:12118:x1877759533744384:12345-192.168.204.50@tcp:101:ls.0 Request processed in 157us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.834802:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14395:x1877759533737856:12345-192.168.204.50@tcp:36:rm.0 Request processed in 61098us (61181us total) trans 4294968573 rc 0/0 00000100:00100000:0.0:1790771165.834810:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5636 00000100:00100000:2.0:1790771165.834819:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5608 00000100:00100000:1.0:1790771165.834820:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14633:x1877759533742336:12345-192.168.204.50@tcp:101:chown.0 Request processed in 246us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.834830:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5637 00000100:00100000:1.0:1790771165.834838:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5635 00000100:00100000:0.0:1790771165.834844:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14412:x1877759533744256:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:2.0:1790771165.834846:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5638 00000100:00100000:1.0:1790771165.834857:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5639 00000100:00100000:2.0:1790771165.834865:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:12120:x1877759533744640:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.834866:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.834871:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14368:x1877759533750656:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:0.0:1790771165.834881:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b6ba lrc: 2/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3522b expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.834884:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.834899:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35240 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834930:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834940:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834947:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.834960:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000004:00200000:0.0:1790771165.834962:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.834972:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.834990:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b6ba lrc: 0/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 117 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835004:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835010:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771165.835013:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.835015:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2600, rc 0) 00000100:00100000:0.0:1790771165.835037:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14412:x1877759533744256:12345-192.168.204.50@tcp:101:ln.0 Request processed in 200us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.835046:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5637 00010000:00010000:2.0:1790771165.835141:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 71 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.835148:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539721472:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.835155:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 71 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.835162:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.835164:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [10485760->10551295] (req 10485760->10551295) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 29 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.835166:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.835171:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996000, rc 0) 00010000:00010000:0.0:1790771165.835180:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a800, rc 0) 00000100:00100000:2.0:1790771165.835200:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:12120:x1877759533744640:12345-192.168.204.50@tcp:101:ls.0 Request processed in 341us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.835205:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:13051:x1877759533740928:12345-192.168.204.50@tcp:101:dd.0 Request processed in 18267us (18370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.835212:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5638 00000100:00100000:0.0:1790771165.835216:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 923 00000001:00080000:2.0:1790771165.835913:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969161 is committed 00000001:00080000:2.0:1790771165.835931:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969160 is committed 00010000:00010000:0.0:1790771165.835936:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835944:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835949:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835953:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.835956:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.835961:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835962:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.835964:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 46 batchid updated 00010000:00010000:1.0:1790771165.835983:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835986:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xea196397 (ffff8bfc10471500) 00010000:00010000:0.0:1790771165.835993:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.835995:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.835997:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.836006:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 46 00010000:00010000:0.0:1790771165.836015:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b4de lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836015:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.836024:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836034:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836034:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836055:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771165.836055:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb04b8b300 with version 75 00010000:00010000:1.0:1790771165.836058:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771165.836065:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.836069:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836070:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.836071:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 46 cancel update log [0x240000401:0x3:0x0].36: rc = 0 00010000:00010000:0.0:1790771165.836086:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.836088:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b25a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836091:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836103:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836111:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836113:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00000020:00080000:2.0:1790771165.836114:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 46 cancel update log [0x200000400:0x3:0x0].36: rc = 0 00010000:00010000:0.0:1790771165.836121:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.836127:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836127:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.836130:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 46 00010000:00010000:1.0:1790771165.836144:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.836145:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0b604 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836157:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.836162:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836167:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.836175:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:1.0:1790771165.836177:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771165.836180:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771165.836185:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 75 rpc_version 75 00000100:00100000:2.0:1790771165.836188:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14368:x1877759533750656:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 1320us (1906us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.836189:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0b1ce lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.836205:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5639 00000020:00100000:0.0:1790771165.836207:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790771165.836216:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05c35180 x1877759539722240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790771165.836232:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539722240:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1790771165.836260:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771165.836285:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.836294:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539722240 00000100:00100000:1.0:1790771165.836298:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539722240 00000100:00100000:1.0:1790771165.836326:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1790771165.836331:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:7768:x1877759539722240:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771165.836411:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539722240:12345-0@lo:1000:osp_up1-0.0 Request processed in 79us (150us total) trans 4294968574 rc 0/0 00000100:00100000:1.0:1790771165.836416:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1790771165.836443:0:7768:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968562 gen 2 00000004:00080000:0.0:1790771165.836448:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968560 committed transno 4294968562 00000004:00080000:0.0:1790771165.836457:0:7768:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968562 committed transno 4294968562 00000100:00100000:0.0:1790771165.836464:0:7768:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb05c35180 x1877759539722240/t4294968574(4294968574) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1790771181 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771165.836476:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539722240:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771165.843054:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72800/0xfa0c505d97f0b421 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa0 expref: 70 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.843119:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6d:0x0].0x0 (ffff8bfc3607d900) 00010000:00010000:3.0:1790771165.843122:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1790771165.843124:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72800, rc 0) 00000100:00100000:3.0:1790771165.843150:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14017:x1877759533732608:12345-192.168.204.50@tcp:101:dd.0 Request processed in 8722us (9050us total) trans 4294968563 rc 0/0 00000100:00100000:3.0:1790771165.843155:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 107 00000100:00100000:1.0:1790771165.849919:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.849987:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751168 00000100:00100000:2.0:1790771165.849993:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751168 00010000:00010000:2.0:1790771165.850016:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 28 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.850045:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1544 00000100:00100000:2.0:1790771165.850052:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533751168:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.850061:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.850074:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 28 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850084:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 28 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850098:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b43d7051/0xfa0c505d97f09f8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3493a expref: 28 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850108:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(5 2) 00010000:00010000:2.0:1790771165.850111:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(5 2) 00010000:00010000:2.0:1790771165.850117:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850129:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850149:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.850158:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539722368:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771165.850201:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1af8db40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.850705:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539721600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.850721:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 3/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 27 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.850731:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b400, rc 0) 00000100:00100000:2.0:1790771165.850758:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14509:x1877759533741056:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 33510us (33588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.850764:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 924 00000100:00100000:1.0:1790771165.852731:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.852754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.852781:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740416 00000100:00100000:3.0:1790771165.852787:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740416 00000100:00100000:0.0:1790771165.852791:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533740544 00000100:00100000:1.0:1790771165.852792:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.852799:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533740544 00000100:00100000:3.0:1790771165.852823:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533743488 00000100:00100000:3.0:1790771165.852827:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533743488 00000100:00100000:1.0:1790771165.852838:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5640 00000100:00100000:1.0:1790771165.852848:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:12242:x1877759533740416:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771165.852855:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5641 00010000:00010000:1.0:1790771165.852862:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.852870:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:12237:x1877759533740544:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.852876:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0b6cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35072 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.852882:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5642 00010000:00010000:0.0:1790771165.852884:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.852895:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14064:x1877759533743488:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.852901:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b6d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3506b expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.852908:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.852921:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b6dd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35208 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.852959:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.852960:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.852963:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.852974:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.852982:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.852996:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853001:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853006:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853050:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0b6cf lrc: 1/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35072 expref: 116 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853053:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b6d6 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3506b expref: 116 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.853066:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.853068:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:1.0:1790771165.853073:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.853077:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0b6cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35072 expref: 116 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853081:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771165.853085:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.853086:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00010000:00010000:0.0:1790771165.853091:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b6d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3506b expref: 115 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853100:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853107:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00010000:00010000:3.0:1790771165.853108:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853116:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.853123:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12242:x1877759533740416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 275us (390us total) trans 4294969163 rc 301/301 00000100:00100000:0.0:1790771165.853139:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12237:x1877759533740544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 272us (380us total) trans 4294969162 rc 301/301 00010000:00010000:3.0:1790771165.853139:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.853140:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5640 00010000:00010000:3.0:1790771165.853146:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853154:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853159:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5641 00000100:00100000:2.0:1790771165.853165:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.853172:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.853176:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.853180:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853185:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0b6e4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853186:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533738624 00000100:00100000:0.0:1790771165.853192:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533738624 00010000:00010000:3.0:1790771165.853198:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853203:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.853210:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853215:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853219:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.853222:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533746176 00010000:00010000:3.0:1790771165.853223:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853226:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533746176 00010000:00010000:3.0:1790771165.853233:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853245:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc10471b00) 00000100:00100000:1.0:1790771165.853250:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5643 00010000:00010000:3.0:1790771165.853251:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.853256:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.853257:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853264:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5644 00000100:00100000:1.0:1790771165.853267:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13678:x1877759533738624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.853274:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0b6f9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853280:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.853284:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:12256:x1877759533746176:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.853286:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.853291:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b707 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fd1 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853299:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.853316:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0b70e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35079 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853322:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.853335:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b715 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853344:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b715 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853345:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b6dd lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35208 expref: 72 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853360:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b715 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853363:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:2.0:1790771165.853364:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533742720 00010000:00010000:0.0:1790771165.853366:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f0b71c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.853370:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.853371:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771165.853372:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533742720 00010000:00010000:3.0:1790771165.853379:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0b6dd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35208 expref: 72 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853384:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f0b71c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853388:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00010000:00010000:0.0:1790771165.853399:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f0b71c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853403:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533748480 00000100:00100000:2.0:1790771165.853408:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533748480 00000004:00200000:0.0:1790771165.853413:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.853424:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14064:x1877759533743488:12345-192.168.204.50@tcp:101:ls.0 Request processed in 531us (631us total) trans 4294968575 rc 301/301 00010000:00010000:1.0:1790771165.853426:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b707 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd1 expref: 120 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853431:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751040 00000100:00100000:2.0:1790771165.853436:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751040 00000100:00100000:3.0:1790771165.853440:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5642 00010000:00010000:1.0:1790771165.853451:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b715 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd1 expref: 119 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853463:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:2.0:1790771165.853463:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5645 00010000:00010000:1.0:1790771165.853469:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.853472:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00010000:00010000:0.0:1790771165.853477:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0b70e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35079 expref: 117 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853478:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13675:x1877759533742720:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.853528:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13678:x1877759533738624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 262us (369us total) trans 4294968576 rc 0/0 00000100:00100000:3.0:1790771165.853539:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5646 00010000:00010000:2.0:1790771165.853548:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.853550:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391600/0xfa0c505d97f0b71c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35079 expref: 116 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.853552:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5643 00000100:00100000:3.0:1790771165.853553:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:11807:x1877759533748480:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.853560:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b731 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fd8 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853569:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.853574:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00000100:00100000:1.0:1790771165.853579:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5647 00010000:00010000:0.0:1790771165.853580:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.853582:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b738 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35080 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853584:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391600, rc 0) 00000100:00100000:1.0:1790771165.853591:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13260:x1877759533751040:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.853602:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.853613:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b73f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35286 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.853624:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b746 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853629:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:12256:x1877759533746176:12345-192.168.204.50@tcp:101:ls.0 Request processed in 350us (426us total) trans 4294969164 rc 0/0 00010000:00010000:3.0:1790771165.853634:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b74d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853646:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853649:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5644 00010000:00010000:2.0:1790771165.853650:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b746 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853654:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b74d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853669:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.853693:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b746 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853693:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b74d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853695:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.853720:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000004:00200000:3.0:1790771165.853721:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.853726:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853733:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853739:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853773:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.853785:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b738 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35080 expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.853789:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.853792:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0b731 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd8 expref: 121 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.853807:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b746 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd8 expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.853813:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.853816:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.853818:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a200, rc 0) 00010000:00010000:1.0:1790771165.853825:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853833:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853838:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b74d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35080 expref: 117 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853840:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853847:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13675:x1877759533742720:12345-192.168.204.50@tcp:101:ls.0 Request processed in 371us (596us total) trans 4294968577 rc 0/0 00010000:00010000:3.0:1790771165.853862:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:1.0:1790771165.853863:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.853869:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5645 00010000:00010000:1.0:1790771165.853874:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00030200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.853879:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853887:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853888:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533747584 00000100:00100000:0.0:1790771165.853897:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533747584 00010000:00010000:1.0:1790771165.853902:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.853907:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.853913:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853921:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0b754 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.853922:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.853926:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372a00, rc 0) 00000100:00100000:0.0:1790771165.853938:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5648 00010000:00010000:1.0:1790771165.853941:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.853951:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13668:x1877759533747584:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.853956:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853962:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.853962:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853968:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.853971:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.853972:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0b777 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fed expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853977:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.853990:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7e500) 00010000:00010000:1.0:1790771165.853992:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.853995:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.854000:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03e00/0xfa0c505d97f0b75b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.854022:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b77e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.854027:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b73f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35286 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.854033:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:11807:x1877759533748480:12345-192.168.204.50@tcp:101:ls.0 Request processed in 482us (745us total) trans 4294969165 rc 0/0 00010000:00010000:0.0:1790771165.854034:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b77e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.854042:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.854049:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1790771165.854052:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5646 00000100:00100000:2.0:1790771165.854056:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.854057:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b77e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.854058:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b73f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35286 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.854073:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745920 00000100:00100000:2.0:1790771165.854078:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745920 00000004:00200000:0.0:1790771165.854080:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.854095:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00000100:00100000:2.0:1790771165.854108:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5649 00000100:00100000:2.0:1790771165.854119:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13664:x1877759533745920:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.854129:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13260:x1877759533751040:12345-192.168.204.50@tcp:101:ls.0 Request processed in 540us (810us total) trans 4294969166 rc 301/301 00010000:00010000:2.0:1790771165.854129:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.854138:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0b777 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fed expref: 124 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.854139:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5647 00010000:00010000:2.0:1790771165.854139:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b78c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fdf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.854173:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b77e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fed expref: 124 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.854179:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771165.854182:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.854184:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00010000:00010000:2.0:1790771165.854197:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b793 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854206:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b793 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854213:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b793 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.854221:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13668:x1877759533747584:12345-192.168.204.50@tcp:101:ls.0 Request processed in 274us (448us total) trans 4294968578 rc 0/0 00000004:00200000:2.0:1790771165.854222:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.854232:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5648 00000100:00100000:1.0:1790771165.854260:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.854275:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b78c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fdf expref: 125 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854286:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b793 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fdf expref: 124 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854292:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.854294:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.854296:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a400, rc 0) 00000100:00100000:2.0:1790771165.854336:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13664:x1877759533745920:12345-192.168.204.50@tcp:101:ls.0 Request processed in 218us (281us total) trans 4294968579 rc 0/0 00000100:00100000:2.0:1790771165.854346:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5649 00000100:00100000:2.0:1790771165.854366:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533747712 00000100:00100000:2.0:1790771165.854370:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533747712 00000100:00100000:2.0:1790771165.854400:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5650 00000100:00100000:2.0:1790771165.854407:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13677:x1877759533747712:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.854415:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.854422:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b7a1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34fe6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854455:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b7a8 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854462:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b7a8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854468:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b7a8 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.854474:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.854533:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b7a1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fe6 expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854547:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b7a8 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fe6 expref: 126 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.854554:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.854557:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.854559:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af000, rc 0) 00000100:00100000:2.0:1790771165.854583:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13677:x1877759533747712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 177us (327us total) trans 4294968580 rc 0/0 00000100:00100000:2.0:1790771165.854589:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5650 00000100:00100000:1.0:1790771165.860020:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.860043:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.860056:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.860076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.860093:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751296 00000100:00100000:0.0:1790771165.860097:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751680 00000100:00100000:2.0:1790771165.860100:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751296 00000100:00100000:0.0:1790771165.860104:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751680 00000100:00100000:3.0:1790771165.860111:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751424 00000100:00100000:3.0:1790771165.860119:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751424 00002000:00100000:2.0:1790771165.860133:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xd:0x0] (0->38335) req@ffff8bfc3facea00 x1877759533751296/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.860143:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3facea00 with x1877759533751296 ext(0->38335) 00000100:00100000:3.0:1790771165.860146:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06192680 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539721728:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.860154:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 925 00010000:00010000:2.0:1790771165.860154:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 29 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.860169:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14361:x1877759533751680:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771165.860170:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 29 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.860171:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.860183:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.860188:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.860193:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3facea00 00010000:00010000:0.0:1790771165.860197:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35294 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.860215:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.860219:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:0.0:1790771165.860230:0:13793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.860231:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759533751296:12345-192.168.204.50@tcp:4:cp.0 00000100:00100000:1.0:1790771165.860243:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.860250:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x13:0x0].0x0 since=1s v=(1 2) 00010000:00010000:0.0:1790771165.860254:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(2 2) 00010000:00010000:0.0:1790771165.860261:0:13793:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35294 expref: 25 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.860271:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.860297:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.860315:0:13793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.860326:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533750016 00000100:00100000:1.0:1790771165.860327:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.860328:0:13793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 23 pid: 13796 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.860333:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533750016 00000100:00100000:0.0:1790771165.860345:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539722496:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.860353:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752448 00000100:00100000:3.0:1790771165.860357:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752448 00000100:00100000:1.0:1790771165.860365:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.860404:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.860413:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87900 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.860415:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751808 00000100:00100000:2.0:1790771165.860422:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751808 00000100:00100000:3.0:1790771165.860431:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752832 00000100:00100000:3.0:1790771165.860436:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752832 00010000:00010000:2.0:1790771165.860442:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 127 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.860444:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752576 00000100:00100000:0.0:1790771165.860452:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752576 00000100:00100000:1.0:1790771165.860463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.860467:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752960 00000100:00100000:3.0:1790771165.860471:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752960 00000100:00100000:2.0:1790771165.860474:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752192 00000100:00100000:2.0:1790771165.860478:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752192 00000100:00100000:3.0:1790771165.860522:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1421 00000100:00100000:0.0:1790771165.860524:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751552 00000100:00100000:0.0:1790771165.860529:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751552 00000100:00100000:3.0:1790771165.860536:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13734:x1877759533752448:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.860537:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1545 00000100:00100000:2.0:1790771165.860551:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759533751808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.860560:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.860565:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 926 00010000:00010000:2.0:1790771165.860566:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.860575:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 927 00000100:00100000:0.0:1790771165.860578:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533752576:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771165.860585:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.860589:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.860592:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2398:x1877759533751552:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:0.0:1790771165.860600:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c4853d9/0xfa0c505d97f0b7bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352a9 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.860610:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f04c63 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32bdc expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.860631:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00000100:00100000:0.0:1790771165.860634:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539722624:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.860637:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.860646:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.860652:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.860659:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.860693:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.860702:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.860718:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759533751808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 170us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.860727:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1545 00000100:00100000:0.0:1790771165.860730:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533751936 00000100:00100000:3.0:1790771165.860733:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13734:x1877759533752448:12345-192.168.204.50@tcp:35:ls.0 Request processed in 196us (487us total) trans 4294968581 rc 0/0 00000100:00100000:0.0:1790771165.860735:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533751936 00000100:00100000:3.0:1790771165.860748:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1421 00000100:00100000:2.0:1790771165.860753:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 727 00000100:00100000:1.0:1790771165.860757:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.860767:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533752192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.860769:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533749632 00000100:00100000:0.0:1790771165.860775:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533749632 00010000:00010000:2.0:1790771165.860779:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.860793:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0b5c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351bb expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.860798:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753088 00000100:00100000:1.0:1790771165.860804:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.860805:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753088 00010000:00010000:2.0:1790771165.860809:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:2.0:1790771165.860813:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.860827:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753216 00000100:00100000:0.0:1790771165.860830:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533750144 00000100:00100000:1.0:1790771165.860834:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753216 00000100:00100000:0.0:1790771165.860835:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533750144 00000100:00100000:2.0:1790771165.860836:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2396:x1877759533752192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.860845:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 727 00010000:00010000:1.0:1790771165.860855:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 32 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.860874:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5651 00000100:00100000:2.0:1790771165.860881:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1422 00000100:00100000:0.0:1790771165.860890:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13742:x1877759533751424:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.860896:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13975:x1877759533752832:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:1.0:1790771165.860897:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1546 00010000:00010000:0.0:1790771165.860906:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.860917:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2396:x1877759533753216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.860918:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b7c4 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3528d expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.860933:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.860948:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 32 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.860954:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.860969:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.860970:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 32 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.860987:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.860995:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13975:x1877759533752832:12345-192.168.204.50@tcp:35:rm.0 Request processed in 104us (668us total) trans 4294969167 rc 0/0 00010000:00010000:1.0:1790771165.861002:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003164996c/0xfa0c505d97f07035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339b2 expref: 32 pid: 8676 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.861014:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1423 00000004:00200000:0.0:1790771165.861015:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.861020:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=1s v=(8 1) 00000004:00200000:0.0:1790771165.861023:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1790771165.861025:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(8 1) 00000100:00100000:2.0:1790771165.861029:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1422 00000100:00100000:3.0:1790771165.861033:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13737:x1877759533752960:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771165.861041:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861049:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b7c4 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861059:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861069:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.861074:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5652 00010000:00010000:0.0:1790771165.861082:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:0.0:1790771165.861087:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.861088:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14383:x1877759533751936:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.861090:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1800, rc 0) 00010000:00010000:1.0:1790771165.861093:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.861102:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.861114:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b7d2 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3529b expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861117:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.861121:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13742:x1877759533751424:12345-192.168.204.50@tcp:101:ls.0 Request processed in 235us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.861141:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5651 00000100:00100000:1.0:1790771165.861152:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29017480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9499:1877759539722752:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771165.861162:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5653 00010000:00010000:2.0:1790771165.861162:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b7d9 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.861173:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.861175:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13735:x1877759533749632:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.861188:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffb40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.861189:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861190:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.861201:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b7e0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ff4 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.861212:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.861216:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771165.861236:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b7d2 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3529b expref: 121 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861244:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0b7e7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.861249:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3529b expref: 120 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861260:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0b7e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.861260:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:2.0:1790771165.861265:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.861268:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aea00, rc 0) 00000100:00100000:1.0:1790771165.861278:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.861279:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0b7e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.861291:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.861292:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14383:x1877759533751936:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 207us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.861302:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5652 00000100:00100000:2.0:1790771165.861316:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753472 00000100:00100000:2.0:1790771165.861319:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753472 00000100:00100000:1.0:1790771165.861328:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.861347:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5654 00010000:00010000:0.0:1790771165.861358:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b7e0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ff4 expref: 130 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.861358:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14401:x1877759533753088:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:0.0:1790771165.861376:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0b7e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ff4 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861381:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.861388:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771165.861390:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.861393:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00000100:00100000:2.0:1790771165.861412:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753728 00000100:00100000:2.0:1790771165.861417:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753728 00000100:00100000:0.0:1790771165.861425:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13735:x1877759533749632:12345-192.168.204.50@tcp:101:ls.0 Request processed in 251us (1125us total) trans 4294968582 rc 0/0 00000100:00100000:0.0:1790771165.861439:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5653 00000100:00100000:1.0:1790771165.861447:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.861450:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 928 00000100:00100000:2.0:1790771165.861460:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533753728:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:0.0:1790771165.861466:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5655 00000100:00100000:0.0:1790771165.861476:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14410:x1877759533750144:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.861517:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.861530:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0b7f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35278 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861546:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.861558:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0b7f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35278 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861567:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0c00/0xfa0c505d97f0b7f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35278 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.861570:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 4360 -> 4360 00002000:00010000:2.0:1790771165.861577:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.861579:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 1790771159 -> 0 00002000:00010000:2.0:1790771165.861582:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:0.0:1790771165.861584:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00002000:00010000:2.0:1790771165.861585:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 16 -> 16 00010000:00010000:0.0:1790771165.861593:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1790771165.861597:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.861599:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0c00, rc 0) 00000100:00100000:2.0:1790771165.861618:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533753728:12345-192.168.204.50@tcp:2:chown.0 Request processed in 159us (242us total) trans 4294967588 rc 0/0 00000100:00100000:2.0:1790771165.861623:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 928 00000100:00100000:0.0:1790771165.861631:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14410:x1877759533750144:12345-192.168.204.50@tcp:101:chown.0 Request processed in 156us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.861639:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5655 00000100:00100000:2.0:1790771165.861649:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753600 00000100:00100000:2.0:1790771165.861653:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753600 00000100:00100000:0.0:1790771165.861662:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744768 00000100:00100000:1.0:1790771165.861664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.861669:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744768 00000100:00100000:2.0:1790771165.861687:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753856 00000100:00100000:2.0:1790771165.861692:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753856 00000100:00100000:2.0:1790771165.861715:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1424 00000100:00100000:0.0:1790771165.861719:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533744896 00000100:00100000:0.0:1790771165.861725:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533744896 00000100:00100000:2.0:1790771165.861725:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:11969:x1877759533753600:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.861739:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.861757:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533745024 00000100:00100000:0.0:1790771165.861761:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533745024 00000100:00100000:0.0:1790771165.861779:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5656 00000100:00100000:0.0:1790771165.861787:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14319:x1877759533753472:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:0.0:1790771165.861809:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.861811:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:11969:x1877759533753600:12345-192.168.204.50@tcp:35:ls.0 Request processed in 87us (484us total) trans 4294968583 rc 0/0 00000100:00100000:2.0:1790771165.861817:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1424 00010000:00010000:0.0:1790771165.861822:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f013c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31761 expref: 114 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.861837:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfb03026800) 00000100:00100000:2.0:1790771165.861837:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1425 00010000:00010000:0.0:1790771165.861845:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.861850:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:12123:x1877759533753856:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771165.861859:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533754112 00010000:00010000:0.0:1790771165.861864:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861865:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533754112 00010000:00010000:0.0:1790771165.861878:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861889:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861905:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 728 00010000:00010000:0.0:1790771165.861908:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861916:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.861917:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:2398:x1877759533754112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.861929:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861934:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.861944:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861951:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b619 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351fa expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.861957:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861958:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 119 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861974:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771165.861978:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.861981:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 4/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.861984:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.862010:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.862012:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:2398:x1877759533754112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.862017:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 119 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.862032:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 728 00010000:00010000:0.0:1790771165.862033:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 119 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862045:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539722880:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.862071:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5657 00010000:00010000:3.0:1790771165.862076:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862081:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.862086:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:12188:x1877759533744768:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.862091:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.862099:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.862104:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5658 00010000:00010000:1.0:1790771165.862112:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35247 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862113:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:12122:x1877759533744896:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.862126:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.862138:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3524e expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.862144:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 77 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862161:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 78 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862178:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 78 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.862179:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 78 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.862180:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862195:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.862203:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.862208:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35ffe400, rc 0) 00010000:00010000:1.0:1790771165.862210:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.862215:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.862217:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.862220:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03800, rc 0) 00010000:00010000:3.0:1790771165.862228:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 4/0,1 mode: --/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862229:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:12122:x1877759533744896:12345-192.168.204.50@tcp:101:ls.0 Request processed in 117us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.862245:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5658 00000100:00100000:1.0:1790771165.862253:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:12188:x1877759533744768:12345-192.168.204.50@tcp:101:ls.0 Request processed in 172us (707us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.862259:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862265:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5659 00010000:00010000:3.0:1790771165.862272:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 129 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.862279:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5657 00000100:00100000:0.0:1790771165.862281:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:11832:x1877759533745024:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.862299:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.862299:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539723008:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.862315:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35255 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.862324:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533753984 00000100:00100000:2.0:1790771165.862328:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533753984 00010000:00010000:0.0:1790771165.862333:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 78 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862344:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 78 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862350:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771165.862353:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.862357:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5e00, rc 0) 00000100:00100000:2.0:1790771165.862357:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 929 00000100:00100000:1.0:1790771165.862371:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.862372:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2398:x1877759533753984:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1790771165.862381:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.862385:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:11832:x1877759533745024:12345-192.168.204.50@tcp:101:ls.0 Request processed in 108us (723us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.862392:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6767e97/0xfa0c505d97f0b834 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352b0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862393:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5659 00000100:00100000:0.0:1790771165.862419:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533749504 00000100:00100000:0.0:1790771165.862425:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533749504 00000100:00100000:2.0:1790771165.862426:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539723136:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.862457:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.862460:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5660 00000100:00100000:0.0:1790771165.862468:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13733:x1877759533749504:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.862476:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.862510:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0b83b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3526a expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.862527:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:14401:x1877759533753088:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 1173us (1872us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771165.862534:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5654 00010000:00010000:0.0:1790771165.862549:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862559:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862566:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.862581:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.862584:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771165.862589:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771165.862595:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.862612:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755264 00010000:00010000:0.0:1790771165.862614:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0b83b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3526a expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.862616:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755264 00010000:00010000:0.0:1790771165.862632:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3526a expref: 131 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862638:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:2.0:1790771165.862642:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5661 00010000:00010000:0.0:1790771165.862643:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771165.862648:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5c00, rc 0) 00000100:00100000:2.0:1790771165.862653:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14008:x1877759533750016:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.862661:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.862683:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.862688:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b849 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35271 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862699:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13733:x1877759533749504:12345-192.168.204.50@tcp:101:ls.0 Request processed in 227us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.862710:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5660 00000100:00100000:0.0:1790771165.862730:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5662 00010000:00010000:2.0:1790771165.862731:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.862740:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:12255:x1877759533755264:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.862740:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.862756:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862758:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.862771:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0b857 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35087 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.862771:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.862776:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771165.862788:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.862808:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b849 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.862818:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862821:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0b85e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.862843:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:0.0:1790771165.862844:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0b85e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.862847:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771165.862851:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b000, rc 0) 00010000:00010000:0.0:1790771165.862863:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0b85e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.862874:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.862883:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14008:x1877759533750016:12345-192.168.204.50@tcp:101:ls.0 Request processed in 232us (2824us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.862889:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5661 00010000:00010000:0.0:1790771165.862927:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0b857 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35087 expref: 123 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862938:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0b85e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35087 expref: 122 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.862944:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:0.0:1790771165.862946:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.862948:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4e00, rc 0) 00000100:00100000:0.0:1790771165.862976:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:12255:x1877759533755264:12345-192.168.204.50@tcp:101:ls.0 Request processed in 240us (391us total) trans 4294969168 rc 0/0 00000100:00100000:0.0:1790771165.862980:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5662 00000100:00100000:0.0:1790771165.863069:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.863090:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.863106:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533754368 00000100:00100000:2.0:1790771165.863110:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533754368 00000100:00100000:0.0:1790771165.863116:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.863126:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533754624 00000100:00100000:1.0:1790771165.863132:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533754624 00000100:00100000:2.0:1790771165.863144:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 930 00000100:00100000:0.0:1790771165.863151:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.863156:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533754368:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.863164:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.863171:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533754880 00010000:00010000:2.0:1790771165.863174:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046f381db/0xfa0c505d97f0b86c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352be expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.863175:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533754880 00000100:00100000:3.0:1790771165.863192:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533754752 00000100:00100000:3.0:1790771165.863198:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533754752 00000100:00100000:2.0:1790771165.863206:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539723264:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.863210:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 729 00000100:00100000:1.0:1790771165.863219:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 730 00000100:00100000:0.0:1790771165.863224:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2397:x1877759533754624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.863234:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.863235:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759533754880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.863235:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5663 00000100:00100000:2.0:1790771165.863246:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7240 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.863249:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.863253:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b66d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351b4 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.863266:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b682 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3520f expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.863270:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771165.863277:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.863280:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00000100:00100000:2.0:1790771165.863282:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14382:x1877759533754752:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771165.863284:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.863293:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.863303:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b873 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352cc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.863310:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759533754624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.863314:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759533754880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.863327:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 730 00000100:00100000:0.0:1790771165.863334:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 729 00010000:00010000:2.0:1790771165.863335:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0b87a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.863344:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0b87a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.863352:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0b87a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.863366:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.863369:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771165.863386:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b873 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352cc expref: 123 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.863400:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0b87a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352cc expref: 122 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.863407:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:2.0:1790771165.863409:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.863412:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373000, rc 0) 00000001:00080000:3.0:1790771165.863416:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967588 is committed 00000001:00080000:3.0:1790771165.863422:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967587 is committed 00000001:00080000:3.0:1790771165.863426:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967586 is committed 00000100:00100000:2.0:1790771165.863439:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14382:x1877759533754752:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 194us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.863444:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5663 00000100:00100000:1.0:1790771165.863707:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533751552:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 3121us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.863714:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 927 00000100:00100000:2.0:1790771165.863725:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539721856:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.863994:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064afb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539721984:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.864013:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.864019:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.864050:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533747968 00000100:00100000:0.0:1790771165.864055:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533747968 00000100:00100000:0.0:1790771165.864080:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5664 00000100:00100000:0.0:1790771165.864085:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:14490:x1877759533747968:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771165.864093:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.864101:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0b881 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35263 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864128:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864136:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864141:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.864166:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 4325376 00000004:00200000:0.0:1790771165.864168:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.864176:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864183:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864193:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0b881 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35263 expref: 79 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864203:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35263 expref: 78 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864208:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771165.864210:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771165.864211:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5600, rc 0) 00000100:00100000:0.0:1790771165.864235:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14490:x1877759533747968:12345-192.168.204.50@tcp:101:ln.0 Request processed in 150us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.864239:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5664 00000100:00100000:0.0:1790771165.864582:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.864606:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533752320 00000100:00100000:1.0:1790771165.864612:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533752320 00000100:00100000:1.0:1790771165.864645:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5665 00000100:00100000:1.0:1790771165.864654:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13743:x1877759533752320:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.864664:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.864690:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b88f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e34ffb expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.864741:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.864744:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b896 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.864757:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b896 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.864766:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b896 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.864776:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.864807:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755008 00000100:00100000:0.0:1790771165.864811:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755008 00010000:00010000:1.0:1790771165.864833:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0b88f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ffb expref: 133 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.864844:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5666 00010000:00010000:1.0:1790771165.864856:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b896 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ffb expref: 132 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.864859:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:11971:x1877759533755008:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.864874:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771165.864876:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.864878:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.864882:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73400, rc 0) 00010000:00010000:0.0:1790771165.864889:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0b8a4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3527f expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.864921:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13743:x1877759533752320:12345-192.168.204.50@tcp:101:ls.0 Request processed in 266us (336us total) trans 4294968584 rc 0/0 00010000:00010000:0.0:1790771165.864928:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.864933:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5665 00010000:00010000:0.0:1790771165.864943:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864949:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864960:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864966:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.864971:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.865009:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.865036:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865041:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865045:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865049:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865057:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.865060:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865065:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865070:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771165.865072:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.865074:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865078:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b8ab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865084:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865089:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865093:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865096:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.865098:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865101:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865109:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771165.865111:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.865113:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865116:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b8b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865132:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0b8a4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3527f expref: 80 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865137:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771165.865139:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.865141:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0b8a4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3527f expref: 80 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.865146:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00000100:00100000:0.0:1790771165.865172:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:11971:x1877759533755008:12345-192.168.204.50@tcp:101:ls.0 Request processed in 321us (434us total) trans 4294968585 rc 301/301 00000100:00100000:0.0:1790771165.865177:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5666 00000100:00100000:3.0:1790771165.865542:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.865567:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755520 00000100:00100000:1.0:1790771165.865573:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755520 00000100:00100000:1.0:1790771165.865609:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5667 00000100:00100000:1.0:1790771165.865619:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14396:x1877759533755520:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771165.865644:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790771165.865655:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0b1e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f4c expref: 113 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865667:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af800/0xfa0c505d97f083ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f62 expref: 112 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865688:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771165.865690:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.865700:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865708:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 121 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865714:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 121 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865719:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 111 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865723:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 6/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865736:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 111 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865742:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 111 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.865748:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723392:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.865787:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 121 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865794:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 121 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.865801:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723520:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.865824:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 121 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.865831:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 121 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.865838:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723648:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.865859:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771165.896573:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.896603:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.896628:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.896643:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757184 00000100:00100000:0.0:1790771165.896653:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757184 00000100:00100000:1.0:1790771165.896661:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757312 00000100:00100000:1.0:1790771165.896684:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757312 00000100:00100000:0.0:1790771165.896720:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756032 00000100:00100000:0.0:1790771165.896725:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756032 00000100:00100000:2.0:1790771165.896733:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5668 00000100:00100000:1.0:1790771165.896744:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5669 00000100:00100000:2.0:1790771165.896750:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13667:x1877759533757184:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.896765:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12240:x1877759533757312:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.896765:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5670 00010000:00010000:2.0:1790771165.896773:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.896783:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.896784:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:11865:x1877759533756032:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.896793:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0b8c7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35002 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.896799:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.896803:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b8ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35095 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.896816:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af800/0xfa0c505d97f0b8d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3508e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.896902:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b8dc lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.896907:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b8e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.896908:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b8ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.896916:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b8dc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.896934:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.896938:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b8dc lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.896957:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.896957:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b8e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.896958:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b8ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.896980:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.896981:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b8ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.896994:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.897079:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0b8c7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35002 expref: 135 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.897080:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b8ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35095 expref: 129 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.897085:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af800/0xfa0c505d97f0b8d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3508e expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.897113:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b8dc lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35002 expref: 134 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.897122:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.897128:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.897129:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b8ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35095 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.897129:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b8e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3508e expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.897131:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668c00, rc 0) 00010000:00010000:1.0:1790771165.897154:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:1.0:1790771165.897156:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.897160:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfde00, rc 0) 00010000:00010000:3.0:1790771165.897160:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:3.0:1790771165.897165:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.897169:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af400, rc 0) 00000100:00100000:1.0:1790771165.897193:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:12240:x1877759533757312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 433us (584us total) trans 4294969170 rc 0/0 00000100:00100000:2.0:1790771165.897193:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13667:x1877759533757184:12345-192.168.204.50@tcp:101:ls.0 Request processed in 446us (623us total) trans 4294968586 rc 0/0 00000100:00100000:3.0:1790771165.897206:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:11865:x1877759533756032:12345-192.168.204.50@tcp:101:ls.0 Request processed in 425us (573us total) trans 4294969169 rc 0/0 00000100:00100000:2.0:1790771165.897209:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5668 00000100:00100000:1.0:1790771165.897218:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5669 00000100:00100000:3.0:1790771165.897226:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5670 00000100:00100000:0.0:1790771165.898953:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.898992:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758208 00000100:00100000:2.0:1790771165.898999:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758208 00000100:00100000:3.0:1790771165.899030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.899096:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757696 00000100:00100000:2.0:1790771165.899099:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757696 00000100:00100000:0.0:1790771165.899117:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5671 00000100:00100000:3.0:1790771165.899123:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.899137:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13739:x1877759533758208:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.899137:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5672 00000100:00100000:1.0:1790771165.899149:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11804:x1877759533757696:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.899156:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.899158:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.899170:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b906 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3509c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.899172:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758080 00000100:00100000:2.0:1790771165.899177:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758080 00010000:00010000:0.0:1790771165.899186:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b90d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35009 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.899206:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5673 00000100:00100000:2.0:1790771165.899217:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12239:x1877759533758080:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.899218:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b914 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.899229:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.899230:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.899239:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.899242:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b91b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.899243:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0b922 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350a3 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.899246:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.899264:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b91b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.899273:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b91b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.899280:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.899309:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b937 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.899312:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0b906 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3509c expref: 131 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.899326:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b937 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.899335:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.899339:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b90d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35009 expref: 137 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.899350:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b937 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.899363:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.899365:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3509c expref: 130 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.899367:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758592 00010000:00010000:0.0:1790771165.899370:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b91b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35009 expref: 136 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.899373:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758592 00010000:00010000:1.0:1790771165.899388:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:0.0:1790771165.899389:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771165.899395:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.899397:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.899400:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfce00, rc 0) 00010000:00010000:0.0:1790771165.899403:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1c00, rc 0) 00000100:00100000:3.0:1790771165.899407:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5674 00010000:00010000:2.0:1790771165.899422:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0b922 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350a3 expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.899422:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13738:x1877759533758592:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.899437:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.899444:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11804:x1877759533757696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 293us (409us total) trans 4294969171 rc 0/0 00010000:00010000:2.0:1790771165.899446:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b937 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350a3 expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.899447:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13739:x1877759533758208:12345-192.168.204.50@tcp:101:ls.0 Request processed in 311us (487us total) trans 4294968587 rc 0/0 00010000:00010000:3.0:1790771165.899450:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0b945 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35010 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.899469:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5672 00010000:00010000:2.0:1790771165.899472:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.899477:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.899479:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668a00, rc 0) 00000100:00100000:0.0:1790771165.899480:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5671 00000100:00100000:2.0:1790771165.899531:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12239:x1877759533758080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 316us (409us total) trans 4294969172 rc 0/0 00000100:00100000:2.0:1790771165.899538:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5673 00010000:00010000:3.0:1790771165.899540:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0b94c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.899550:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0b94c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.899558:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0b94c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.899565:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.899619:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0b945 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35010 expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.899635:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0b94c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35010 expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.899644:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:3.0:1790771165.899701:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.899705:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592200, rc 0) 00000100:00100000:3.0:1790771165.899739:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13738:x1877759533758592:12345-192.168.204.50@tcp:101:ls.0 Request processed in 324us (411us total) trans 4294968588 rc 0/0 00000100:00100000:3.0:1790771165.899748:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5674 00000100:00100000:3.0:1790771165.900250:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.900284:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759488 00000100:00100000:0.0:1790771165.900288:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759488 00000100:00100000:0.0:1790771165.900315:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5675 00000100:00100000:0.0:1790771165.900321:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13264:x1877759533759488:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.900331:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.900340:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b95a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352ef expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900374:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900382:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900388:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900403:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900412:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900420:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.900522:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.900551:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900557:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900562:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900571:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900576:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.900579:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900584:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900591:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.900593:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.900596:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900599:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0b961 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900607:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900612:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900616:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900619:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.900621:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900628:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900632:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771165.900634:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.900635:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900639:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0b968 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900659:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b95a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352ef expref: 114 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900665:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.900667:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.900669:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0b95a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352ef expref: 114 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.900691:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00000100:00100000:0.0:1790771165.900716:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13264:x1877759533759488:12345-192.168.204.50@tcp:101:ls.0 Request processed in 396us (507us total) trans 4294969173 rc 301/301 00000100:00100000:0.0:1790771165.900722:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5675 00000100:00100000:1.0:1790771165.901755:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.901784:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759744 00000100:00100000:0.0:1790771165.901788:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759744 00000100:00100000:0.0:1790771165.901812:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5676 00000100:00100000:0.0:1790771165.901817:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13673:x1877759533759744:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.901830:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.901841:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0b976 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35017 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.901889:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0b97d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.901898:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0b97d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.901906:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0b97d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.901915:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.901940:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.901955:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0b976 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35017 expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.901966:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0b97d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35017 expref: 140 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.901972:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:1.0:1790771165.901973:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533760128 00010000:00010000:0.0:1790771165.901974:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.901978:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85800, rc 0) 00000100:00100000:1.0:1790771165.901979:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533760128 00000100:00100000:0.0:1790771165.902013:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13673:x1877759533759744:12345-192.168.204.50@tcp:101:ls.0 Request processed in 193us (256us total) trans 4294968589 rc 0/0 00000100:00100000:1.0:1790771165.902013:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5677 00000100:00100000:0.0:1790771165.902024:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5676 00000100:00100000:1.0:1790771165.902026:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:13891:x1877759533760128:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.902041:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.902050:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b98b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352e1 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902080:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902088:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902094:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902106:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902112:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902116:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.902157:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.902182:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902186:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902190:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902194:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902197:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfcc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.902199:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902203:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902209:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.902211:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.902213:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902217:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0b992 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902223:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902227:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902231:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902235:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.902236:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902240:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902244:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc0ab7e500) 00010000:00010000:1.0:1790771165.902246:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.902248:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902251:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0b999 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902280:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b98b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e1 expref: 81 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902291:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.902293:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.902296:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0b98b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e1 expref: 81 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.902303:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc000, rc 0) 00000100:00100000:3.0:1790771165.902329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.902339:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:13891:x1877759533760128:12345-192.168.204.50@tcp:101:ls.0 Request processed in 314us (429us total) trans 4294968590 rc 301/301 00000100:00100000:1.0:1790771165.902348:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5677 00000100:00100000:0.0:1790771165.902368:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533760640 00000100:00100000:0.0:1790771165.902373:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533760640 00000100:00100000:0.0:1790771165.902406:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5678 00000100:00100000:0.0:1790771165.902415:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:14687:x1877759533760640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771165.902426:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.902436:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0b9a7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352c5 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.902481:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0b9ae lrc: 3/1,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.902509:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0b9ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.902515:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0b9ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.902522:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00010000:00010000:0.0:1790771165.902561:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0b9a7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352c5 expref: 83 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.902571:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0b9ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352c5 expref: 82 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.902576:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771165.902578:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790771165.902580:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1a00, rc 0) 00000100:00100000:0.0:1790771165.902603:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14687:x1877759533760640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 191us (277us total) trans 4294968591 rc 0/0 00000100:00100000:0.0:1790771165.902608:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5678 00000100:00100000:2.0:1790771165.903589:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.903621:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755904 00000100:00100000:2.0:1790771165.903626:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.903627:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755904 00000100:00100000:2.0:1790771165.903656:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756160 00000100:00100000:2.0:1790771165.903662:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756160 00000100:00100000:1.0:1790771165.903663:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 931 00000100:00100000:1.0:1790771165.903686:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:14015:x1877759533755904:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771165.903693:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.903705:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352d3 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.903712:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.903717:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1426 00000100:00100000:2.0:1790771165.903730:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12252:x1877759533756160:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.903745:0:13786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 25 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.903751:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.903761:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x12:0x0].0x0 since=2s v=(1 10) 00010000:00010000:1.0:1790771165.903767:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(2 10) 00010000:00010000:1.0:1790771165.903773:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 4/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 29 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.903782:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.903803:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756416 00000100:00100000:3.0:1790771165.903804:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.903808:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756416 00010000:00010000:1.0:1790771165.903817:0:13786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 25 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.903828:0:13786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 25 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.903837:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755776 00000100:00100000:2.0:1790771165.903838:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:12252:x1877759533756160:12345-192.168.204.50@tcp:35:ls.0 Request processed in 109us (210us total) trans 4294969174 rc 0/0 00002000:00100000:0.0:1790771165.903843:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (466944->471039) req@ffff8bfb0305fb80 x1877759533756416/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.903843:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539723776:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.903846:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755776 00000100:00100000:2.0:1790771165.903854:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1426 00002000:00100000:0.0:1790771165.903865:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0305fb80 with x1877759533756416 ext(466944->471039) 00002000:00010000:0.0:1790771165.903871:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0305fb80 00010000:00010000:3.0:1790771165.903877:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 113 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.903897:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 377 00000100:00100000:0.0:1790771165.903908:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533756416:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771165.903912:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533755648 00000100:00100000:3.0:1790771165.903919:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533755648 00000100:00100000:1.0:1790771165.903922:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.903938:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 131 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.903951:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1547 00000100:00100000:1.0:1790771165.903960:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:2397:x1877759533755776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.903970:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.903978:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 113 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.903979:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1548 00010000:00010000:1.0:1790771165.903992:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 113 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.903998:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2397:x1877759533755648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.904013:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.904016:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f02079 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cd2 expref: 113 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904017:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533756416:12345-192.168.204.50@tcp:3:cat.0 Request processed in 110us (238us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.904024:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 131 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904035:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 377 00002000:00100000:0.0:1790771165.904047:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (466944->471039) req@ffff8bfb0305fb80 x1877759533756416/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.904055:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 131 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.904056:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0305fb80 with x1877759533756416 ext(466944->471039) 00002000:00010000:0.0:1790771165.904062:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0305fb80 00010000:00010000:1.0:1790771165.904071:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:1.0:1790771165.904078:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904088:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904097:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.904108:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.904108:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0b142 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eff expref: 131 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904125:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00000100:00100000:1.0:1790771165.904128:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2397:x1877759533755776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.904130:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904144:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.904146:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1547 00010000:00010000:3.0:1790771165.904154:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904166:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756544 00000100:00100000:2.0:1790771165.904171:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756544 00010000:00010000:3.0:1790771165.904175:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.904183:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.904202:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759533755648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 210us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.904208:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1427 00000100:00100000:0.0:1790771165.904209:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761024 00000100:00100000:3.0:1790771165.904214:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1548 00000100:00100000:0.0:1790771165.904215:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761024 00000100:00100000:2.0:1790771165.904221:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14237:x1877759533756544:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:1.0:1790771165.904235:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756288 00010000:00010000:3.0:1790771165.904241:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.904242:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756288 00010000:00010000:3.0:1790771165.904250:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904252:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5679 00000004:00200000:2.0:1790771165.904257:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:2.0:1790771165.904262:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.904266:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13666:x1877759533761024:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.904275:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.904286:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0b9c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3501e expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.904293:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5680 00000100:00100000:2.0:1790771165.904301:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14237:x1877759533756544:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.904308:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13973:x1877759533756288:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:2.0:1790771165.904314:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1427 00010000:00010000:1.0:1790771165.904318:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.904330:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b9ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352da expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904346:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904353:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904355:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b9d1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904364:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904366:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904372:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b9d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904386:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.904387:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904391:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b9d1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904392:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904399:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904411:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533751296:12345-192.168.204.50@tcp:4:cp.0 Request processed in 44182us (44389us total) trans 4294967589 rc 0/0 00010000:00010000:3.0:1790771165.904414:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.904419:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.904427:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904430:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 85 00010000:00010000:3.0:1790771165.904433:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:3.0:1790771165.904440:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00002000:00100000:2.0:1790771165.904442:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xd:0x0] (0->38335) req@ffff8bfc3facea00 x1877759533751296/t4294967589(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/448 e 0 to 0 dl 1790771176 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.904443:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904444:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.904468:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3facea00 with x1877759533751296 ext(0->38335) 00010000:00010000:1.0:1790771165.904469:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.904469:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0b697 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904475:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0b9c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3501e expref: 143 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.904481:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904518:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b9d1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3501e expref: 142 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904544:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771165.904548:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.904551:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.904552:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1000, rc 0) 00002000:00010000:2.0:1790771165.904562:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3facea00 00000100:00100000:3.0:1790771165.904567:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14437:x1877759533747072:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 78995us (79133us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771165.904570:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.904579:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5632 00010000:00010000:1.0:1790771165.904581:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904586:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13666:x1877759533761024:12345-192.168.204.50@tcp:101:ls.0 Request processed in 321us (864us total) trans 4294968592 rc 0/0 00010000:00010000:1.0:1790771165.904593:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904598:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5679 00000004:00200000:1.0:1790771165.904617:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xa2:0x0]: returning size 13172736 00000004:00200000:1.0:1790771165.904621:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.904631:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904639:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904645:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904651:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904655:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904660:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904665:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.904668:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904691:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904697:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069eed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539722368:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.904703:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771165.904704:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.904708:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.904712:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904718:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0b9d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.904720:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.904732:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904738:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904745:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533751168:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 54690us (54826us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.904747:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.904759:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.904761:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.904762:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1544 00010000:00010000:1.0:1790771165.904767:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904774:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904782:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc0ab7e900) 00010000:00010000:1.0:1790771165.904785:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.904785:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757568 00010000:00010000:1.0:1790771165.904787:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904789:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757568 00000100:00100000:0.0:1790771165.904802:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.904806:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0b9df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904822:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757440 00000100:00100000:2.0:1790771165.904825:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757440 00010000:00010000:1.0:1790771165.904839:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0b9ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352da expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.904855:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352da expref: 131 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.904858:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 731 00010000:00010000:1.0:1790771165.904872:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00000100:00100000:2.0:1790771165.904872:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2397:x1877759533757568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.904873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.904881:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771165.904884:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.904886:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00010000:00010000:2.0:1790771165.904899:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0b746 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd8 expref: 142 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.904911:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533756672 00010000:00010000:2.0:1790771165.904914:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:1.0:1790771165.904917:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533756672 00010000:00010000:2.0:1790771165.904918:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.904926:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.904944:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759533757568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.904952:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 731 00000100:00100000:0.0:1790771165.904955:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758336 00000100:00100000:0.0:1790771165.904961:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758336 00000100:00100000:1.0:1790771165.904962:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 932 00000100:00100000:2.0:1790771165.904973:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 732 00000100:00100000:1.0:1790771165.904980:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2397:x1877759533756672:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:2.0:1790771165.904987:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759533757440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.904996:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.905006:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0b715 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fd1 expref: 140 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.905013:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 733 00010000:00010000:2.0:1790771165.905020:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.905024:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.905029:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533758336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.905041:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.905049:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13973:x1877759533756288:12345-192.168.204.50@tcp:101:rm.0 Request processed in 744us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.905054:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533757440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.905058:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0b74d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35080 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.905065:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5680 00000100:00100000:2.0:1790771165.905074:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 732 00000100:00100000:1.0:1790771165.905085:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533757952 00000100:00100000:1.0:1790771165.905089:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533757952 00010000:00010000:0.0:1790771165.905090:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:0.0:1790771165.905095:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.905117:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5681 00000100:00100000:0.0:1790771165.905123:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533758336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.905130:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14064:x1877759533757952:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771165.905139:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 733 00010000:00010000:1.0:1790771165.905139:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.905150:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0b9f4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352e8 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905200:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905208:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905214:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.905226:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.905228:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.905237:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905253:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0b9f4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 83 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905264:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 82 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.905270:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771165.905272:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.905275:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56800, rc 0) 00000100:00100000:1.0:1790771165.905297:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14064:x1877759533757952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 174us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.905302:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5681 00000100:00100000:1.0:1790771165.905400:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.905401:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13737:x1877759533752960:12345-192.168.204.50@tcp:37:ls.0 Request processed in 44372us (44995us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.905411:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1423 00000100:00100000:1.0:1790771165.905424:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758464 00000100:00100000:1.0:1790771165.905429:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758464 00000100:00100000:1.0:1790771165.905454:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 734 00000100:00100000:0.0:1790771165.905461:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.905468:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533758464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.905479:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.905480:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758720 00000100:00100000:3.0:1790771165.905517:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758720 00010000:00010000:1.0:1790771165.905545:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0b77e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fed expref: 139 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.905554:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 735 00000100:00100000:3.0:1790771165.905567:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2397:x1877759533758720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.905571:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:3.0:1790771165.905575:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.905577:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.905591:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0b7a8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fe6 expref: 138 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.905605:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:1.0:1790771165.905610:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2396:x1877759533758464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 142us (208us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.905610:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.905621:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.905622:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 734 00000100:00100000:3.0:1790771165.905639:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2397:x1877759533758720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.905646:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 735 00000100:00100000:3.0:1790771165.905716:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533758976 00000100:00100000:3.0:1790771165.905720:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533758976 00000100:00100000:1.0:1790771165.905732:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.905754:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1428 00000100:00100000:3.0:1790771165.905766:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13260:x1877759533758976:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.905777:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.905787:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539722496:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.905831:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35294 expref: 25 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.905836:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.905853:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1200, rc 0) 00000100:00100000:3.0:1790771165.905864:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759616 00000100:00100000:3.0:1790771165.905869:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759616 00000100:00100000:3.0:1790771165.905906:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 933 00000100:00100000:3.0:1790771165.905920:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2397:x1877759533759616:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:2.0:1790771165.905921:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759104 00000100:00100000:2.0:1790771165.905927:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759104 00010000:00010000:3.0:1790771165.905931:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.905937:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14361:x1877759533751680:12345-192.168.204.50@tcp:101:dd.0 Request processed in 45749us (45837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.905945:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 925 00010000:00010000:3.0:1790771165.905946:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a2487e/0xfa0c505d97f0ba02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352f6 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.905957:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759360 00000100:00100000:2.0:1790771165.905961:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759360 00010000:00010000:2.0:1790771165.905976:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 33 pid: 13796 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.905992:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06374380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539723904:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.906003:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1549 00000100:00100000:2.0:1790771165.906012:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+33:2397:x1877759533759360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.906017:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 736 00010000:00010000:2.0:1790771165.906024:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.906029:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2397:x1877759533759104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.906040:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 33 pid: 13796 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906041:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.906052:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35c00 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.906057:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 33 pid: 13796 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906059:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0b793 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fdf expref: 136 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906082:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.906093:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025635485/0xfa0c505d97f0a2b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a59 expref: 33 pid: 13796 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906098:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.906102:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(2 2) 00010000:00010000:2.0:1790771165.906107:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(2 2) 00010000:00010000:2.0:1790771165.906112:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35294 expref: 24 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.906119:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35294 expref: 24 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.906139:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000055e8cbb9/0xfa0c505d97f0b7b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35294 expref: 24 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.906148:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2397:x1877759533759104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.906153:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539724032:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771165.906167:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 736 00000100:00100000:3.0:1790771165.906170:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13260:x1877759533758976:12345-192.168.204.50@tcp:35:ls.0 Request processed in 404us (616us total) trans 4294969175 rc 0/0 00000100:00100000:3.0:1790771165.906181:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1428 00000100:00100000:2.0:1790771165.906187:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.906217:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:12123:x1877759533753856:12345-192.168.204.50@tcp:37:ls.0 Request processed in 44371us (44779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.906224:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1425 00000001:00080000:1.0:1790771165.906285:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967594 is committed 00000001:00080000:1.0:1790771165.906293:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967593 is committed 00000001:00080000:1.0:1790771165.906297:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967591 is committed 00000001:00080000:1.0:1790771165.906306:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967585 is committed 00000100:00100000:2.0:1790771165.906378:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2397:x1877759533756672:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1405us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.906380:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.906388:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 932 00000100:00100000:1.0:1790771165.906413:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533759872 00000100:00100000:1.0:1790771165.906418:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533759872 00000100:00100000:0.0:1790771165.906422:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.906451:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1429 00000100:00100000:2.0:1790771165.906451:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533760256 00000100:00100000:2.0:1790771165.906457:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533760256 00000100:00100000:1.0:1790771165.906462:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14395:x1877759533759872:12345-192.168.204.50@tcp:35:rm.0 00002000:00100000:2.0:1790771165.906482:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x15:0x0] (0->524287) req@ffff8bfb03023800 x1877759533760256/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771165.906518:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03023800 with x1877759533760256 ext(0->524287) 00002000:00010000:2.0:1790771165.906522:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03023800 00000100:00100000:2.0:1790771165.906539:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 378 00000100:00100000:2.0:1790771165.906548:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533760256:12345-192.168.204.50@tcp:4:dd.0 00000100:00100000:1.0:1790771165.906569:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14395:x1877759533759872:12345-192.168.204.50@tcp:35:rm.0 Request processed in 108us (192us total) trans 4294968593 rc 0/0 00000100:00100000:1.0:1790771165.906576:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1429 00000100:00100000:0.0:1790771165.906622:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.906646:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533760512 00000100:00100000:1.0:1790771165.906650:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533760512 00000100:00100000:1.0:1790771165.906690:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5682 00002000:00010000:0.0:1790771165.906698:0:8409:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime: 0 -> 1790771165 00000100:00100000:1.0:1790771165.906699:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14701:x1877759533760512:12345-192.168.204.50@tcp:36:chmod.0 00002000:00010000:0.0:1790771165.906706:0:8409:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1790771165 00000100:00100000:0.0:1790771165.906721:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539722624:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771165.906722:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790771165.906738:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f056c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32f1d expref: 113 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906747:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c4853d9/0xfa0c505d97f0b7bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352a9 expref: 30 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.906753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.906756:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0b467 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35152 expref: 112 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906769:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c4853d9/0xfa0c505d97f0b7bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352a9 expref: 30 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.906774:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f01638 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e317e6 expref: 111 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.906781:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0800, rc 0) 00010000:00010000:1.0:1790771165.906786:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771165.906790:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.906802:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.906812:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 129 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.906813:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2398:x1877759533752576:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 46238us (46446us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.906824:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761152 00010000:00010000:1.0:1790771165.906829:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.906831:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761152 00000100:00100000:0.0:1790771165.906836:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 926 00010000:00010000:1.0:1790771165.906854:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 129 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.906863:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 129 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.906875:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1430 00000100:00100000:1.0:1790771165.906878:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b21180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539724160:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.906890:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13741:x1877759533761152:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771165.906892:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.906918:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.906930:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.906938:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761408 00000100:00100000:1.0:1790771165.906943:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761408 00000100:00100000:0.0:1790771165.906953:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761536 00000100:00100000:0.0:1790771165.906958:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761536 00000100:00100000:1.0:1790771165.906975:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5683 00000100:00100000:1.0:1790771165.906984:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:13975:x1877759533761408:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771165.906996:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5684 00010000:00010000:1.0:1790771165.907007:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1790771165.907008:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13742:x1877759533761536:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.907009:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13741:x1877759533761152:12345-192.168.204.50@tcp:35:ls.0 Request processed in 119us (258us total) trans 4294968594 rc 0/0 00010000:00010000:1.0:1790771165.907022:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0b60b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ec expref: 111 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907024:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.907027:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1430 00010000:00010000:0.0:1790771165.907036:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0ba10 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35304 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907050:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe000/0xfa0c505d97f0358e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32331 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907059:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:1.0:1790771165.907062:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.907065:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907074:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907075:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907095:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907096:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 129 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907114:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.907130:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.907131:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 129 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.907138:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:2.0:1790771165.907151:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.907155:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 129 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.907166:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539724288:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.907174:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0ba10 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 138 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907190:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 137 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.907196:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffe40 going to sleep for 11 seconds 00010000:00010000:0.0:1790771165.907197:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:0.0:1790771165.907201:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.907204:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00000100:00100000:0.0:1790771165.907233:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13742:x1877759533761536:12345-192.168.204.50@tcp:101:ls.0 Request processed in 230us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.907240:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5684 00000100:00100000:3.0:1790771165.907245:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762944 00000100:00100000:3.0:1790771165.907252:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762944 00000100:00100000:1.0:1790771165.907289:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.907311:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763456 00000100:00100000:0.0:1790771165.907315:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763456 00000100:00100000:0.0:1790771165.907339:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5685 00000100:00100000:0.0:1790771165.907343:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13665:x1877759533763456:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.907350:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.907356:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0ba25 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35025 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907387:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0ba2c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907397:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0ba2c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907407:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0ba2c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.907417:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.907426:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5686 00000100:00100000:3.0:1790771165.907437:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:11864:x1877759533762944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.907446:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.907454:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29017480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:9499:1877759539722752:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771165.907455:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ba3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350aa expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907473:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0ba25 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35025 expref: 140 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907475:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.907525:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0ba2c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35025 expref: 139 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907531:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771165.907534:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.907535:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ba41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907537:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4ae00, rc 0) 00000100:00100000:1.0:1790771165.907545:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759533753216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 46630us (46741us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.907549:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ba41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.907562:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1546 00010000:00010000:3.0:1790771165.907563:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ba41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.907571:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:13665:x1877759533763456:12345-192.168.204.50@tcp:101:ls.0 Request processed in 223us (278us total) trans 4294968595 rc 0/0 00000100:00100000:2.0:1790771165.907575:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:3.0:1790771165.907582:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.907587:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5685 00000100:00100000:2.0:1790771165.907600:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761664 00000100:00100000:2.0:1790771165.907604:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761664 00010000:00010000:3.0:1790771165.907630:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ba3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350aa expref: 133 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.907638:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5687 00010000:00010000:3.0:1790771165.907647:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ba41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350aa expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.907651:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14383:x1877759533761664:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:1.0:1790771165.907658:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.907667:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.907668:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.907687:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.907691:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592a00, rc 0) 00010000:00010000:2.0:1790771165.907694:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0ba4f lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3530b expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.907699:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761920 00000100:00100000:1.0:1790771165.907706:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.907707:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761920 00000100:00100000:3.0:1790771165.907717:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:11864:x1877759533762944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 282us (570us total) trans 4294969176 rc 0/0 00000100:00100000:3.0:1790771165.907724:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5686 00000100:00100000:1.0:1790771165.907726:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762048 00002000:00010000:0.0:1790771165.907728:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (20983->18446744073709551615) 00000100:00100000:1.0:1790771165.907731:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762048 00002000:00100000:0.0:1790771165.907732:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06d14380 with x1877759533761920 ext(20983->18446744073709551615) 00010000:00010000:2.0:1790771165.907737:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0ba56 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907744:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 25 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.907748:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0ba56 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.907763:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0ba56 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.907767:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 25 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.907767:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 737 00000100:00100000:1.0:1790771165.907782:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2397:x1877759533762048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1790771165.907784:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06d14380. 00000004:00200000:2.0:1790771165.907790:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.907793:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:2.0:1790771165.907794:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1790771165.907808:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0b7d9 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3529b expref: 132 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.907817:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 86 00010000:00010000:2.0:1790771165.907818:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0ba4f lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3530b expref: 141 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.907821:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:1.0:1790771165.907828:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.907833:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533761920:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:2.0:1790771165.907840:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0ba56 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3530b expref: 140 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.907847:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000100:00100000:1.0:1790771165.907850:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2397:x1877759533762048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (143us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.907851:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771165.907856:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669400, rc 0) 00000100:00100000:1.0:1790771165.907861:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 737 00000100:00100000:2.0:1790771165.907884:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14383:x1877759533761664:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 238us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.907891:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5687 00000100:00100000:1.0:1790771165.907900:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.907920:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533761792 00000100:00100000:3.0:1790771165.907925:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533761792 00000100:00100000:3.0:1790771165.907960:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 738 00000100:00100000:3.0:1790771165.907969:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759533761792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1790771165.907972:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 13777 -> 20983 00002000:00010000:0.0:1790771165.907977:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771164 -> 1790771165 00010000:00010000:3.0:1790771165.907977:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790771165.907980:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771165.907983:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00002000:00010000:0.0:1790771165.907986:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 16 -> 16 00010000:00010000:3.0:1790771165.907992:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0b7e7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ff4 expref: 140 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908004:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:3.0:1790771165.908007:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.908015:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533761920:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 189us (363us total) trans 4294967590 rc 0/0 00000100:00100000:0.0:1790771165.908022:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 86 00002000:00010000:0.0:1790771165.908025:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (20983->18446744073709551615) 00000100:00100000:3.0:1790771165.908030:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533761792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (129us total) trans 0 rc 0/0 00002000:00100000:0.0:1790771165.908031:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06d14380 with x1877759533761920 ext(20983->18446744073709551615) 00010000:00010000:0.0:1790771165.908044:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.908044:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 738 00000100:00100000:1.0:1790771165.908054:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.908065:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 26 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.908065:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762176 00000100:00100000:3.0:1790771165.908070:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762176 00002000:00010000:0.0:1790771165.908075:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06d14380. 00000100:00100000:0.0:1790771165.908114:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539722880:192.168.204.50@tcp:104: 00002000:00010000:2.0:1790771165.908119:0:13796:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime: 1752421453 -> 1790771165 00000100:00100000:2.0:1790771165.908131:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539723136:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771165.908135:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.908135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.908157:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762304 00010000:00010000:2.0:1790771165.908161:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6767e97/0xfa0c505d97f0b834 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352b0 expref: 25 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.908162:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762304 00010000:00010000:1.0:1790771165.908178:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 139 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908179:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6767e97/0xfa0c505d97f0b834 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352b0 expref: 25 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908204:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058ae600, rc 0) 00000100:00100000:0.0:1790771165.908215:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.908219:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1550 00000100:00100000:1.0:1790771165.908230:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533762304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.908236:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533753984:12345-192.168.204.50@tcp:101:cat.0 Request processed in 45868us (46497us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771165.908238:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.908240:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762560 00000100:00100000:0.0:1790771165.908246:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762560 00010000:00010000:1.0:1790771165.908248:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 139 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908250:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 929 00010000:00010000:1.0:1790771165.908263:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 139 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908275:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x48:0x0].0x0 (ffff8bfb0321e300) 00000100:00100000:0.0:1790771165.908280:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5688 00010000:00010000:1.0:1790771165.908280:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908291:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.908295:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:11969:x1877759533762560:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.908301:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.908310:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908312:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.908325:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ba5d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35312 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908327:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.908331:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908356:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.908357:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533762304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.908363:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1551 00010000:00010000:0.0:1790771165.908367:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.908373:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1550 00000100:00100000:3.0:1790771165.908378:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533762176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.908382:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 2/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908388:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.908392:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762432 00000100:00100000:2.0:1790771165.908393:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.908396:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762432 00010000:00010000:3.0:1790771165.908399:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908414:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908423:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908424:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.908428:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 739 00000100:00100000:1.0:1790771165.908440:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533762432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.908446:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f00640 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31228 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908448:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908451:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.908462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.908468:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfb03026800) 00010000:00010000:1.0:1790771165.908469:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0b842 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3526a expref: 139 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908470:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908478:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908479:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763840 00000100:00100000:2.0:1790771165.908511:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763840 00010000:00010000:1.0:1790771165.908514:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771165.908521:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.908525:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.908526:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764224 00000100:00100000:0.0:1790771165.908533:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764224 00010000:00010000:3.0:1790771165.908534:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908539:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533760000 00000100:00100000:1.0:1790771165.908544:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759533762432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.908545:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533760000 00000100:00100000:1.0:1790771165.908554:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 739 00010000:00010000:3.0:1790771165.908559:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.908572:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762688 00000100:00100000:0.0:1790771165.908577:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762688 00000100:00100000:2.0:1790771165.908582:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5689 00000100:00100000:3.0:1790771165.908587:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533762176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 213us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.908591:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5690 00000100:00100000:2.0:1790771165.908596:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:13672:x1877759533763840:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.908603:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1551 00010000:00010000:2.0:1790771165.908606:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.908608:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14699:x1877759533764224:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:0.0:1790771165.908616:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5691 00010000:00010000:2.0:1790771165.908618:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0ba6b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3502c expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908619:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.908628:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13051:x1877759533760000:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771165.908630:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0ba72 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3512f expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908641:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.908643:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f02f67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x48:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3215c expref: 141 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.908655:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539723008:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.908656:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0ba79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352fd expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908665:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0ba80 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908683:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908685:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908690:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0ba80 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908698:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ba8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908716:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0ba80 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908722:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908726:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908727:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.908740:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.908748:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.908750:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908753:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ba8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908775:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908783:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908790:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0ba6b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3502c expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908796:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908805:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0ba80 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3502c expref: 141 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908812:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.908814:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.908817:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38600, rc 0) 00000100:00100000:2.0:1790771165.908839:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13672:x1877759533763840:12345-192.168.204.50@tcp:101:ls.0 Request processed in 250us (544us total) trans 4294968596 rc 0/0 00010000:00010000:0.0:1790771165.908846:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0ba79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352fd expref: 132 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908847:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5689 00000100:00100000:2.0:1790771165.908865:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5692 00010000:00010000:1.0:1790771165.908870:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.908876:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14724:x1877759533762688:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771165.908878:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ba8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352fd expref: 131 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.908890:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.908894:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:1.0:1790771165.908894:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908899:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.908900:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0baaa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35319 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.908905:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1a00, rc 0) 00010000:00010000:1.0:1790771165.908914:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.908925:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 38336 00010000:00010000:2.0:1790771165.908927:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.908935:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13051:x1877759533760000:12345-192.168.204.50@tcp:101:dd.0 Request processed in 312us (517us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.908937:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771165.908937:0:13765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9648 00000100:00100000:0.0:1790771165.908949:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5691 00010000:00010000:2.0:1790771165.908953:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771165.908967:0:13765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9760 00010000:00010000:1.0:1790771165.908975:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908987:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.908995:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909002:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909006:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.909012:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.909016:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0baaa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 87 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909025:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909028:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfcc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.909038:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909043:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 86 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909044:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909056:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909067:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771165.909071:0:13765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.909076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.909076:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771165.909082:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:2.0:1790771165.909082:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487f200, rc 0) 00010000:00010000:1.0:1790771165.909090:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.909091:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909096:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 3/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909107:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0ba87 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.909109:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:14724:x1877759533762688:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 236us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.909124:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5692 00000100:00100000:0.0:1790771165.909132:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.909132:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.909137:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763072 00000100:00100000:2.0:1790771165.909142:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763072 00010000:00010000:3.0:1790771165.909148:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909150:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909170:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.909177:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5693 00010000:00010000:1.0:1790771165.909181:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc029cbc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.909182:0:13765:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771165.909188:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.909190:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14382:x1877759533763072:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771165.909200:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909203:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.909212:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bac6 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35320 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909219:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909223:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909245:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0xcdd6ff3 (ffff8bfc0ab7e500) 00010000:00010000:3.0:1790771165.909245:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909249:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0bacd lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909254:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.909260:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909263:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0bacd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909277:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0ba9c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909278:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0bacd lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909302:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771165.909305:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.909308:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.909309:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1790771165.909315:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763328 00000100:00100000:1.0:1790771165.909321:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763328 00010000:00010000:3.0:1790771165.909323:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.909328:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bac6 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35320 expref: 144 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909343:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x48:0x0].0x0 (ffff8bfb0321e300) 00010000:00010000:2.0:1790771165.909347:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0bacd lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35320 expref: 143 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909349:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:1.0:1790771165.909352:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 740 00010000:00010000:3.0:1790771165.909357:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 2/0,0 mode: --/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.909364:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533763328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.909364:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:2.0:1790771165.909372:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.909378:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.909378:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fa00, rc 0) 00010000:00010000:3.0:1790771165.909379:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0b81f lrc: 0/0,0 mode: --/EX res: [0x240000402:0x48:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909394:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0b87a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352cc expref: 131 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909402:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909405:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:1.0:1790771165.909412:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.909412:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14382:x1877759533763072:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 224us (340us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.909421:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.909422:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5693 00010000:00010000:3.0:1790771165.909434:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.909441:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533763328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (310us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.909447:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.909452:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 740 00010000:00010000:3.0:1790771165.909455:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909471:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909475:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771165.909482:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909513:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771165.909516:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909521:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909530:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x48:0x0].0x0 (ffff8bfb0321e300) 00010000:00010000:1.0:1790771165.909532:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771165.909535:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 1/0,0 mode: --/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909539:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0babf lrc: 0/0,0 mode: --/PW res: [0x240000402:0x48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909547:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.909549:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.909550:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771165.909568:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0ba72 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 143 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.909579:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 142 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909581:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:1.0:1790771165.909585:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771165.909589:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771165.909589:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.909594:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cafe00, rc 0) 00010000:00010000:3.0:1790771165.909596:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.909617:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14699:x1877759533764224:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 1016us (1231us total) trans 4294968597 rc 0/0 00000100:00100000:1.0:1790771165.909625:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5690 00010000:00010000:3.0:1790771165.909649:0:13765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909658:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909698:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909707:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0b620 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.909720:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.909727:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.909743:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.909745:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771165.909753:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.909762:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cd4fe17 reply state 00000000ae79acd9 transno 4294968598 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.909769:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ba5d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35312 expref: 86 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909783:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.909788:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35312 expref: 85 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909798:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0xf7a5b27a (ffff8bfc20109000) 00010000:00010000:0.0:1790771165.909799:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:0.0:1790771165.909805:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771165.909805:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.909811:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0c00, rc 0) 00000100:00100000:3.0:1790771165.909812:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771165.909847:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:11969:x1877759533762560:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1555us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.909853:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:13894:x1877759533741696:12345-192.168.204.50@tcp:36:rm.0 Request processed in 91928us (92406us total) trans 4294968598 rc 0/0 00000100:00100000:0.0:1790771165.909862:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5688 00000100:00100000:3.0:1790771165.909875:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5620 00010000:00010000:3.0:1790771165.909912:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.909922:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.910105:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ed6cf6cf reply state 00000000872985b8 transno 4294969177 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910118:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910127:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfb03026800) 00010000:00010000:3.0:1790771165.910130:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771165.910132:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771165.910137:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910145:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910153:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910159:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.910163:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910171:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910186:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.910188:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.910192:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910200:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0b7fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.910211:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ed6cf6cf reply state 00000000872985b8 transno 4294969177 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910220:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.910228:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc1ae7fc00) 00010000:00010000:3.0:1790771165.910231:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.910233:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790771165.910274:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14319:x1877759533753472:12345-192.168.204.50@tcp:36:ln.0 Request processed in 48487us (48998us total) trans 4294969177 rc 0/0 00000100:00100000:3.0:1790771165.910283:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5656 00000100:00100000:3.0:1790771165.910312:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533762816 00000100:00100000:3.0:1790771165.910317:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533762816 00000100:00100000:3.0:1790771165.910348:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1431 00000100:00100000:3.0:1790771165.910359:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14008:x1877759533762816:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771165.912669:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.912706:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.912716:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764352 00000100:00100000:0.0:1790771165.912721:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764352 00000100:00100000:1.0:1790771165.912728:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.912750:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764736 00000100:00100000:3.0:1790771165.912752:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764864 00000100:00100000:0.0:1790771165.912753:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764736 00000100:00100000:3.0:1790771165.912761:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764864 00000100:00100000:2.0:1790771165.912765:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5694 00000100:00100000:2.0:1790771165.912778:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14432:x1877759533764352:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:0.0:1790771165.912787:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5695 00010000:00010000:2.0:1790771165.912788:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.912803:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:12253:x1877759533764736:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.912803:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bad4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350b1 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.912804:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5696 00010000:00010000:0.0:1790771165.912819:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.912819:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14277:x1877759533764864:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:1.0:1790771165.912831:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.912834:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0badb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350b8 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.912843:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0bae2 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35198 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.912853:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.912900:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bad4 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350b1 expref: 136 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.912901:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0baf0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.912905:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.912920:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.912926:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0baf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.912926:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.912928:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.912933:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bad4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350b1 expref: 136 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.912948:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0baf0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.912952:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.912957:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fe00, rc 0) 00000004:00200000:0.0:1790771165.912968:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.912977:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.912984:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.912989:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.912997:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14432:x1877759533764352:12345-192.168.204.50@tcp:101:rm.0 Request processed in 222us (327us total) trans 4294969178 rc 301/301 00000100:00100000:2.0:1790771165.913003:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5694 00000004:00200000:1.0:1790771165.913006:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:0.0:1790771165.913018:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0badb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350b8 expref: 136 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913018:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913035:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913050:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913055:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.913057:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0baf0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350b8 expref: 135 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913064:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfca00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.913068:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.913070:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:0.0:1790771165.913077:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.913080:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00010000:00010000:1.0:1790771165.913080:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913090:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.913093:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.913096:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913101:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0baf7 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913109:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.913114:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:12253:x1877759533764736:12345-192.168.204.50@tcp:101:ls.0 Request processed in 318us (405us total) trans 4294969179 rc 0/0 00010000:00010000:1.0:1790771165.913116:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913124:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.913128:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5695 00010000:00010000:1.0:1790771165.913134:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.913138:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913143:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913151:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc0ab7e900) 00010000:00010000:1.0:1790771165.913154:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.913156:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913160:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bafe lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913178:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0bae2 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35198 expref: 143 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913184:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.913186:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.913190:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0bae2 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35198 expref: 143 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.913196:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caee00, rc 0) 00000100:00100000:1.0:1790771165.913224:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14277:x1877759533764864:12345-192.168.204.50@tcp:101:touch.0 Request processed in 411us (498us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771165.913230:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5696 00000100:00100000:3.0:1790771165.916463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.916531:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533766656 00000100:00100000:2.0:1790771165.916537:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533766656 00000100:00100000:2.0:1790771165.916569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5697 00000100:00100000:2.0:1790771165.916577:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:13266:x1877759533766656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.916585:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.916593:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb0c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35327 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916633:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916641:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916647:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916655:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916660:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916665:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.916722:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.916750:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916755:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916759:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916766:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916770:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.916772:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916776:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916781:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.916783:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.916785:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916789:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb13 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916796:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916801:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916805:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916808:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.916810:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916816:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916821:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771165.916822:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.916824:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916827:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916846:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb0c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35327 expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916851:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.916853:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.916855:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb0c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35327 expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.916860:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ee00, rc 0) 00000100:00100000:2.0:1790771165.916889:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13266:x1877759533766656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 313us (427us total) trans 4294969180 rc 301/301 00000100:00100000:2.0:1790771165.916894:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5697 00000100:00100000:0.0:1790771165.917047:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.917078:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533767168 00000100:00100000:2.0:1790771165.917082:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533767168 00000100:00100000:2.0:1790771165.917113:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5698 00000100:00100000:2.0:1790771165.917119:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:11863:x1877759533767168:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.917128:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.917134:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bb28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350bf expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.917167:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bb2f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.917175:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bb2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.917181:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bb2f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.917186:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.917220:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bb28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350bf expref: 138 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.917229:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bb2f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350bf expref: 137 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.917234:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.917235:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.917237:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e000, rc 0) 00000100:00100000:2.0:1790771165.917261:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:11863:x1877759533767168:12345-192.168.204.50@tcp:101:ls.0 Request processed in 143us (215us total) trans 4294969181 rc 0/0 00000100:00100000:2.0:1790771165.917266:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5698 00000100:00100000:0.0:1790771165.949862:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.949901:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.949929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.949931:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533767808 00000100:00100000:2.0:1790771165.949941:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533767808 00000100:00100000:1.0:1790771165.949967:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533768192 00000100:00100000:1.0:1790771165.949975:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533768192 00000100:00100000:3.0:1790771165.949978:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533768576 00000100:00100000:2.0:1790771165.950005:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5699 00000100:00100000:1.0:1790771165.950019:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5700 00000100:00100000:2.0:1790771165.950020:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:11954:x1877759533767808:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.950033:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:12238:x1877759533768192:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.950043:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.950044:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.950065:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bb44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350d4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950066:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bb3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350cd expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950073:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.950081:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533768576 00000100:00100000:3.0:1790771165.950116:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5701 00000100:00100000:1.0:1790771165.950124:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763200 00000100:00100000:1.0:1790771165.950129:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763200 00000100:00100000:0.0:1790771165.950170:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.950170:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 741 00000100:00100000:1.0:1790771165.950186:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2396:x1877759533763200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.950200:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.950203:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539723264:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771165.950219:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:11972:x1877759533768576:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.950225:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0b85e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35087 expref: 141 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950243:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000046f381db/0xfa0c505d97f0b86c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352be expref: 28 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950244:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:1.0:1790771165.950249:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.950254:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.950277:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.950284:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046f381db/0xfa0c505d97f0b86c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352be expref: 28 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950295:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765120 00010000:00010000:2.0:1790771165.950298:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996400, rc 0) 00000100:00100000:0.0:1790771165.950300:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765120 00000100:00100000:1.0:1790771165.950302:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2396:x1877759533763200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.950310:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 741 00000100:00100000:1.0:1790771165.950328:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763584 00000100:00100000:1.0:1790771165.950331:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763584 00000100:00100000:2.0:1790771165.950341:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2397:x1877759533754368:12345-192.168.204.50@tcp:101:chown.0 Request processed in 87186us (87267us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771165.950342:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1432 00000100:00100000:2.0:1790771165.950357:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 930 00000100:00100000:1.0:1790771165.950363:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 742 00000100:00100000:0.0:1790771165.950364:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:11971:x1877759533765120:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.950375:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2397:x1877759533763584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.950383:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.950395:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0b896 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ffb expref: 142 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950408:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771165.950411:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.950422:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb4b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.950432:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759533763584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 59us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.950440:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 742 00010000:00010000:2.0:1790771165.950442:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950457:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb4b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.950470:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.950475:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764608 00000100:00100000:1.0:1790771165.950478:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764608 00000100:00100000:0.0:1790771165.950538:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:11971:x1877759533765120:12345-192.168.204.50@tcp:35:ls.0 Request processed in 183us (260us total) trans 4294968599 rc 0/0 00000100:00100000:0.0:1790771165.950546:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1432 00000100:00100000:1.0:1790771165.950551:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5702 00000100:00100000:1.0:1790771165.950560:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:14211:x1877759533764608:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:1.0:1790771165.950583:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.950588:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bb44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350d4 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950598:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0ad3d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34da8 expref: 87 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950600:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.950606:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb4b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350d4 expref: 140 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950616:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4d:0x0].0x0 (ffff8bfc2900ac00) 00000100:00100000:0.0:1790771165.950623:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763968 00010000:00010000:1.0:1790771165.950624:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.950630:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763968 00010000:00010000:2.0:1790771165.950631:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.950635:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.950638:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ee00, rc 0) 00010000:00010000:1.0:1790771165.950644:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950655:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950659:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 743 00000100:00100000:2.0:1790771165.950665:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:11954:x1877759533767808:12345-192.168.204.50@tcp:101:ls.0 Request processed in 648us (809us total) trans 4294969182 rc 0/0 00010000:00010000:1.0:1790771165.950692:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 141 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.950693:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5699 00000100:00100000:0.0:1790771165.950694:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2398:x1877759533763968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.950710:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 141 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.950711:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.950724:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 141 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.950728:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0b8dc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35002 expref: 141 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950735:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 141 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950737:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.950745:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771165.950747:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 140 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950750:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb60 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35335 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.950751:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.950765:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 140 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950773:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2398:x1877759533763968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.950775:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 140 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.950785:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 743 00010000:00010000:1.0:1790771165.950789:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 140 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950793:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950797:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 139 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950807:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950808:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 13/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950826:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950851:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950857:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 139 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950860:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950878:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950887:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.950899:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724416:192.168.204.50@tcp:104: 00000004:00200000:2.0:1790771165.950952:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.950964:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 139 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.950974:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 139 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.950984:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724544:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.950990:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.950998:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951004:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951009:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951015:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 139 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951018:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771165.951019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.951026:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951032:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 139 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951035:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951051:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724672:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.951052:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.951056:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.951059:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951063:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bb67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951074:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951076:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 139 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951100:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 139 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951100:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951119:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.951135:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765760 00010000:00010000:2.0:1790771165.951136:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.951139:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.951141:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.951142:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765760 00010000:00010000:2.0:1790771165.951150:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951156:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771165.951159:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.951161:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951166:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bb6e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951184:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 140 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951196:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb60 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35335 expref: 88 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951200:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 140 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.951207:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.951213:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.951218:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bb60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35335 expref: 88 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951221:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724928:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.951244:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00000100:00100000:3.0:1790771165.951244:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5703 00000100:00100000:3.0:1790771165.951257:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14341:x1877759533765760:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771165.951264:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 140 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.951275:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:11972:x1877759533768576:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1150us (1341us total) trans 4294968600 rc 301/301 00010000:00010000:1.0:1790771165.951276:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 140 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.951295:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5701 00000100:00100000:1.0:1790771165.951299:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064af480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725056:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.951327:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 140 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951335:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 140 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951343:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725184:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.951361:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.951368:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 140 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951381:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 140 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951388:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725312:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.951411:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.951419:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 140 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951426:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 140 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951433:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725440:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.951454:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 140 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951462:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 140 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951471:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725568:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.951519:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.951553:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b20e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539723776:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.951570:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [16384->24575] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 26 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951581:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd000, rc 0) 00000100:00100000:0.0:1790771165.951597:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.951601:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:14015:x1877759533755904:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 47928us (48012us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.951608:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.951609:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 931 00010000:00010000:3.0:1790771165.951627:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ae16 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dd9 expref: 140 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951640:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533763712 00010000:00010000:3.0:1790771165.951642:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00000100:00100000:1.0:1790771165.951645:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533763712 00000100:00100000:0.0:1790771165.951649:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.951664:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 112 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951709:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765248 00000100:00100000:1.0:1790771165.951713:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765248 00000100:00100000:0.0:1790771165.951714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.951738:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.951745:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765504 00000100:00100000:1.0:1790771165.951749:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765504 00010000:00010000:3.0:1790771165.951764:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.951776:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 86 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.951777:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.951782:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1552 00000100:00100000:1.0:1790771165.951791:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2396:x1877759533763712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.951798:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.951801:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770496 00010000:00010000:1.0:1790771165.951803:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 112 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.951806:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770496 00010000:00010000:1.0:1790771165.951818:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 112 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951829:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00000100:00100000:0.0:1790771165.951834:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770752 00010000:00010000:1.0:1790771165.951834:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.951838:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770752 00010000:00010000:1.0:1790771165.951844:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951856:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.951866:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5704 00010000:00010000:3.0:1790771165.951867:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 4/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.951878:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:11955:x1877759533770496:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771165.951878:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2396:x1877759533763712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.951891:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1552 00010000:00010000:0.0:1790771165.951893:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.951904:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0bb83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350db expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951908:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 744 00000100:00100000:1.0:1790771165.951920:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2396:x1877759533765248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.951928:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.951929:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 86 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951940:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0b91b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35009 expref: 141 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.951943:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 86 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.951955:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0bb8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.951960:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:3.0:1790771165.951963:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539725696:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.951965:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.951966:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0bb8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.951977:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0bb8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.951981:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2396:x1877759533765248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 61us (382us total) trans 0 rc 0/0 00000004:00200000:0.0:1790771165.951991:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.951994:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 744 00000100:00100000:3.0:1790771165.951996:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.952012:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 745 00000100:00100000:1.0:1790771165.952022:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533765504:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.952026:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5705 00010000:00010000:1.0:1790771165.952033:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.952040:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14512:x1877759533770752:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:3.0:1790771165.952040:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533766400 00010000:00010000:1.0:1790771165.952046:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0b937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350a3 expref: 144 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952047:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533766400 00010000:00010000:2.0:1790771165.952052:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.952054:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0bb83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350db expref: 144 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952063:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.952065:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0bb98 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3525c expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952068:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.952078:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0bb8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350db expref: 142 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952086:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533765504:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.952089:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1433 00010000:00010000:0.0:1790771165.952100:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00000100:00100000:1.0:1790771165.952101:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 745 00010000:00010000:0.0:1790771165.952106:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:3.0:1790771165.952108:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13264:x1877759533766400:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771165.952111:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5000, rc 0) 00010000:00010000:2.0:1790771165.952124:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952137:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:11955:x1877759533770496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 261us (488us total) trans 4294969183 rc 0/0 00010000:00010000:2.0:1790771165.952138:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952146:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f08eb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3432f expref: 112 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952152:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5704 00010000:00010000:2.0:1790771165.952155:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.952169:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.952174:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723392:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.952197:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723520:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.952217:0:12128:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000004a77a5ab x1877759539723648) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 140 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952228:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13264:x1877759533766400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 123us (863us total) trans 4294969184 rc 0/0 00000100:00100000:0.0:1790771165.952231:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.952234:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0bb98 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 142 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952241:0:12128:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 140 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952252:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1433 00010000:00010000:1.0:1790771165.952272:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0837c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33f69 expref: 140 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952277:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 141 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952284:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.952290:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765888 00000100:00100000:3.0:1790771165.952298:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765888 00000100:00100000:1.0:1790771165.952303:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539723648:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.952307:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.952311:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.952313:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487e600, rc 0) 00010000:00010000:1.0:1790771165.952330:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771165.952335:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.952342:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14512:x1877759533770752:12345-192.168.204.50@tcp:101:rm.0 Request processed in 304us (564us total) trans 4294968601 rc 0/0 00000100:00100000:3.0:1790771165.952347:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 746 00010000:00010000:1.0:1790771165.952348:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952352:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.952362:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5705 00010000:00010000:1.0:1790771165.952364:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952369:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2396:x1877759533765888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.952382:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.952384:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772032 00000100:00100000:2.0:1790771165.952388:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772032 00010000:00010000:3.0:1790771165.952399:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0b8ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35095 expref: 140 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952414:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.952414:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0bbad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.952417:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:3.0:1790771165.952427:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.952429:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0bbad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.952432:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772416 00000100:00100000:2.0:1790771165.952438:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772416 00010000:00010000:1.0:1790771165.952441:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0bbad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952445:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5706 00000004:00200000:1.0:1790771165.952453:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1b:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.952454:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759533765888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.952462:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14736:x1877759533772032:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:2.0:1790771165.952471:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5707 00000100:00100000:3.0:1790771165.952472:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 746 00010000:00010000:0.0:1790771165.952475:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.952507:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14066:x1877759533772416:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.952515:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0bbbb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352b7 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952524:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533766144 00000100:00100000:3.0:1790771165.952529:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533766144 00010000:00010000:1.0:1790771165.952541:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0bb3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350cd expref: 141 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952554:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0bbad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350cd expref: 140 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952556:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.952563:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:0.0:1790771165.952567:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0bbc2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952568:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 747 00010000:00010000:1.0:1790771165.952569:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.952570:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bbc9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3533c expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.952574:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00000100:00100000:3.0:1790771165.952587:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2396:x1877759533766144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.952591:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0bbc2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952598:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:12238:x1877759533768192:12345-192.168.204.50@tcp:101:ls.0 Request processed in 2569us (2694us total) trans 4294969185 rc 0/0 00010000:00010000:3.0:1790771165.952603:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.952604:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0bbc2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952609:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5700 00000004:00200000:0.0:1790771165.952620:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.952620:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.952624:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0b914 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3509c expref: 139 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952640:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952650:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.952650:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:3.0:1790771165.952660:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.952665:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.952688:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.952694:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0bbbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352b7 expref: 144 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952707:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533766144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.952711:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952718:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.952727:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84600/0xfa0c505d97f0bbc2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352b7 expref: 143 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952731:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952733:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 747 00010000:00010000:0.0:1790771165.952747:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:1.0:1790771165.952749:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.952754:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.952758:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84600, rc 0) 00000100:00100000:3.0:1790771165.952760:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533764096 00000100:00100000:3.0:1790771165.952766:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533764096 00000100:00100000:1.0:1790771165.952768:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765376 00000100:00100000:1.0:1790771165.952773:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765376 00000100:00100000:0.0:1790771165.952779:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14736:x1877759533772032:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 321us (499us total) trans 4294968602 rc 0/0 00000100:00100000:0.0:1790771165.952787:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5706 00010000:00010000:3.0:1790771165.952787:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 139 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.952796:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.952802:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 748 00000100:00100000:0.0:1790771165.952809:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772544 00000100:00100000:1.0:1790771165.952810:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759533765376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.952814:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772544 00010000:00010000:1.0:1790771165.952819:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.952829:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1553 00010000:00010000:1.0:1790771165.952833:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0b8e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3508e expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952845:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.952846:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759533764096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.952851:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00000100:00100000:0.0:1790771165.952857:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5708 00010000:00010000:1.0:1790771165.952859:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.952865:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.952867:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.952872:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14006:x1877759533772544:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771165.952876:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 139 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952880:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759533765376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (134us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.952888:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.952890:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.952899:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0bbec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350e2 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952900:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 748 00010000:00010000:3.0:1790771165.952913:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 138 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952914:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.952923:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.952933:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.952937:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0b5e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d0 expref: 139 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952943:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771165.952947:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.952962:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771165.952968:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:2.0:1790771165.952969:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.952971:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.952978:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.952978:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.952988:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533765632 00000100:00100000:1.0:1790771165.952994:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533765632 00010000:00010000:0.0:1790771165.952999:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0bbec lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350e2 expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953001:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0bbd0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.953004:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.953017:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 749 00010000:00010000:0.0:1790771165.953020:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.953027:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.953029:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771165.953029:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533765632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.953040:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0bbec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350e2 expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953041:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.953057:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0b94c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35010 expref: 143 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953061:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.953062:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.953066:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00010000:00010000:1.0:1790771165.953072:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771165.953073:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953078:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.953083:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.953086:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533764096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 246us (422us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.953092:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.953097:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953099:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14006:x1877759533772544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 229us (385us total) trans 4294969186 rc 301/301 00000100:00100000:3.0:1790771165.953100:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1553 00000100:00100000:1.0:1790771165.953109:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533765632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 77us (137us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.953114:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953120:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5708 00000100:00100000:1.0:1790771165.953126:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 749 00010000:00010000:2.0:1790771165.953132:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc0ab7fc00) 00010000:00010000:2.0:1790771165.953135:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.953139:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953143:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0bbde lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953149:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773568 00000100:00100000:0.0:1790771165.953155:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773568 00010000:00010000:3.0:1790771165.953175:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.953186:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953187:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5709 00000100:00100000:0.0:1790771165.953201:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14002:x1877759533773568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.953212:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.953215:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.953224:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bc01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350e9 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.953232:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.953233:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.953253:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774208 00000100:00100000:1.0:1790771165.953259:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774208 00000100:00100000:1.0:1790771165.953285:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5710 00000100:00100000:2.0:1790771165.953290:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533760256:12345-192.168.204.50@tcp:4:dd.0 Request processed in 46741us (46868us total) trans 4294967595 rc 0/0 00000004:00200000:0.0:1790771165.953295:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.953299:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13270:x1877759533774208:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.953305:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 378 00010000:00010000:3.0:1790771165.953306:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 138 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953312:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1790771165.953317:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000400:0x15:0x0] (0->524287) req@ffff8bfb03023800 x1877759533760256/t4294967595(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/448 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.953322:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 5/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953324:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0bc0f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3536d expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.953348:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bc01 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350e9 expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.953351:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03023800 with x1877759533760256 ext(0->524287) 00002000:00010000:2.0:1790771165.953359:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03023800 00010000:00010000:3.0:1790771165.953364:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.953370:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771165.953376:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.953382:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bc01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350e9 expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953384:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.953388:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 139 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953395:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bbc9 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3533c expref: 89 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.953407:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1400, rc 0) 00010000:00010000:1.0:1790771165.953412:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953425:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.953427:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953428:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1790771165.953428:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539725824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.953435:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14002:x1877759533773568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 233us (492us total) trans 4294969187 rc 301/301 00010000:00010000:2.0:1790771165.953438:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bbc9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3533c expref: 89 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953453:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5709 00010000:00010000:2.0:1790771165.953458:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00010000:00010000:1.0:1790771165.953460:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953468:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953474:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.953501:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:14066:x1877759533772416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1001us (1068us total) trans 4294968603 rc 301/301 00000100:00100000:2.0:1790771165.953508:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5707 00000004:00200000:1.0:1790771165.953543:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.953577:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953582:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953587:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953594:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.953597:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953601:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953608:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.953610:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.953612:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953616:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0bc16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953626:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953631:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953635:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953639:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc029cbc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.953642:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953647:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953657:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7e900) 00010000:00010000:1.0:1790771165.953662:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.953665:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.953666:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953689:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bc1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953719:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0bc0f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3536d expref: 114 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953726:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.953728:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771165.953731:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0bc0f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3536d expref: 114 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.953741:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2a00, rc 0) 00000100:00100000:1.0:1790771165.953759:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13270:x1877759533774208:12345-192.168.204.50@tcp:101:ls.0 Request processed in 466us (532us total) trans 4294969188 rc 301/301 00000100:00100000:1.0:1790771165.953768:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5710 00010000:00010000:3.0:1790771165.953769:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 113 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953795:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.953797:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533766016 00000100:00100000:1.0:1790771165.953801:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533766016 00000100:00100000:0.0:1790771165.953830:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.953838:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 112 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.953840:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533767296 00000100:00100000:1.0:1790771165.953845:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533767296 00000100:00100000:3.0:1790771165.953861:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539725952:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.953873:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 23 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.953877:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533767424 00000100:00100000:2.0:1790771165.953883:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533767424 00000100:00100000:0.0:1790771165.953887:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.953905:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1554 00010000:00010000:2.0:1790771165.953906:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 24 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.953911:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533767936 00000100:00100000:0.0:1790771165.953918:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533767936 00000100:00100000:1.0:1790771165.953920:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533767296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.953930:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.953930:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1555 00002000:00010000:1.0:1790771165.953941:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 1 -> 80 00000100:00100000:2.0:1790771165.953941:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 750 00002000:00100000:0.0:1790771165.953947:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (471040->475135) req@ffff8bfb0644ce00 x1877759533767936/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.953952:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 23 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.953957:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533766016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.953971:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1790771165.953976:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644ce00 with x1877759533767936 ext(471040->475135) 00002000:00010000:0.0:1790771165.953982:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644ce00 00010000:00010000:1.0:1790771165.953982:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 23 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.953989:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0b9d1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3501e expref: 142 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.953990:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533767424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.954007:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 379 00010000:00010000:3.0:1790771165.954010:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.954015:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020b370b6/0xfa0c505d97f08cb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342e2 expref: 23 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.954022:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533767936:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771165.954028:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:3.0:1790771165.954031:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 24 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.954035:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.954036:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771165.954045:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00000100:00100000:2.0:1790771165.954055:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2396:x1877759533766016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (391us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.954060:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.954063:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 24 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954068:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 750 00010000:00010000:1.0:1790771165.954084:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.954111:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954115:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.954123:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1877759539726080:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771165.954130:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533767936:12345-192.168.204.50@tcp:3:cat.0 Request processed in 112us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.954136:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 379 00002000:00100000:0.0:1790771165.954143:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (471040->475135) req@ffff8bfb0644ce00 x1877759533767936/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.954147:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd300 going to sleep for 11 seconds 00002000:00100000:0.0:1790771165.954153:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644ce00 with x1877759533767936 ext(471040->475135) 00002000:00010000:0.0:1790771165.954157:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644ce00 00010000:00010000:3.0:1790771165.954163:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098f3dfd8/0xfa0c505d97f063bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33425 expref: 24 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.954180:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(2 10) 00010000:00010000:3.0:1790771165.954186:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(2 10) 00010000:00010000:3.0:1790771165.954195:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.954207:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954218:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.954246:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.954257:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533768064 00000100:00100000:0.0:1790771165.954262:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533768064 00000100:00100000:3.0:1790771165.954262:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539726208:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771165.954295:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771165.954301:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5711 00000100:00100000:0.0:1790771165.954310:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:14762:x1877759533768064:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:2.0:1790771165.954319:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.954326:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.954339:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35343 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954345:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533768448 00000100:00100000:2.0:1790771165.954350:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533768448 00010000:00010000:0.0:1790771165.954365:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.954366:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.954379:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 4/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 89 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954388:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1434 00000100:00100000:2.0:1790771165.954398:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12256:x1877759533768448:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771165.954409:0:13774:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.954421:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 89 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.954432:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.954435:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.954437:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.954443:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00000100:00100000:0.0:1790771165.954465:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14762:x1877759533768064:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 157us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.954471:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5711 00000100:00100000:2.0:1790771165.954530:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:12256:x1877759533768448:12345-192.168.204.50@tcp:35:ls.0 Request processed in 134us (216us total) trans 4294969189 rc 0/0 00000100:00100000:2.0:1790771165.954541:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1434 00000100:00100000:1.0:1790771165.954545:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.954557:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539724032:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771165.954568:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533769088 00000100:00100000:2.0:1790771165.954572:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533769088 00010000:00010000:0.0:1790771165.954575:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1790771165.954587:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (14680064->18446744073709551615) 00002000:00100000:2.0:1790771165.954591:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb049e8380 with x1877759533769088 ext(14680064->18446744073709551615) 00000100:00100000:0.0:1790771165.954598:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533759360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 48586us (48824us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771165.954598:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb049e8380. 00000100:00100000:0.0:1790771165.954607:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1549 00000100:00100000:2.0:1790771165.954625:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 380 00000100:00100000:1.0:1790771165.954629:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b21180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539724160:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.954638:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533769088:12345-192.168.204.50@tcp:10:dd.0 00010000:00010000:1.0:1790771165.954650:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.954722:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.954749:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 30163 -> 14680064 00002000:00010000:2.0:1790771165.954753:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.954756:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime from disk: 1790771161 -> 0 00000100:00100000:1.0:1790771165.954759:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533769344 00002000:00010000:2.0:1790771165.954759:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:2.0:1790771165.954764:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771165.954766:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533769344 00000100:00100000:0.0:1790771165.954772:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.954788:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954789:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533769088:12345-192.168.204.50@tcp:10:dd.0 Request processed in 154us (248us total) trans 4294967596 rc 0/0 00000100:00100000:2.0:1790771165.954805:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 380 00002000:00010000:2.0:1790771165.954808:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (14680064->18446744073709551615) 00002000:00100000:2.0:1790771165.954813:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb049e8380 with x1877759533769088 ext(14680064->18446744073709551615) 00000100:00100000:0.0:1790771165.954817:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.954821:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb049e8380. 00000100:00100000:1.0:1790771165.954825:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1556 00000100:00100000:1.0:1790771165.954835:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533769344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.954843:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.954847:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954848:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533769600 00000100:00100000:2.0:1790771165.954853:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533769600 00010000:00010000:1.0:1790771165.954860:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.954875:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0b3c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f3e expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954884:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1435 00010000:00010000:1.0:1790771165.954885:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771165.954890:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.954896:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13736:x1877759533769600:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.954903:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.954910:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.954923:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.954927:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.954946:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2396:x1877759533769344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 114us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.954952:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1556 00000100:00100000:1.0:1790771165.954968:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533769856 00000100:00100000:1.0:1790771165.954970:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533769856 00000100:00100000:2.0:1790771165.954988:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:13736:x1877759533769600:12345-192.168.204.50@tcp:35:ls.0 Request processed in 95us (217us total) trans 4294968604 rc 0/0 00000100:00100000:1.0:1790771165.954998:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 751 00000100:00100000:2.0:1790771165.954998:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1435 00000100:00100000:0.0:1790771165.955001:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.955012:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533769856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.955019:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.955028:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533769728 00010000:00010000:1.0:1790771165.955030:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0b97d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35017 expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.955034:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533769728 00010000:00010000:1.0:1790771165.955045:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771165.955048:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.955055:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.955067:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533769856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.955072:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770112 00000100:00100000:1.0:1790771165.955074:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 751 00000100:00100000:0.0:1790771165.955079:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770112 00000100:00100000:2.0:1790771165.955093:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.955116:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770240 00000100:00100000:0.0:1790771165.955121:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770240 00010000:00010000:1.0:1790771165.955123:0:13772:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000007317bb48 x1877759539724288) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 137 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955128:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.955139:0:13772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 137 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.955145:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533775616 00000100:00100000:0.0:1790771165.955150:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533775616 00010000:00010000:1.0:1790771165.955161:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0ab4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d23 expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955164:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5712 00000100:00100000:2.0:1790771165.955176:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14725:x1877759533769728:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771165.955184:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539724288:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.955192:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5713 00010000:00010000:2.0:1790771165.955195:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.955206:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771165.955208:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13742:x1877759533770112:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.955212:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f06ee5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33996 expref: 142 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955215:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.955223:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.955236:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0bc32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35351 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955237:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955240:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00000100:00100000:3.0:1790771165.955244:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06374380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539723904:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771165.955252:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.955261:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955270:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.955271:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4a2487e/0xfa0c505d97f0ba02 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352f6 expref: 24 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955280:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955300:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.955301:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955303:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.955306:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a2487e/0xfa0c505d97f0ba02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352f6 expref: 24 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955326:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955329:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.955332:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.955335:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593200, rc 0) 00010000:00010000:0.0:1790771165.955354:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955356:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533759616:12345-192.168.204.50@tcp:101:chown.0 Request processed in 49442us (49525us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771165.955364:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955365:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955376:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 933 00010000:00010000:0.0:1790771165.955382:0:13764:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955389:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955396:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 141 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955396:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533768832 00010000:00010000:0.0:1790771165.955398:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955401:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955403:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533768832 00000100:00100000:2.0:1790771165.955428:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539726336:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.955439:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5714 00000100:00100000:0.0:1790771165.955449:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14551:x1877759533770240:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:3.0:1790771165.955461:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 934 00000100:00100000:2.0:1790771165.955464:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7540 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.955465:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955473:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759533768832:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:2.0:1790771165.955480:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770624 00010000:00010000:1.0:1790771165.955481:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 138 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955504:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770624 00010000:00010000:1.0:1790771165.955527:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.955535:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.955539:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 752 00010000:00010000:3.0:1790771165.955549:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066ebbdda/0xfa0c505d97f0bc55 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3534a expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955551:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533770624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.955561:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5715 00010000:00010000:2.0:1790771165.955567:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.955576:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14004:x1877759533775616:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.955579:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955581:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ba41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350aa expref: 139 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955589:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.955593:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539726464:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771165.955600:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0bc63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350f0 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.955606:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 142 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.955609:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.955617:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.955620:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955630:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.955638:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533770624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (514us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.955644:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 142 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955649:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 752 00010000:00010000:1.0:1790771165.955650:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0bc6a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.955662:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 142 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955663:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0bc6a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.955695:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0bc6a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.955696:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539726592:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.955696:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14008:x1877759533762816:12345-192.168.204.50@tcp:37:ls.0 Request processed in 45337us (46687us total) trans 0 rc 0/0 00000004:00200000:1.0:1790771165.955716:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.955716:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.955717:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1431 00000100:00100000:0.0:1790771165.955728:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.955744:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770368 00000100:00100000:1.0:1790771165.955749:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770368 00000100:00100000:2.0:1790771165.955759:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.955786:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.955789:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533770880 00000100:00100000:1.0:1790771165.955796:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 753 00000100:00100000:0.0:1790771165.955798:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533770880 00000100:00100000:2.0:1790771165.955800:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.955802:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.955810:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2397:x1877759533770368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.955819:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.955832:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.955833:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0ba2c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35025 expref: 144 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.955842:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771008 00010000:00010000:1.0:1790771165.955846:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:0.0:1790771165.955848:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771008 00010000:00010000:1.0:1790771165.955850:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.955855:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771136 00000100:00100000:3.0:1790771165.955860:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771136 00000100:00100000:2.0:1790771165.955868:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.955875:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2397:x1877759533770368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.955883:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 753 00000100:00100000:3.0:1790771165.955896:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771392 00000100:00100000:0.0:1790771165.955897:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 754 00000100:00100000:3.0:1790771165.955901:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771392 00000100:00100000:1.0:1790771165.955909:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 755 00000100:00100000:2.0:1790771165.955909:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.955916:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533770880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.955927:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.955928:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2396:x1877759533771008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.955929:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1436 00010000:00010000:1.0:1790771165.955942:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.955947:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0ba80 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3502c expref: 143 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.955947:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14064:x1877759533771136:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771165.955948:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.955957:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0bacd lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35320 expref: 143 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.955966:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771648 00010000:00010000:0.0:1790771165.955973:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:2.0:1790771165.955973:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771648 00010000:00010000:1.0:1790771165.955977:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:0.0:1790771165.955979:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.955982:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.956002:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533770880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.956008:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759533771008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.956014:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 754 00000100:00100000:2.0:1790771165.956016:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5716 00000100:00100000:1.0:1790771165.956024:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 755 00000100:00100000:2.0:1790771165.956033:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14699:x1877759533771648:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:2.0:1790771165.956044:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.956049:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1437 00000100:00100000:1.0:1790771165.956051:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771520 00000100:00100000:1.0:1790771165.956055:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771520 00010000:00010000:2.0:1790771165.956057:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0bc71 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3535f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956064:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:13891:x1877759533771392:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.956079:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 935 00000100:00100000:1.0:1790771165.956085:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533771520:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771165.956091:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956093:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.956104:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35358 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956106:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956128:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956129:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771165.956136:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771165.956147:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956153:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:13891:x1877759533771392:12345-192.168.204.50@tcp:35:ls.0 Request processed in 93us (284us total) trans 4294968606 rc 0/0 00000100:00100000:0.0:1790771165.956167:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1437 00010000:00010000:1.0:1790771165.956170:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956183:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35ffe000, rc 0) 00000100:00100000:1.0:1790771165.956207:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533771520:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 121us (304us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.956214:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0bc71 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.956221:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 935 00000100:00100000:0.0:1790771165.956226:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.956248:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956257:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771165.956260:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771165.956264:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594600, rc 0) 00010000:00010000:1.0:1790771165.956274:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 137 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956276:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.956289:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14699:x1877759533771648:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 260us (344us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.956293:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 137 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956298:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5716 00000100:00100000:1.0:1790771165.956315:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539726720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.956317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.956318:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533771776 00000100:00100000:2.0:1790771165.956324:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533771776 00000100:00100000:1.0:1790771165.956344:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.956354:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772288 00000100:00100000:2.0:1790771165.956358:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772288 00000100:00100000:1.0:1790771165.956363:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5717 00000100:00100000:1.0:1790771165.956377:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14198:x1877759533771776:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771165.956381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.956386:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5718 00000100:00100000:2.0:1790771165.956397:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14426:x1877759533772288:12345-192.168.204.50@tcp:55:truncate.0 00010000:00010000:1.0:1790771165.956404:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 11 locks, starting at 0 00000100:00100000:0.0:1790771165.956405:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772800 00000100:00100000:0.0:1790771165.956411:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772800 00010000:00010000:1.0:1790771165.956417:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0b01c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e1f expref: 141 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956425:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956431:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6a:0x0].0x0 (ffff8bfc2900ad00) 00010000:00010000:2.0:1790771165.956437:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 113 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956444:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 140 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.956444:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772160 00000100:00100000:0.0:1790771165.956445:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5719 00000100:00100000:3.0:1790771165.956450:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772160 00010000:00010000:2.0:1790771165.956458:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 139 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956460:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14438:x1877759533772800:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:1.0:1790771165.956471:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 140 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956477:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 113 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.956482:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1438 00000100:00100000:3.0:1790771165.956513:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14432:x1877759533772160:12345-192.168.204.50@tcp:37:rm.0 00010000:00010000:2.0:1790771165.956523:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 139 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956527:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 140 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956535:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 7/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956544:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 140 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956557:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 140 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956560:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 139 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956561:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14438:x1877759533772800:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 101us (181us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771165.956581:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5719 00010000:00010000:1.0:1790771165.956585:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 140 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956586:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 139 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956611:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06790a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539726848:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.956614:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 140 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956631:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.956637:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 140 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956652:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 140 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956666:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 112 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956683:0:13770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 140 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956699:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.956706:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 112 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956711:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.956719:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956725:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539726976:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.956729:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40290400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956735:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40290400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956740:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533772928 00010000:00010000:1.0:1790771165.956744:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 91 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956745:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533772928 00000100:00100000:0.0:1790771165.956749:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.956763:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.956764:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 24 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.956769:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773184 00000100:00100000:0.0:1790771165.956775:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773184 00010000:00010000:1.0:1790771165.956777:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956786:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 91 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956788:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773056 00010000:00010000:1.0:1790771165.956794:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956795:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773056 00000100:00100000:0.0:1790771165.956807:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1557 00000100:00100000:0.0:1790771165.956816:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533772928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.956821:0:13770:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 91 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.956826:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.956831:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 756 00010000:00010000:1.0:1790771165.956841:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.956842:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 24 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.956844:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759533773184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.956857:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.956873:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0baf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350b8 expref: 140 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.956875:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 24 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.956891:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 757 00010000:00010000:2.0:1790771165.956891:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.956896:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.956900:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001028217b/0xfa0c505d97f0a492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ade expref: 24 pid: 13781 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.956902:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759533773056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.956914:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2397:x1877759533773184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (218us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.956917:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.956920:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(8 1) 00000100:00100000:2.0:1790771165.956925:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 756 00010000:00010000:0.0:1790771165.956927:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(8 1) 00010000:00010000:1.0:1790771165.956930:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0ba56 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3530b expref: 141 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.956936:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.956947:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.956947:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:1.0:1790771165.956953:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.956971:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 138 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.956977:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759533773056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (229us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.956978:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.956994:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 138 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.957000:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 757 00010000:00010000:0.0:1790771165.957002:0:13783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957019:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539727232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.957023:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539727360:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771165.957058:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653900 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.957059:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 112 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.957070:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 112 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.957078:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0bc63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350f0 expref: 141 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957081:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539727488:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.957106:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73400/0xfa0c505d97f0bc6a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350f0 expref: 140 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957110:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7840 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.957112:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.957117:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.957119:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73400, rc 0) 00000100:00100000:0.0:1790771165.957125:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.957142:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14004:x1877759533775616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1570us (2049us total) trans 4294969190 rc 0/0 00000100:00100000:0.0:1790771165.957149:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773440 00000100:00100000:1.0:1790771165.957153:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5715 00000100:00100000:0.0:1790771165.957154:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773440 00000100:00100000:2.0:1790771165.957175:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.957192:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1439 00000100:00100000:1.0:1790771165.957199:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773696 00000100:00100000:0.0:1790771165.957206:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13266:x1877759533773440:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.957207:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773696 00000100:00100000:2.0:1790771165.957221:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.957237:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533773952 00000100:00100000:3.0:1790771165.957243:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533773952 00000100:00100000:1.0:1790771165.957250:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 758 00000100:00100000:1.0:1790771165.957261:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2396:x1877759533773696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.957271:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5720 00010000:00010000:1.0:1790771165.957273:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.957282:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.957285:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:14742:x1877759533773952:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771165.957291:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bb2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350bf expref: 140 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.957309:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:1.0:1790771165.957312:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.957312:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774336 00000100:00100000:3.0:1790771165.957317:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774336 00000100:00100000:1.0:1790771165.957331:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759533773696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.957339:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 758 00010000:00010000:2.0:1790771165.957343:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.957353:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.957359:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.957369:0:13762:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.957377:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.957411:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:13266:x1877759533773440:12345-192.168.204.50@tcp:35:ls.0 Request processed in 210us (288us total) trans 4294969192 rc 0/0 00000100:00100000:2.0:1790771165.957420:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.957442:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1439 00000100:00100000:1.0:1790771165.957465:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774464 00000100:00100000:1.0:1790771165.957467:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774464 00000100:00100000:1.0:1790771165.957536:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1440 00000100:00100000:3.0:1790771165.957544:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1441 00000100:00100000:1.0:1790771165.957549:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:11969:x1877759533774336:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771165.957633:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14237:x1877759533774464:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:2.0:1790771165.957727:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.957767:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774592 00000100:00100000:0.0:1790771165.957771:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774592 00000004:00200000:3.0:1790771165.957797:0:13790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000100:00100000:0.0:1790771165.957800:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5721 00000004:00200000:3.0:1790771165.957802:0:13790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771165.957811:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14687:x1877759533774592:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771165.957821:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.957831:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35374 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957841:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.957850:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.957858:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 4/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 96 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957865:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774720 00010000:00010000:0.0:1790771165.957868:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 4/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.957872:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774720 00010000:00010000:0.0:1790771165.957880:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 97 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.957886:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.957889:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.957892:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 97 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.957900:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5c00, rc 0) 00000100:00100000:3.0:1790771165.957917:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14237:x1877759533774464:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 361us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.957924:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14687:x1877759533774592:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 112us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.957930:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1441 00000100:00100000:0.0:1790771165.957934:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5721 00000100:00100000:2.0:1790771165.957947:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5722 00000100:00100000:2.0:1790771165.957956:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14724:x1877759533774720:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:0.0:1790771165.957979:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.957993:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.958005:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.958010:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0b888 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35263 expref: 95 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.958030:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774848 00000100:00100000:0.0:1790771165.958034:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.958034:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00000100:00100000:3.0:1790771165.958036:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774848 00010000:00010000:2.0:1790771165.958043:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.958076:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533774976 00000100:00100000:1.0:1790771165.958077:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533775104 00000100:00100000:3.0:1790771165.958080:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533774976 00000100:00100000:0.0:1790771165.958083:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5723 00000100:00100000:1.0:1790771165.958083:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533775104 00000001:00080000:2.0:1790771165.958096:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969191 is committed 00010000:00010000:0.0:1790771165.958105:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.958108:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969190 is committed 00000100:00100000:3.0:1790771165.958113:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5724 00010000:00010000:0.0:1790771165.958116:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.958123:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5725 00000100:00100000:3.0:1790771165.958128:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14769:x1877759533774976:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.958129:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.958139:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14774:x1877759533775104:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771165.958142:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.958142:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.958149:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958154:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.958155:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958168:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35389 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958169:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc1ae7fc00) 00010000:00010000:0.0:1790771165.958175:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.958181:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.958193:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35382 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958196:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0b803 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958197:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 98 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.958203:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000032bd0d78 reply state 00000000cf62988b transno 4294969191 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.958233:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.958234:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958235:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.958252:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:0.0:1790771165.958253:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.958260:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.958263:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.958265:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771165.958272:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771165.958274:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.958275:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958291:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790771165.958303:0:13761:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771165.958314:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.958314:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958315:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfb03026800) 00010000:00010000:0.0:1790771165.958325:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771165.958326:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14701:x1877759533760512:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 51625us (51701us total) trans 4294969191 rc 0/0 00010000:00010000:0.0:1790771165.958333:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.958340:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771165.958346:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.958349:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5682 00010000:00010000:3.0:1790771165.958353:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958356:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0b80a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.958364:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfde00, rc 0) 00010000:00010000:1.0:1790771165.958365:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.958370:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.958375:0:13773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958381:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03400, rc 0) 00000100:00100000:3.0:1790771165.958387:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14769:x1877759533774976:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 266us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.958394:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5724 00000100:00100000:0.0:1790771165.958401:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:13637:x1877759533774848:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771165.958401:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958414:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958418:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.958420:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958425:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.958428:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958431:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f0bcb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3537b expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.958438:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958448:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958464:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:2.0:1790771165.958464:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 139 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958472:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771165.958476:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.958480:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 4/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958481:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f0bcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3537b expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.958483:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0ba09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958533:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4000/0xfa0c505d97f0bcb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3537b expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.958540:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14774:x1877759533775104:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 406us (510us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.958542:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 139 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958546:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00000100:00100000:1.0:1790771165.958553:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5725 00010000:00010000:0.0:1790771165.958555:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771165.958560:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4000, rc 0) 00010000:00010000:2.0:1790771165.958572:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 139 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.958585:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13637:x1877759533774848:12345-192.168.204.50@tcp:101:dd.0 Request processed in 488us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.958585:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539727616:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.958596:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5723 00000100:00100000:2.0:1790771165.958623:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.958630:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.958652:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533775360 00000100:00100000:0.0:1790771165.958656:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533775360 00000100:00100000:0.0:1790771165.958701:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5726 00000100:00100000:0.0:1790771165.958711:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14732:x1877759533775360:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771165.958718:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.958725:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35390 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958742:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 100 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.958742:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.958754:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 100 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958763:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.958766:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.958769:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 100 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.958775:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5800, rc 0) 00000100:00100000:2.0:1790771165.958776:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533775488 00000100:00100000:2.0:1790771165.958782:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533775488 00000100:00100000:0.0:1790771165.958798:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14732:x1877759533775360:12345-192.168.204.50@tcp:101:chown.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.958804:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5726 00000100:00100000:2.0:1790771165.958821:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1442 00000100:00100000:2.0:1790771165.958831:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:11832:x1877759533775488:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.958907:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:11832:x1877759533775488:12345-192.168.204.50@tcp:35:ls.0 Request processed in 79us (168us total) trans 4294968608 rc 0/0 00000100:00100000:2.0:1790771165.958912:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1442 00000100:00100000:1.0:1790771165.959291:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.959293:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000fd0452b4 x1877759539724416) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959304:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0b4d0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fae expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959314:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724416:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959329:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000006ed148cf x1877759539724544) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 138 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959330:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533775744 00000100:00100000:2.0:1790771165.959337:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533775744 00010000:00010000:0.0:1790771165.959341:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0b49f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f99 expref: 138 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959351:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d15180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724544:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959368:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000006115ee3c x1877759539724672) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 137 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959376:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 759 00010000:00010000:0.0:1790771165.959379:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0b47c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f92 expref: 137 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959389:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533775744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.959393:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724672:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.959398:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.959412:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000359f46b6 x1877759539724800) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 136 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.959413:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bb4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350d4 expref: 118 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.959415:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.959438:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776000 00010000:00010000:0.0:1790771165.959440:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0b2df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f7d expref: 136 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.959441:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00000100:00100000:3.0:1790771165.959443:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776000 00010000:00010000:2.0:1790771165.959448:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.959459:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724800:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959475:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000001f4d10b4 x1877759539724928) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 135 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959513:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0b2b5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34eea expref: 135 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959517:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759533775744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.959520:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1443 00000100:00100000:1.0:1790771165.959535:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.959536:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539724928:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.959536:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:11972:x1877759533776000:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.959549:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 759 00010000:00010000:0.0:1790771165.959563:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000060bb1c08 x1877759539725056) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 134 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959576:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0b2ae lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ed5 expref: 134 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959585:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064af480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725056:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959594:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000a9ba699e x1877759539725184) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 133 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959600:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0b28b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec0 expref: 133 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959610:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725184:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959625:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000e151d2a6 x1877759539725312) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 132 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.959626:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:11972:x1877759533776000:12345-192.168.204.50@tcp:35:ls.0 Request processed in 93us (213us total) trans 4294968609 rc 0/0 00010000:00010000:0.0:1790771165.959635:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0b24c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ea4 expref: 132 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959644:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725312:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959653:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000008ffd1797 x1877759539725440) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 131 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959660:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0b0e0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e9d expref: 131 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.959662:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776256 00000100:00100000:1.0:1790771165.959667:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776256 00000100:00100000:0.0:1790771165.959688:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725440:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.959701:0:13766:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000ce06e744 x1877759539725568) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 1/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 130 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959709:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0b0c4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e81 expref: 130 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.959716:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 936 00000100:00100000:0.0:1790771165.959720:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539725568:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.959726:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:14699:x1877759533776256:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:1.0:1790771165.959733:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.959742:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3539e expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.959752:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1443 00010000:00010000:0.0:1790771165.959758:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771165.959759:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771165.959766:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1790771165.959767:0:13766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 101 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.959774:0:13793:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 27 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959779:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.959786:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 27 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959787:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959806:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.959809:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02a00, rc 0) 00000100:00100000:3.0:1790771165.959810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.959828:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959835:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.959845:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:14699:x1877759533776256:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 120us (364us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.959846:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959847:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776512 00000100:00100000:2.0:1790771165.959854:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776512 00000100:00100000:1.0:1790771165.959858:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 936 00010000:00010000:0.0:1790771165.959872:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959880:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 129 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.959885:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 4/0,1 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959898:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5727 00010000:00010000:0.0:1790771165.959903:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 129 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.959913:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14003:x1877759533776512:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.959914:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 129 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959929:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539727744:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.959930:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.959944:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0bce1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350f7 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.959970:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87e40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.959996:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0bce8 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960009:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0bce8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960020:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0bce8 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.960029:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.960085:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0bce1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350f7 expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960103:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0bce8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350f7 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960113:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.960116:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.960120:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00000100:00100000:2.0:1790771165.960161:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14003:x1877759533776512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 254us (354us total) trans 4294969193 rc 0/0 00000100:00100000:2.0:1790771165.960172:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5727 00000100:00100000:3.0:1790771165.960179:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539725696:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.960194:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.960224:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.960251:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.960253:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776384 00000100:00100000:2.0:1790771165.960259:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776384 00000100:00100000:3.0:1790771165.960270:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776640 00000100:00100000:3.0:1790771165.960275:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776640 00010000:00010000:2.0:1790771165.960281:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 101 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.960302:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5728 00000100:00100000:3.0:1790771165.960312:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14444:x1877759533776640:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:2.0:1790771165.960318:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1558 00000100:00100000:2.0:1790771165.960331:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:2397:x1877759533776384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.960341:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.960348:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 101 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960361:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 101 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.960378:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14444:x1877759533776640:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 67us (126us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771165.960380:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f07d16 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d4e expref: 101 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.960389:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5728 00010000:00010000:2.0:1790771165.960404:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:2.0:1790771165.960409:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960418:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960426:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.960455:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.960469:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.960477:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.960523:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:2397:x1877759533776384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 159us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.960533:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1558 00000040:00080000:3.0:1790771165.960713:0:13765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 88 off9848 00000004:00010000:3.0:1790771165.960744:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d4a5764d reply state 00000000ea183148 transno 4294968610 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.960752:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.960758:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771165.960760:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.960762:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771165.960797:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14341:x1877759533765760:12345-192.168.204.50@tcp:36:chown.0 Request processed in 9543us (9785us total) trans 4294968610 rc 0/0 00000100:00100000:3.0:1790771165.960803:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5703 00000100:00100000:1.0:1790771165.961101:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14432:x1877759533772160:12345-192.168.204.50@tcp:37:rm.0 Request processed in 4592us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.961108:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1438 00000100:00100000:0.0:1790771165.961149:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14064:x1877759533771136:12345-192.168.204.50@tcp:37:ls.0 Request processed in 5208us (5320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.961155:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1436 00000100:00100000:3.0:1790771165.963049:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.963078:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776896 00000100:00100000:0.0:1790771165.963083:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776896 00000100:00100000:0.0:1790771165.963106:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5729 00000100:00100000:0.0:1790771165.963111:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14001:x1877759533776896:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.963120:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.963127:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0bcf6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e350fe expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963162:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0bcfd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963174:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0bcfd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963184:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0bcfd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.963194:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.963212:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.963237:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.963247:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533776768 00010000:00010000:0.0:1790771165.963252:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0bcf6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350fe expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.963254:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533776768 00000100:00100000:3.0:1790771165.963264:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.963271:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0bcfd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350fe expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963277:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.963280:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.963282:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4c00, rc 0) 00000100:00100000:2.0:1790771165.963288:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777024 00000100:00100000:2.0:1790771165.963291:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777024 00000100:00100000:3.0:1790771165.963315:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.963321:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14001:x1877759533776896:12345-192.168.204.50@tcp:101:ls.0 Request processed in 203us (266us total) trans 4294969194 rc 0/0 00000100:00100000:2.0:1790771165.963322:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 760 00000100:00100000:0.0:1790771165.963333:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5729 00000100:00100000:2.0:1790771165.963337:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533776768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.963347:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.963355:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777408 00010000:00010000:2.0:1790771165.963359:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0bb8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350db expref: 120 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.963360:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777408 00010000:00010000:2.0:1790771165.963376:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.963380:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.963395:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5730 00000100:00100000:0.0:1790771165.963405:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14783:x1877759533777408:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:2.0:1790771165.963411:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2396:x1877759533776768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.963418:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 760 00010000:00010000:0.0:1790771165.963424:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.963434:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777152 00000100:00100000:2.0:1790771165.963438:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 761 00010000:00010000:0.0:1790771165.963440:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f08f22 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3434b expref: 104 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.963441:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777152 00000100:00100000:2.0:1790771165.963449:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759533777024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.963460:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771165.963460:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.963466:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.963475:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0bbad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350cd expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.963480:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1444 00000100:00100000:3.0:1790771165.963519:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13678:x1877759533777152:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771165.963524:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1b:0x0].0x0 (ffff8bfc3607ed00) 00010000:00010000:2.0:1790771165.963528:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.963546:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759533777024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.963554:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 761 00010000:00010000:0.0:1790771165.963577:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963588:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.963594:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.963611:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13678:x1877759533777152:12345-192.168.204.50@tcp:35:ls.0 Request processed in 94us (347us total) trans 4294968611 rc 0/0 00010000:00010000:0.0:1790771165.963615:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.963624:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1444 00010000:00010000:0.0:1790771165.963631:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 116 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.963641:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539727872:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.963701:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87540 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.963902:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:11969:x1877759533774336:12345-192.168.204.50@tcp:37:ls.0 Request processed in 6357us (6622us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.963910:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1440 00000100:00100000:2.0:1790771165.964523:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.964550:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777536 00000100:00100000:0.0:1790771165.964555:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777536 00000100:00100000:0.0:1790771165.964585:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5731 00000100:00100000:0.0:1790771165.964592:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14741:x1877759533777536:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771165.964620:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.964627:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.964631:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964639:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964645:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 132 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964650:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964656:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964663:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 132 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.964667:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777664 00010000:00010000:0.0:1790771165.964681:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 132 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.964688:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777664 00010000:00010000:0.0:1790771165.964693:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964704:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964710:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 96 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964715:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 13/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.964720:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5732 00000100:00100000:3.0:1790771165.964731:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14007:x1877759533777664:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771165.964739:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 96 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.964741:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.964749:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 96 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.964752:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35105 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.964765:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728000:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.964811:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.964813:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0bd20 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964829:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.964830:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0bd20 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.964851:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0bd20 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.964852:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728128:192.168.204.50@tcp:104: 00000004:00200000:3.0:1790771165.964864:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.964887:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964899:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.964905:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728256:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.964937:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 132 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.964946:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 132 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.964954:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0644df80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728384:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.964995:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 132 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965007:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 132 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.965020:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35105 expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.965022:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728512:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.965073:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0bd20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35105 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965079:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.965080:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.965086:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771165.965090:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592200, rc 0) 00010000:00010000:0.0:1790771165.965097:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.965110:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728640:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.965122:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14007:x1877759533777664:12345-192.168.204.50@tcp:101:ls.0 Request processed in 392us (495us total) trans 4294969196 rc 0/0 00010000:00010000:0.0:1790771165.965144:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965152:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.965167:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5732 00000100:00100000:0.0:1790771165.965176:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064af480 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728768:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.965220:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 132 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965232:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 132 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.965244:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.965278:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965285:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.965293:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539729024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.965312:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.965323:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.965330:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539729152:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.965356:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87780 going to sleep for 11 seconds 00000100:00100000:2.0:1790771165.965786:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.965807:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533777920 00000100:00100000:3.0:1790771165.965813:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533777920 00000100:00100000:1.0:1790771165.965860:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539725824:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.965907:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1445 00000100:00100000:0.0:1790771165.965917:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:13270:x1877759533777920:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771165.965927:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539725952:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.965954:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.965955:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.965985:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6481:1877759539726080:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771165.965996:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.966009:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13270:x1877759533777920:12345-192.168.204.50@tcp:35:ls.0 Request processed in 94us (222us total) trans 4294969197 rc 0/0 00000100:00100000:0.0:1790771165.966015:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1445 00000100:00100000:1.0:1790771165.966024:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533767296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12106us (12230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.966031:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533778304 00000100:00100000:1.0:1790771165.966036:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1554 00000100:00100000:3.0:1790771165.966036:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533778304 00000100:00100000:2.0:1790771165.966075:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5733 00000100:00100000:2.0:1790771165.966084:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:12017:x1877759533778304:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.966092:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.966101:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bd2e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35397 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966133:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966142:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966150:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966161:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966172:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.966173:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539726208:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771165.966185:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.966197:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.966224:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533767424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12283us (12394us total) trans 0 rc 0/0 00000004:00200000:2.0:1790771165.966230:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00000100:00100000:1.0:1790771165.966233:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1555 00000100:00100000:0.0:1790771165.966246:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539726592:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.966266:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966266:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966282:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966287:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966292:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966296:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.966299:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966304:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966310:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.966312:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.966314:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966322:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bd35 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966333:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966337:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966342:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966345:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.966347:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966351:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966355:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7fc00) 00010000:00010000:2.0:1790771165.966357:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.966358:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966362:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd3c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966380:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bd2e lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35397 expref: 99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966390:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771165.966392:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.966395:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bd2e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35397 expref: 99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.966401:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00000100:00100000:2.0:1790771165.966434:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:12017:x1877759533778304:12345-192.168.204.50@tcp:101:ls.0 Request processed in 353us (483us total) trans 4294968612 rc 301/301 00000100:00100000:2.0:1790771165.966441:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5733 00000100:00100000:1.0:1790771165.966472:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539726720:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.966513:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.966576:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06790a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539726848:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771165.966602:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539726336:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.966614:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.967541:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539726976:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.967573:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539727360:192.168.204.50@tcp:105: 00002000:00010000:3.0:1790771165.967579:0:8676:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size: 0 -> 38336 00002000:00010000:3.0:1790771165.967582:0:8676:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime: 1752421453 -> 1790771165 00010000:00010000:0.0:1790771165.967584:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1790771165.967586:0:8676:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:3.0:1790771165.967598:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539726464:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771165.967616:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533772928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10801us (10984us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.967621:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066ebbdda/0xfa0c505d97f0bc55 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3534a expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.967629:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1557 00010000:00010000:3.0:1790771165.967640:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066ebbdda/0xfa0c505d97f0bc55 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3534a expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.967655:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.967662:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00000100:00100000:3.0:1790771165.967703:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533768832:12345-192.168.204.50@tcp:101:cp.0 Request processed in 12235us (13338us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771165.967709:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 934 00000100:00100000:1.0:1790771165.967710:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533778560 00000100:00100000:1.0:1790771165.967716:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533778560 00000100:00100000:1.0:1790771165.967760:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 937 00000100:00100000:1.0:1790771165.967770:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14017:x1877759533778560:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771165.967778:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.967790:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022541e2f/0xfa0c505d97f0bd4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353ac expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771165.967807:0:13781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790771165.967818:0:6493:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000007c158d9 x1877759539727232) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 118 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.967820:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=166s v=(0 0) 00010000:00010000:1.0:1790771165.967829:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1790771165.967834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.967844:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022541e2f/0xfa0c505d97f0bd4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 524288->589823) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353ac expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.967846:0:6493:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 118 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.967870:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022541e2f/0xfa0c505d97f0bd4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 524288->589823) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353ac expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.967874:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0b3e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f29 expref: 118 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.967894:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03e00, rc 0) 00000100:00100000:0.0:1790771165.967895:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539727232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771165.967907:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04878e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539727488:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.967927:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.967930:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.967937:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14017:x1877759533778560:12345-192.168.204.50@tcp:101:dd.0 Request processed in 167us (283us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.967940:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.967953:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.967954:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 937 00000100:00100000:1.0:1790771165.967983:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533778688 00000100:00100000:1.0:1790771165.967987:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533778688 00000100:00100000:1.0:1790771165.968013:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5734 00000100:00100000:1.0:1790771165.968022:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:11056:x1877759533778688:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1790771165.968030:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.968038:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0bd51 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353b3 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968064:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968072:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968078:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968086:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968091:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968097:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968132:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968138:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968143:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.968156:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:1.0:1790771165.968159:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771165.968172:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968183:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968189:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968196:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968204:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968210:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.968214:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968220:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968227:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.968229:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.968231:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968236:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bd58 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968243:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968247:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968253:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968259:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.968262:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968268:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968275:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771165.968278:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.968281:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968288:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd5f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968317:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0bd51 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353b3 expref: 108 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968326:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353b3 expref: 107 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.968331:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:1.0:1790771165.968333:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790771165.968334:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc0151fa00, rc 0) 00000100:00100000:1.0:1790771165.968361:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:11056:x1877759533778688:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 343us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.968366:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5734 00000100:00100000:2.0:1790771165.979005:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.979030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.979045:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771165.979076:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533778816 00000100:00100000:3.0:1790771165.979083:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533778816 00000100:00100000:0.0:1790771165.979086:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779584 00000100:00100000:1.0:1790771165.979089:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780608 00000100:00100000:2.0:1790771165.979093:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.979094:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779584 00000100:00100000:1.0:1790771165.979097:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780608 00000100:00100000:3.0:1790771165.979122:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780992 00000100:00100000:3.0:1790771165.979126:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780992 00000100:00100000:0.0:1790771165.979144:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5735 00000100:00100000:1.0:1790771165.979155:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5736 00000100:00100000:0.0:1790771165.979159:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13998:x1877759533778816:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.979167:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5737 00000100:00100000:1.0:1790771165.979173:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:13885:x1877759533779584:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771165.979178:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5738 00010000:00010000:0.0:1790771165.979179:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.979184:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14005:x1877759533780608:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771165.979194:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771165.979195:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13266:x1877759533780992:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.979196:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.979200:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bd6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3510c expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979208:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.979210:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bd74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35113 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979214:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0bd7b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353a5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979219:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bd82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353ba expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979279:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979284:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979286:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd97 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.979290:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bd9e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979291:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979313:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd97 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979315:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979317:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979328:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd97 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.979332:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bd9e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979338:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979344:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.979349:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.979361:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bd9e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979365:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979370:0:6495:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.979373:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.979388:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.979391:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979431:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bd74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35113 expref: 124 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.979440:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bd6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3510c expref: 125 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.979450:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.979454:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd97 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35113 expref: 123 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.979457:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bd9e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3510c expref: 123 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979479:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.979482:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.979507:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771165.979513:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e200, rc 0) 00010000:00010000:0.0:1790771165.979519:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771165.979526:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771165.979532:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1400, rc 0) 00010000:00010000:3.0:1790771165.979532:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979541:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979547:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979551:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.979554:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979559:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.979563:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14005:x1877759533780608:12345-192.168.204.50@tcp:101:ls.0 Request processed in 382us (512us total) trans 4294969198 rc 0/0 00010000:00010000:3.0:1790771165.979571:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.979576:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.979577:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5737 00000100:00100000:0.0:1790771165.979579:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13998:x1877759533778816:12345-192.168.204.50@tcp:101:ls.0 Request processed in 425us (576us total) trans 4294969199 rc 0/0 00010000:00010000:3.0:1790771165.979582:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.979592:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5735 00010000:00010000:3.0:1790771165.979593:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0bd89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979614:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979621:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979629:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979635:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.979639:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979647:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979658:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc20109400) 00010000:00010000:3.0:1790771165.979661:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.979665:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979686:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bda5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979776:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bd82 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353ba expref: 109 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979788:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771165.979791:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771165.979796:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bd82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353ba expref: 109 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.979805:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00000100:00100000:3.0:1790771165.979893:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13266:x1877759533780992:12345-192.168.204.50@tcp:101:ls.0 Request processed in 701us (801us total) trans 4294969200 rc 301/301 00000100:00100000:3.0:1790771165.979902:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5738 00000100:00100000:2.0:1790771165.990525:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.990564:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.990588:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782144 00000100:00100000:1.0:1790771165.990590:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.990596:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782144 00000100:00100000:2.0:1790771165.990602:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.990622:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782656 00000100:00100000:1.0:1790771165.990628:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782656 00000100:00100000:0.0:1790771165.990637:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783040 00000100:00100000:0.0:1790771165.990641:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783040 00000100:00100000:3.0:1790771165.990645:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539727616:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771165.990660:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.990684:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5739 00000100:00100000:0.0:1790771165.990694:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5740 00000100:00100000:1.0:1790771165.990696:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14000:x1877759533782144:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771165.990708:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13737:x1877759533782656:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.990709:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.990712:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.990722:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.990728:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bdc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3511a expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.990735:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bdc8 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3532e expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.990736:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.990755:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.990771:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779840 00000100:00100000:2.0:1790771165.990776:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779840 00010000:00010000:2.0:1790771165.990797:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 135 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.990808:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.990813:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.990820:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bdcf lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.990825:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1559 00010000:00010000:1.0:1790771165.990836:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bdcf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.990842:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783296 00000100:00100000:2.0:1790771165.990845:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759533779840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.990850:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bdcf lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.990850:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783296 00000004:00200000:1.0:1790771165.990860:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.990860:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.990871:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 137 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.990878:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781504 00000100:00100000:3.0:1790771165.990883:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781504 00010000:00010000:2.0:1790771165.990887:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 137 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.990889:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bdc8 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3532e expref: 137 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.990912:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f06c76 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33632 expref: 137 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.990924:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771165.990927:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:0.0:1790771165.990928:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.990936:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.990940:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bdc8 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3532e expref: 136 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.990941:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0bdc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3511a expref: 126 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.990945:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.990967:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.990972:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1e00, rc 0) 00010000:00010000:2.0:1790771165.990974:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.990979:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bdcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3511a expref: 126 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.990982:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5741 00010000:00010000:2.0:1790771165.990991:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.990994:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.990999:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.991002:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc029cbc00, rc 0) 00000100:00100000:0.0:1790771165.991008:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13737:x1877759533782656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 304us (442us total) trans 4294968613 rc 301/301 00010000:00010000:2.0:1790771165.991012:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.991030:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14000:x1877759533782144:12345-192.168.204.50@tcp:101:ls.0 Request processed in 337us (510us total) trans 4294969201 rc 0/0 00000100:00100000:2.0:1790771165.991039:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759533779840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.991045:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1559 00000100:00100000:0.0:1790771165.991057:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5740 00000100:00100000:3.0:1790771165.991063:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14414:x1877759533783040:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1790771165.991065:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5739 00000100:00100000:2.0:1790771165.991076:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5742 00010000:00010000:3.0:1790771165.991079:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771165.991084:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5743 00000100:00100000:2.0:1790771165.991088:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14277:x1877759533783296:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771165.991093:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bde4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35128 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991098:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14633:x1877759533781504:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771165.991101:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.991114:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bdeb lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35366 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991115:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.991128:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0bdf2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353c1 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.991133:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.991148:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991153:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991163:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991168:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991175:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991181:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991195:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.991204:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.991212:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991212:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.991226:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785472 00000100:00100000:1.0:1790771165.991232:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785472 00010000:00010000:2.0:1790771165.991233:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991235:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991257:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.991264:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5744 00010000:00010000:2.0:1790771165.991265:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991271:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0bdf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.991284:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:11974:x1877759533785472:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771165.991286:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991304:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.991304:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991309:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 127 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.991311:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00010000:00010000:1.0:1790771165.991317:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0be1c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353c8 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991319:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:0.0:1790771165.991327:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771165.991331:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.991332:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1000, rc 0) 00010000:00010000:3.0:1790771165.991342:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991348:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.991349:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00000100:00100000:0.0:1790771165.991359:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14633:x1877759533781504:12345-192.168.204.50@tcp:101:chown.0 Request processed in 264us (624us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.991360:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991361:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991375:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5743 00010000:00010000:1.0:1790771165.991376:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991379:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.991385:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991387:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991391:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991400:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780224 00010000:00010000:2.0:1790771165.991405:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991406:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780224 00010000:00010000:3.0:1790771165.991409:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991416:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991424:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991433:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781376 00010000:00010000:3.0:1790771165.991435:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:0.0:1790771165.991439:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781376 00010000:00010000:3.0:1790771165.991440:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.991441:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.991444:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991449:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991449:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991459:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1446 00010000:00010000:1.0:1790771165.991464:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991472:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14625:x1877759533780224:12345-192.168.204.50@tcp:35:chown.0 00010000:00010000:3.0:1790771165.991473:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0bdf9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991474:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991516:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991521:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991522:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771165.991529:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.991534:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991535:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991551:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0be07 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991552:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991568:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.991571:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991573:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991578:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991581:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.991582:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:3.0:1790771165.991590:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc20109400) 00010000:00010000:2.0:1790771165.991593:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991594:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.991599:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991602:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533f000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.991609:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991610:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14625:x1877759533780224:12345-192.168.204.50@tcp:35:chown.0 Request processed in 137us (1021us total) trans 4294969202 rc 0/0 00010000:00010000:3.0:1790771165.991611:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0be0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991622:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991628:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991630:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1446 00010000:00010000:1.0:1790771165.991643:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991645:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc0ab7fc00) 00010000:00010000:2.0:1790771165.991652:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.991653:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1447 00010000:00010000:3.0:1790771165.991656:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bde4 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35128 expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991657:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991658:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991666:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:14237:x1877759533781376:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:1.0:1790771165.991694:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.991697:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0be15 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991700:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991717:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000004:00200000:0.0:1790771165.991720:0:13775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.991721:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.991721:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000004:00200000:0.0:1790771165.991728:0:13775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771165.991730:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0bde4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35128 expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991741:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771165.991744:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00010000:00010000:1.0:1790771165.991745:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.991751:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991757:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0be23 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991759:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bdeb lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35366 expref: 134 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991765:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:14237:x1877759533781376:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 101us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.991776:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14414:x1877759533783040:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 716us (1172us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771165.991788:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771165.991795:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991795:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.991796:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5741 00000100:00100000:0.0:1790771165.991802:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1447 00010000:00010000:2.0:1790771165.991804:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0bdeb lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35366 expref: 134 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991815:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991822:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.991824:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00000100:00100000:3.0:1790771165.991825:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780736 00010000:00010000:1.0:1790771165.991829:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771165.991831:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780736 00010000:00010000:1.0:1790771165.991833:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991840:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.991848:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771165.991851:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.991853:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.991855:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (29064->18446744073709551615) 00010000:00010000:1.0:1790771165.991862:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0be2a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771165.991863:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04b23100 with x1877759533780736 ext(29064->18446744073709551615) 00000100:00100000:0.0:1790771165.991867:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.991867:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14277:x1877759533783296:12345-192.168.204.50@tcp:101:touch.0 Request processed in 779us (1154us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771165.991879:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.991889:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5742 00000100:00100000:0.0:1790771165.991893:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781248 00010000:00010000:3.0:1790771165.991898:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 23 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.991899:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781248 00002000:00010000:3.0:1790771165.991907:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb04b23100. 00010000:00010000:1.0:1790771165.991919:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0be1c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c8 expref: 102 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.991922:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (475136->479231) req@ffff8bfb06d14700 x1877759533781248/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771165.991933:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 87 00010000:00010000:1.0:1790771165.991937:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771165.991945:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00002000:00100000:0.0:1790771165.991947:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06d14700 with x1877759533781248 ext(475136->479231) 00000100:00100000:3.0:1790771165.991947:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533780736:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:1.0:1790771165.991953:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0be1c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c8 expref: 102 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.991955:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06d14700 00000100:00100000:2.0:1790771165.991962:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.991972:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2a00, rc 0) 00000100:00100000:0.0:1790771165.991989:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 381 00000100:00100000:0.0:1790771165.992002:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533781248:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771165.992002:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:11974:x1877759533785472:12345-192.168.204.50@tcp:101:ls.0 Request processed in 722us (802us total) trans 4294968614 rc 301/301 00000100:00100000:2.0:1790771165.992017:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.992021:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5744 00000100:00100000:2.0:1790771165.992037:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779328 00000100:00100000:1.0:1790771165.992041:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785856 00000100:00100000:2.0:1790771165.992042:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779328 00000100:00100000:1.0:1790771165.992047:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785856 00010000:00010000:2.0:1790771165.992061:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 133 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.992077:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5745 00000100:00100000:1.0:1790771165.992087:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:12241:x1877759533785856:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.992091:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1560 00010000:00010000:1.0:1790771165.992100:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771165.992102:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2398:x1877759533779328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.992111:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.992113:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0be38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35136 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992117:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 133 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992126:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533781248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 126us (262us total) trans 0 rc 0/0 00002000:00010000:3.0:1790771165.992138:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 20983 -> 29064 00002000:00010000:3.0:1790771165.992142:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000100:00100000:0.0:1790771165.992144:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 381 00010000:00010000:2.0:1790771165.992145:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 133 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.992146:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771165 -> 1752421453 00002000:00010000:3.0:1790771165.992154:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00100000:0.0:1790771165.992156:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (475136->479231) req@ffff8bfb06d14700 x1877759533781248/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/440 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00010000:3.0:1790771165.992160:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 16 -> 16 00010000:00010000:1.0:1790771165.992173:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0be3f lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.992176:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06d14700 with x1877759533781248 ext(475136->479231) 00010000:00010000:2.0:1790771165.992176:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0b5e1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3519f expref: 133 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771165.992186:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06d14700 00000100:00100000:3.0:1790771165.992188:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533780736:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 244us (1055us total) trans 4294967591 rc 0/0 00010000:00010000:1.0:1790771165.992199:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0be3f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992206:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:3.0:1790771165.992207:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 87 00002000:00010000:3.0:1790771165.992214:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (29064->18446744073709551615) 00010000:00010000:2.0:1790771165.992215:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771165.992219:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04b23100 with x1877759533780736 ext(29064->18446744073709551615) 00010000:00010000:1.0:1790771165.992220:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0be3f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992233:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992233:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.992235:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.992257:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992259:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.992278:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb04b23100. 00000100:00100000:0.0:1790771165.992286:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.992293:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.992301:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0be38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35136 expref: 129 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.992318:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533779328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 216us (301us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.992321:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0be3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35136 expref: 128 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992324:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.992337:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:2.0:1790771165.992337:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1560 00010000:00010000:1.0:1790771165.992342:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:3.0:1790771165.992344:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779968 00010000:00010000:1.0:1790771165.992347:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84800, rc 0) 00000100:00100000:3.0:1790771165.992349:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779968 00000100:00100000:0.0:1790771165.992356:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.992369:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533778944 00010000:00010000:3.0:1790771165.992370:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 108 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.992375:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12241:x1877759533785856:12345-192.168.204.50@tcp:101:ls.0 Request processed in 287us (416us total) trans 4294969203 rc 0/0 00000100:00100000:2.0:1790771165.992375:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533778944 00000100:00100000:0.0:1790771165.992390:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.992395:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5745 00010000:00010000:2.0:1790771165.992395:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.992417:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779712 00000100:00100000:0.0:1790771165.992419:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.992429:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780480 00000100:00100000:2.0:1790771165.992433:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780480 00000100:00100000:1.0:1790771165.992435:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533779200 00000100:00100000:1.0:1790771165.992440:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779200 00010000:00010000:2.0:1790771165.992449:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992450:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.992459:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 109 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.992472:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533780352 00000100:00100000:3.0:1790771165.992473:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533779712 00000100:00100000:2.0:1790771165.992476:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533780352 00000100:00100000:1.0:1790771165.992479:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1561 00000100:00100000:0.0:1790771165.992511:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.992512:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 129 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.992520:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:2398:x1877759533779968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.992524:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 110 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992532:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.992536:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781120 00010000:00010000:1.0:1790771165.992540:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.992543:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1562 00000100:00100000:0.0:1790771165.992544:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781120 00000100:00100000:2.0:1790771165.992554:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1563 00000100:00100000:3.0:1790771165.992560:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2398:x1877759533778944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.992564:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.992569:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533780480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.992570:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1790771165.992577:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (0->4095) req@ffff8bfb06790a80 x1877759533781120/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'timeout.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771165.992580:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992585:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.992595:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992602:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0b3f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e350c6 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992608:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771165.992616:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790a80 with x1877759533781120 ext(0->4095) 00002000:00010000:0.0:1790771165.992625:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790a80 00010000:00010000:2.0:1790771165.992628:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992639:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771165.992644:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0b7cb lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3528d expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992646:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992647:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0b690 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351c2 expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992655:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 382 00010000:00010000:3.0:1790771165.992683:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00000100:00100000:0.0:1790771165.992688:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533781120:12345-192.168.204.50@tcp:3:timeout.0 00010000:00010000:1.0:1790771165.992688:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992693:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992712:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.992712:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771165.992713:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992719:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992722:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.992729:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.992733:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:2398:x1877759533779968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 218us (447us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.992740:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.992743:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2398:x1877759533778944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.992752:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1561 00000100:00100000:3.0:1790771165.992763:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1562 00010000:00010000:2.0:1790771165.992774:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.992789:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1564 00000100:00100000:0.0:1790771165.992790:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533781120:12345-192.168.204.50@tcp:3:timeout.0 Request processed in 119us (306us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1790771165.992798:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2398:x1877759533780480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 231us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.992799:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:2396:x1877759533779200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.992805:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 382 00000100:00100000:1.0:1790771165.992811:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1565 00010000:00010000:3.0:1790771165.992815:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1790771165.992818:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (0->4095) req@ffff8bfb06790a80 x1877759533781120/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:266/0 lens 488/4536 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 4096/4096 job:'timeout.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771165.992819:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1563 00000100:00100000:1.0:1790771165.992825:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2398:x1877759533779712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1790771165.992837:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790a80 with x1877759533781120 ext(0->4095) 00010000:00010000:1.0:1790771165.992840:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790771165.992841:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790a80 00000100:00100000:2.0:1790771165.992848:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1566 00010000:00010000:1.0:1790771165.992849:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 127 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992862:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 127 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.992865:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:2396:x1877759533780352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.992871:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992886:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.992887:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.992896:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 108 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992902:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0b62e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351e5 expref: 127 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992908:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992914:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 108 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992922:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.992936:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771165.992941:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.992943:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0b508 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35183 expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992954:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.992960:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771165.992961:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:3.0:1790771165.992966:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.992971:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0a83c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34be1 expref: 107 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.992973:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539727744:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.992978:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.992981:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2398:x1877759533779712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 159us (623us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.992999:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993000:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:1.0:1790771165.993001:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1565 00010000:00010000:0.0:1790771165.993002:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993011:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993027:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781760 00010000:00010000:2.0:1790771165.993028:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993030:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.993032:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781760 00010000:00010000:2.0:1790771165.993039:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993047:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993053:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533779200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 254us (635us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.993058:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.993063:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993069:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1564 00000100:00100000:1.0:1790771165.993072:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1448 00000100:00100000:2.0:1790771165.993081:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533780352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.993088:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13265:x1877759533781760:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771165.993097:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1566 00010000:00010000:3.0:1790771165.993109:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993116:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993128:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993138:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993139:0:12128:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993154:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993162:0:12128:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771165.993171:0:13769:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968607 00000100:00100000:1.0:1790771165.993182:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13265:x1877759533781760:12345-192.168.204.50@tcp:35:ls.0 Request processed in 97us (296us total) trans 4294969204 rc 0/0 00000100:00100000:0.0:1790771165.993187:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12128:1877759539729280:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1790771165.993196:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1448 00000001:00080000:2.0:1790771165.993197:0:13771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968605 00000004:00010000:3.0:1790771165.993203:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005dfb9d3f reply state 00000000341534e0 transno 4294968615 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993224:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786624 00000004:00010000:2.0:1790771165.993225:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007ce09875 reply state 0000000020ad02e3 transno 4294968616 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993225:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993231:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786624 00000100:00100000:0.0:1790771165.993241:0:12128:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771165.993249:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771165.993252:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.993253:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993256:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771165.993266:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5746 00010000:00010000:2.0:1790771165.993268:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771165.993273:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.993276:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771165.993278:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:11056:x1877759533786624:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:0.0:1790771165.993284:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87e40 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.993292:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.993296:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1790771165.993302:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539729280 00000100:00100000:0.0:1790771165.993307:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539729280 00010000:00010000:1.0:1790771165.993312:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f08daf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342fe expref: 106 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993316:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:14724:x1877759533774720:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 35357us (35476us total) trans 4294968615 rc 0/0 00010000:00010000:1.0:1790771165.993330:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00000100:00100000:2.0:1790771165.993330:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14551:x1877759533770240:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 37880us (38273us total) trans 4294968616 rc 0/0 00000100:00100000:3.0:1790771165.993332:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5722 00010000:00010000:1.0:1790771165.993338:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.993340:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000020:00080000:3.0:1790771165.993343:0:13769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771165.993348:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0be54 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353d6 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993349:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5714 00000100:00100000:0.0:1790771165.993354:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12128:x1877759539729280:12345-0@lo:101:mdt00_005.0 00000020:00080000:2.0:1790771165.993357:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771165.993371:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.993378:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993383:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0be4d expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993386:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993401:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771165.993406:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993408:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 101 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993424:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993428:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 125 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993437:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.993442:0:6498:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 5/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993447:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993454:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782016 00000100:00100000:2.0:1790771165.993460:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782016 00010000:00010000:3.0:1790771165.993463:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993472:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993477:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993479:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533781888 00010000:00010000:3.0:1790771165.993482:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00002000:00100000:2.0:1790771165.993504:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xd:0x0] (0->4095) req@ffff8bfb06ba0000 x1877759533782016/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/0 e 0 to 0 dl 1790771176 ref 1 fl New:/600/ffffffff rc 0/-1 job:'timeout.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771165.993509:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533781888 00010000:00010000:0.0:1790771165.993512:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 132 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993516:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771165.993524:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba0000 with x1877759533782016 ext(0->4095) 00010000:00010000:1.0:1790771165.993530:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 133 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771165.993533:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba0000 00010000:00010000:3.0:1790771165.993540:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993542:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 133 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993555:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 383 00000100:00100000:2.0:1790771165.993569:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533782016:12345-192.168.204.50@tcp:3:timeout.0 00010000:00010000:3.0:1790771165.993570:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00000100:00100000:0.0:1790771165.993571:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539729408:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771165.993580:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771165.993581:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1567 00010000:00010000:3.0:1790771165.993587:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993597:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2397:x1877759533781888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.993601:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993612:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.993612:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993621:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 133 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993622:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 101 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993636:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993639:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533782016:12345-192.168.204.50@tcp:3:timeout.0 Request processed in 70us (204us total) trans 0 rc 4096/4096 00010000:00010000:1.0:1790771165.993644:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 133 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993651:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 101 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993658:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0bc39 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.993662:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 383 00002000:00100000:2.0:1790771165.993689:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xd:0x0] (0->4095) req@ffff8bfb06ba0000 x1877759533782016/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:266/0 lens 488/4536 e 0 to 0 dl 1790771176 ref 1 fl Complete:/600/0 rc 4096/4096 job:'timeout.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771165.993695:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0a223 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x4d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349fe expref: 133 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.993696:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539729536:192.168.204.50@tcp:104: 00002000:00100000:2.0:1790771165.993712:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba0000 with x1877759533782016 ext(0->4095) 00002000:00010000:2.0:1790771165.993717:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba0000 00010000:00010000:1.0:1790771165.993722:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4d:0x0].0x0 (ffff8bfc2900ac00) 00000100:00100000:3.0:1790771165.993722:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14725:x1877759533769728:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 38546us (38907us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771165.993725:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e873c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771165.993730:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993737:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5712 00010000:00010000:1.0:1790771165.993742:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993746:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993759:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993761:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993763:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993779:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.993798:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.993802:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993803:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.993811:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993822:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2397:x1877759533781888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 228us (419us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.993823:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.993826:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782272 00000100:00100000:3.0:1790771165.993831:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782272 00010000:00010000:0.0:1790771165.993839:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771165.993840:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1567 00010000:00010000:0.0:1790771165.993844:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993850:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993860:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771165.993863:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1790771165.993866:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 762 00010000:00010000:0.0:1790771165.993868:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.993875:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0bc86 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771165.993879:0:13762:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968617 00000100:00100000:3.0:1790771165.993879:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2397:x1877759533782272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.993891:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.993905:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.993905:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0bce8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350f7 expref: 126 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771165.993911:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005580bd52 reply state 000000009c0bb673 transno 4294968618 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.993912:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14426:x1877759533772288:12345-192.168.204.50@tcp:55:truncate.0 Request processed in 37516us (37599us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790771165.993933:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5718 00010000:00010000:1.0:1790771165.993940:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 126 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993945:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993952:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b21880 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539729664:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.993953:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:0.0:1790771165.993956:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.993960:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771165.993964:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771165.993968:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.993982:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd480 going to sleep for 11 seconds 00010000:00010000:3.0:1790771165.993989:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.993995:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.993996:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14742:x1877759533773952:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 36716us (36773us total) trans 4294968618 rc 0/0 00000100:00100000:2.0:1790771165.994004:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5720 00010000:00010000:0.0:1790771165.994008:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771165.994008:0:13762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771165.994019:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2397:x1877759533782272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 142us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.994023:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994027:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994031:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.994034:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994039:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994048:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x4d:0x0].0x0 (ffff8bfc2900ac00) 00010000:00010000:0.0:1790771165.994050:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.994053:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 2/0,0 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994058:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0bcda lrc: 0/0,0 mode: --/EX res: [0x240000403:0x4d:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994074:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994079:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994088:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994092:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.994096:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994100:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994108:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771165.994110:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.994115:0:13766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 103 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.994122:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.994125:0:13766:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 103 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994133:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 103 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994140:0:13766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.994149:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 762 00010000:00010000:0.0:1790771165.994163:0:13766:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 103 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.994172:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 103 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.994182:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d805880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539729792:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771165.994190:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782400 00000100:00100000:1.0:1790771165.994196:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782400 00000100:00100000:0.0:1790771165.994206:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f50840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771165.994236:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1449 00000100:00100000:1.0:1790771165.994247:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14066:x1877759533782400:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771165.994254:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.994285:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782912 00000100:00100000:2.0:1790771165.994292:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782912 00000100:00100000:2.0:1790771165.994326:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 763 00000100:00100000:2.0:1790771165.994333:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2397:x1877759533782912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.994341:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.994349:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0bcfd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e350fe expref: 124 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994358:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771165.994361:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.994398:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14066:x1877759533782400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 152us (274us total) trans 4294968619 rc 0/0 00000100:00100000:2.0:1790771165.994401:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2397:x1877759533782912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.994413:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1449 00000100:00100000:2.0:1790771165.994415:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 763 00000100:00100000:0.0:1790771165.994457:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.994513:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533782784 00000100:00100000:0.0:1790771165.994517:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.994520:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533782784 00000100:00100000:1.0:1790771165.994544:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783168 00000100:00100000:1.0:1790771165.994552:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783168 00000100:00100000:2.0:1790771165.994556:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 938 00000100:00100000:2.0:1790771165.994565:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533782784:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:0.0:1790771165.994584:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539727872:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.994601:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5747 00010000:00010000:0.0:1790771165.994602:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.994619:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14705:x1877759533783168:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:3.0:1790771165.994621:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771165.994635:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 28259 -> 28259 00002000:00010000:2.0:1790771165.994639:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:2.0:1790771165.994641:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 1790771157 -> 0 00000100:00100000:3.0:1790771165.994643:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783552 00002000:00010000:2.0:1790771165.994644:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00010000:00010000:1.0:1790771165.994645:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1790771165.994648:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783552 00002000:00010000:2.0:1790771165.994650:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 24 -> 24 00010000:00010000:1.0:1790771165.994662:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0b63c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351a6 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.994683:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.994693:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533782784:12345-192.168.204.50@tcp:2:chown.0 Request processed in 128us (234us total) trans 4294967592 rc 0/0 00000100:00100000:3.0:1790771165.994698:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1450 00000100:00100000:2.0:1790771165.994707:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 938 00010000:00010000:1.0:1790771165.994708:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f07fc4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33e5f expref: 131 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.994713:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13675:x1877759533783552:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771165.994728:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771165.994732:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.994733:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783680 00000100:00100000:2.0:1790771165.994738:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783680 00010000:00010000:1.0:1790771165.994745:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.994753:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728000:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771165.994754:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994758:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 123 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.994777:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.994798:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1568 00000100:00100000:3.0:1790771165.994803:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13675:x1877759533783552:12345-192.168.204.50@tcp:35:ls.0 Request processed in 95us (186us total) trans 4294968620 rc 0/0 00000100:00100000:2.0:1790771165.994809:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759533783680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.994815:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1450 00010000:00010000:2.0:1790771165.994818:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.994827:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 123 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.994831:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728128:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771165.994848:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 123 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994866:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0b10a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ef1 expref: 123 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994882:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771165.994886:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994892:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994898:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.994916:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771165.994946:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759533783680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 142us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.994952:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1568 00000100:00100000:1.0:1790771165.995063:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728256:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.995077:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0644df80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728384:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.995092:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728640:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.995104:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064af480 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728768:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.995114:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771165.995122:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995130:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.995164:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539729024:192.168.204.50@tcp:104: 00000001:00080000:0.0:1790771165.995169:0:13763:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969195 00000100:00100000:1.0:1790771165.995184:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06d16680 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539729152:192.168.204.50@tcp:104: 00000004:00010000:0.0:1790771165.995193:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000080719ded reply state 00000000fae99e44 transno 4294969205 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995203:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995212:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00000100:00100000:3.0:1790771165.995213:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.995216:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771165.995219:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771165.995253:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783808 00000100:00100000:3.0:1790771165.995260:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.995261:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783808 00000100:00100000:0.0:1790771165.995265:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14783:x1877759533777408:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 31859us (31951us total) trans 4294969205 rc 0/0 00000100:00100000:0.0:1790771165.995273:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5730 00000020:00080000:0.0:1790771165.995278:0:13763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771165.995289:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533783936 00010000:00010000:1.0:1790771165.995291:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 105 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.995295:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533783936 00000100:00100000:3.0:1790771165.995313:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.995317:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.995324:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0001_UUID:13774:1877759539728512:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771165.995331:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784064 00000100:00100000:1.0:1790771165.995335:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784064 00000100:00100000:3.0:1790771165.995351:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1569 00010000:00010000:1.0:1790771165.995356:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 133 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.995364:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1570 00000100:00100000:3.0:1790771165.995366:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2397:x1877759533783808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.995379:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.995380:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759533783936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.995389:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 105 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.995392:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771165.995393:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1571 00010000:00010000:2.0:1790771165.995402:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 18 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 133 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.995413:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2397:x1877759533784064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771165.995414:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 18 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 105 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.995427:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.995436:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 133 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.995444:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 133 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995453:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 18 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.995462:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0b0bd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e88 expref: 105 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.995463:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 133 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.995526:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0b046 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e2d expref: 133 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.995529:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.995532:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f09fbb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ca expref: 133 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.995539:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 19 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.995562:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.995568:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.995569:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.995574:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.995580:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.995586:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.995587:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:3.0:1790771165.995587:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:2397:x1877759533783808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 226us (378us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.995598:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.995600:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1569 00000100:00100000:2.0:1790771165.995608:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533783936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 229us (347us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.995614:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.995618:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1570 00010000:00010000:1.0:1790771165.995629:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.995652:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759533784064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 248us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.995659:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1571 00000100:00100000:2.0:1790771165.995834:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.995881:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784192 00000100:00100000:0.0:1790771165.995886:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784192 00010000:00010000:0.0:1790771165.995903:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 130 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.995924:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1572 00000100:00100000:0.0:1790771165.995928:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533784192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.995934:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.995939:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 130 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995947:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 130 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995957:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373800/0xfa0c505d97f09edb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348c3 expref: 130 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995968:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771165.995971:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995976:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.995981:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.995996:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2396:x1877759533784192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.996002:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1572 00000100:00100000:2.0:1790771165.996015:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771165.996046:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.996055:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784832 00000100:00100000:1.0:1790771165.996060:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784832 00000100:00100000:2.0:1790771165.996076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.996092:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784448 00000100:00100000:0.0:1790771165.996098:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784448 00000100:00100000:2.0:1790771165.996105:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785216 00000100:00100000:1.0:1790771165.996107:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1451 00000100:00100000:2.0:1790771165.996111:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785216 00010000:00010000:0.0:1790771165.996115:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 129 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.996121:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:12017:x1877759533784832:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771165.996130:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 130 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.996150:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1573 00000100:00100000:2.0:1790771165.996157:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1574 00000100:00100000:0.0:1790771165.996162:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759533784448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771165.996170:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759533785216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.996171:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771165.996175:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.996180:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 130 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996182:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.996192:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 130 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996193:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 130 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996223:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f09e56 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348ae expref: 130 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996225:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 130 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.996227:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:12017:x1877759533784832:12345-192.168.204.50@tcp:35:ls.0 Request processed in 110us (211us total) trans 4294968622 rc 0/0 00000100:00100000:3.0:1790771165.996245:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533787264 00000100:00100000:1.0:1790771165.996249:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1451 00000100:00100000:3.0:1790771165.996253:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533787264 00010000:00010000:0.0:1790771165.996255:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771165.996260:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996266:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996271:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.996283:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f09eb1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348bc expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.996290:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759533784448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (240us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771165.996300:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:0.0:1790771165.996302:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1573 00010000:00010000:2.0:1790771165.996307:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.996309:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.996318:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996323:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.996345:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5748 00000100:00100000:2.0:1790771165.996350:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759533785216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 182us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771165.996351:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784960 00000100:00100000:1.0:1790771165.996355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.996357:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784960 00000100:00100000:3.0:1790771165.996360:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13263:x1877759533787264:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771165.996369:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1574 00010000:00010000:3.0:1790771165.996373:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771165.996374:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996384:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0be70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353e4 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.996396:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1575 00000100:00100000:1.0:1790771165.996397:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.996409:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785600 00000100:00100000:2.0:1790771165.996411:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759533784960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.996414:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785600 00010000:00010000:2.0:1790771165.996422:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.996423:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996432:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996436:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.996443:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.996446:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 764 00010000:00010000:3.0:1790771165.996458:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996459:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.996464:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759533785600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771165.996466:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785728 00000100:00100000:1.0:1790771165.996473:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785728 00010000:00010000:0.0:1790771165.996479:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771165.996514:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996522:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0bd20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35105 expref: 122 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996526:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996531:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f09e17 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a7 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996536:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.996541:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996544:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771165.996550:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 939 00010000:00010000:2.0:1790771165.996556:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.996561:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.996562:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533785600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771165.996568:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533785728:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771165.996580:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.996583:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 764 00010000:00010000:1.0:1790771165.996586:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771165.996592:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771165.996602:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c7b5c36/0xfa0c505d97f0be85 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353cf expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771165.996602:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:2.0:1790771165.996612:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2397:x1877759533784960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.996622:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1575 00010000:00010000:3.0:1790771165.996638:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996647:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.996648:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539729920:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771165.996650:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533787392 00000001:00080000:0.0:1790771165.996654:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968621 is committed 00000100:00100000:2.0:1790771165.996656:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533787392 00010000:00010000:3.0:1790771165.996662:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996686:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.996688:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968619 is committed 00010000:00010000:3.0:1790771165.996698:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.996703:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996711:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.996715:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5749 00000100:00100000:2.0:1790771165.996729:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14511:x1877759533787392:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:1.0:1790771165.996734:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d394900 going to sleep for 11 seconds 00010000:00010000:2.0:1790771165.996738:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771165.996738:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771165.996744:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771165.996749:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996750:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0be93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e351f3 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996755:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996769:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0be77 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996776:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996784:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771165.996786:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968574 is committed 00010000:00010000:3.0:1790771165.996788:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996794:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73e00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:0.0:1790771165.996796:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 12 committed 00010000:00010000:1.0:1790771165.996802:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996803:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996805:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0be9a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771165.996813:0:7423:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8bfb04b8b900 refcount 2 committed 0 result -61 batchid 18 00010000:00010000:1.0:1790771165.996821:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771165.996822:0:7423:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3fa05800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result -61 sub_th ffff8bfb04b8b300 00010000:00010000:3.0:1790771165.996831:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996833:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0be9a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771165.996837:0:7423:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3fa05200 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05764200 00010000:00010000:1.0:1790771165.996843:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771165.996852:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771165.996856:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c72000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.996857:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996864:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996872:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0be9a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996873:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996881:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0b237 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996888:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996898:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771165.996898:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1790771165.996912:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996916:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc20109b00) 00010000:00010000:0.0:1790771165.996917:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.996917:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996923:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.996924:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996930:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996931:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996934:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996950:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0be93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351f3 expref: 124 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.996956:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.996956:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0be7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996959:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771165.996966:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0be9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351f3 expref: 123 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996967:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.996972:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.996997:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0b643 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.996998:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.997000:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.997006:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771165.997008:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.997010:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fa00, rc 0) 00010000:00010000:0.0:1790771165.997018:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997020:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771165.997020:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 18 committed batchid 17 00000100:00100000:2.0:1790771165.997031:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14511:x1877759533787392:12345-192.168.204.50@tcp:101:rm.0 Request processed in 306us (679us total) trans 4294969207 rc 0/0 00010000:00010000:0.0:1790771165.997034:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997043:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00000100:00100000:2.0:1790771165.997048:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5749 00010000:00010000:1.0:1790771165.997051:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771165.997052:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771165.997054:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 17 00010000:00010000:1.0:1790771165.997056:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997065:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.997069:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0bb7c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997070:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997086:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.997086:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0be70 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353e4 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997091:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997107:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x1d91fb2c (ffff8bfc310f2400) 00010000:00010000:1.0:1790771165.997113:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997114:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771165.997115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.997120:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997126:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997129:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0b532 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997137:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.997141:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997148:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997153:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997157:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.997175:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.997179:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.997182:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771165.997187:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771165.997190:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997190:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771165.997197:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997198:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.997199:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0be70 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353e4 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997213:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771165.997214:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786240 00010000:00010000:1.0:1790771165.997219:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0bc5c lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997221:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786240 00010000:00010000:0.0:1790771165.997223:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.997229:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73c00, rc 0) 00010000:00010000:0.0:1790771165.997239:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997253:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0xf7a5b27a (ffff8bfc20109000) 00010000:00010000:0.0:1790771165.997258:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771165.997260:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:13263:x1877759533787264:12345-192.168.204.50@tcp:101:ls.0 Request processed in 901us (1089us total) trans 4294969206 rc 301/301 00000100:00100000:2.0:1790771165.997262:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 765 00010000:00010000:0.0:1790771165.997263:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997276:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339400/0xfa0c505d97f0b811 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x40:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997282:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2397:x1877759533786240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771165.997282:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5748 00010000:00010000:2.0:1790771165.997295:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.997298:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997305:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.997307:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785984 00010000:00010000:2.0:1790771165.997310:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bd97 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35113 expref: 123 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.997314:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785984 00010000:00010000:0.0:1790771165.997316:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.997320:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790771165.997335:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539730048:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771165.997336:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.997343:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.997344:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:3.0:1790771165.997347:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786112 00010000:00010000:2.0:1790771165.997354:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.997355:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.997355:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786112 00010000:00010000:0.0:1790771165.997367:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771165.997371:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771165.997372:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771165.997377:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997378:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2397:x1877759533786240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.997392:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5750 00010000:00010000:0.0:1790771165.997393:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0bcbe lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997394:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 765 00000100:00100000:3.0:1790771165.997414:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539730048 00010000:00010000:0.0:1790771165.997417:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.997419:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539730048 00000004:00010000:1.0:1790771165.997424:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000094a99b40 reply state 00000000f1d45a47 transno 4294968621 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997427:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997443:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997445:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997449:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.997455:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997457:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:3.0:1790771165.997458:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00010000:00010000:1.0:1790771165.997466:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.997468:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.997471:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771165.997473:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771165.997477:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771165.997478:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3626:x1877759539730048:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771165.997506:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:0.0:1790771165.997510:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771165.997513:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997519:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0bc9b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790771165.997533:0:13765:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790771165.997540:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786368 00000100:00100000:2.0:1790771165.997541:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771165.997547:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786368 00000100:00100000:1.0:1790771165.997550:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14705:x1877759533783168:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 2935us (3032us total) trans 4294968621 rc 0/0 00000100:00100000:1.0:1790771165.997560:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5747 00000100:00100000:0.0:1790771165.997581:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786752 00000100:00100000:0.0:1790771165.997584:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786752 00000100:00100000:2.0:1790771165.997592:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771165.997593:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5751 00000100:00100000:1.0:1790771165.997608:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14174:x1877759533786112:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:0.0:1790771165.997615:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 766 00000100:00100000:0.0:1790771165.997627:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2397:x1877759533786368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.997631:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.997636:0:13765:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0837c) 00010000:00010000:1.0:1790771165.997638:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.997639:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771165.997645:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.997654:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0bd9e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3510c expref: 124 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997654:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997661:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784320 00000100:00100000:2.0:1790771165.997667:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784320 00010000:00010000:1.0:1790771165.997690:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997694:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.997698:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.997699:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 89 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997700:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.997721:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2397:x1877759533786368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (258us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.997722:0:13765:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.997732:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1576 00010000:00010000:1.0:1790771165.997741:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.997742:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 766 00000100:00100000:2.0:1790771165.997746:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:2398:x1877759533784320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771165.997761:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.997768:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 89 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.997770:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 767 00010000:00010000:2.0:1790771165.997783:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 89 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.997788:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:2397:x1877759533786752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771165.997790:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.997791:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 4360 -> 4360 00002000:00010000:3.0:1790771165.997801:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00010000:00010000:2.0:1790771165.997804:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f09e6b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348b5 expref: 89 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997805:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771165.997806:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.997807:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771165.997816:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:0.0:1790771165.997820:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bd66 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353b3 expref: 109 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771165.997826:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 16 -> 16 00010000:00010000:1.0:1790771165.997830:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997849:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:1.0:1790771165.997851:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.997855:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997857:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.997860:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.997870:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.997873:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771165.997878:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3626:x1877759539730048:12345-0@lo:2:osp-syn-1-1.0 Request processed in 404us (504us total) trans 4294967593 rc 0/0 00010000:00010000:1.0:1790771165.997879:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.997882:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.997893:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:2397:x1877759533786752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771165.997899:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00010000:00010000:2.0:1790771165.997905:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771165.997913:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 767 00010000:00010000:1.0:1790771165.997923:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771165.997926:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771165.997930:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:2398:x1877759533784320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771165.997931:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.997941:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0be69 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.997943:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533786880 00000100:00100000:2.0:1790771165.997944:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1576 00000100:00100000:0.0:1790771165.997949:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533786880 00000100:00100000:3.0:1790771165.997949:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967587 gen 2 00000004:00080000:3.0:1790771165.997959:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06541c00, transno 4294967576 00000004:00080000:3.0:1790771165.997976:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06543b80, transno 4294967577 00000100:00100000:0.0:1790771165.997983:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5752 00000004:00080000:3.0:1790771165.997983:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06541500, transno 4294967579 00000004:00080000:3.0:1790771165.997991:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb04973800, transno 4294967584 00000100:00100000:0.0:1790771165.997996:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13266:x1877759533786880:12345-192.168.204.50@tcp:101:ls.0 00000004:00080000:3.0:1790771165.997999:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb04973480, transno 4294967585 00010000:00010000:0.0:1790771165.998006:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:3.0:1790771165.998006:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb04971180, transno 4294967587 00000100:00100000:3.0:1790771165.998018:0:3626:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb05794a80 x1877759539730048/t4294967593(4294967593) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771181 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1790771165.998019:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0beaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353dd expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.998043:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05794a80/2, rc 0, transno 4294967593 00000100:00100000:3.0:1790771165.998050:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539730048:0@lo:2:osp-syn-1-1.0 00000100:00100000:1.0:1790771165.998062:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.998077:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.998085:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533785344 00010000:00010000:0.0:1790771165.998086:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.998091:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533785344 00010000:00010000:0.0:1790771165.998097:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.998107:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771165.998112:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 88 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.998115:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000004:00200000:0.0:1790771165.998121:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771165.998132:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771165.998133:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.998137:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533784704 00000100:00100000:2.0:1790771165.998141:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533784704 00010000:00010000:0.0:1790771165.998153:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0beaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 110 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998156:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 89 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771165.998159:0:9554:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 2 changes, 1 in progress, 0 in flight, 6 done 00000100:00100000:1.0:1790771165.998170:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771165.998183:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.998193:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1577 00010000:00010000:0.0:1790771165.998196:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:0.0:1790771165.998201:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:3.0:1790771165.998205:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1578 00000100:00100000:2.0:1790771165.998206:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:2398:x1877759533785344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771165.998207:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0800, rc 0) 00010000:00010000:2.0:1790771165.998218:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771165.998226:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 89 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998227:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:2398:x1877759533784704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771165.998236:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:13266:x1877759533786880:12345-192.168.204.50@tcp:101:ls.0 Request processed in 240us (644us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.998246:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771165.998254:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5752 00010000:00010000:3.0:1790771165.998257:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 89 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.998272:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533787520 00010000:00010000:2.0:1790771165.998274:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 89 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.998278:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533787520 00000100:00100000:1.0:1790771165.998278:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771165.998294:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 89 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.998301:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533788160 00000100:00100000:0.0:1790771165.998304:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533788160 00000100:00100000:0.0:1790771165.998321:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5753 00000100:00100000:0.0:1790771165.998328:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14521:x1877759533787520:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771165.998334:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771165.998335:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5754 00010000:00010000:0.0:1790771165.998344:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bebd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353eb expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.998349:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14322:x1877759533788160:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771165.998364:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771165.998378:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bec4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353f2 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998380:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f09e02 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34899 expref: 89 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998390:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998390:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f09e33 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e348a0 expref: 89 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998406:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771165.998414:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998414:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998416:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998441:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998442:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998443:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998463:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998467:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998471:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998473:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998481:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998514:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998518:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998518:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771165.998522:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998528:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998538:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998551:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771165.998559:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.998572:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998578:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:2398:x1877759533784704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 357us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771165.998585:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:2398:x1877759533785344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 381us (522us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771165.998586:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998595:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1578 00010000:00010000:1.0:1790771165.998599:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998607:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.998609:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1577 00010000:00010000:1.0:1790771165.998620:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.998629:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:1.0:1790771165.998630:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771165.998633:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771165.998641:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533787904 00000004:00200000:1.0:1790771165.998644:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00000004:00010000:0.0:1790771165.998646:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998646:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533787904 00010000:00010000:2.0:1790771165.998650:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771165.998662:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998684:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998688:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998689:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998690:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1452 00000100:00100000:3.0:1790771165.998703:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14368:x1877759533787904:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:1.0:1790771165.998715:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998724:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998725:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998736:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998742:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.998743:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998748:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998752:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.998757:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998766:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998769:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998770:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998782:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771165.998791:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.998792:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998794:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998800:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771165.998802:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998808:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bed2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998809:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.998812:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771165.998817:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998820:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998826:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998829:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14368:x1877759533787904:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 126us (665us total) trans 4294969208 rc 0/0 00010000:00010000:2.0:1790771165.998846:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998850:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1452 00010000:00010000:1.0:1790771165.998851:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998859:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0becb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998875:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771165.998876:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771165.998877:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc34320450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14514:x1877759533785984:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:0.0:1790771165.998883:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998884:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771165.998890:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998899:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771165.998900:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771165.998905:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998909:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998910:0:13774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998914:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998917:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0aea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e49 expref: 125 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.998933:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998936:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771165.998939:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998944:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998948:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:3.0:1790771165.998957:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771165.998964:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998966:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfc0ab7e100) 00010000:00010000:2.0:1790771165.998971:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.998972:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771165.998976:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbc0ca3a9 (ffff8bfc22108100) 00010000:00010000:1.0:1790771165.998980:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.998980:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998981:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.998981:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0bd12 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.998987:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.999011:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0bed9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.999020:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bee0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771165.999024:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.999032:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14741:x1877759533777536:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 34438us (34505us total) trans 0 rc -61/-61 00010000:00010000:3.0:1790771165.999038:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771165.999042:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5731 00010000:00010000:0.0:1790771165.999048:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0bebd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 111 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.999056:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bec4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353f2 expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999073:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.999076:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 110 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771165.999079:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353f2 expref: 124 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999089:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771165.999095:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e5868ba8 reply state 000000009700f620 transno 4294969209 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771165.999101:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771165.999104:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:0.0:1790771165.999110:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771165.999112:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790771165.999115:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391e00, rc 0) 00010000:00010000:1.0:1790771165.999118:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82600, rc 0) 00010000:00010000:3.0:1790771165.999120:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999121:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771165.999140:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14521:x1877759533787520:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 812us (1008us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.999141:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:2.0:1790771165.999142:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.999147:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14322:x1877759533788160:12345-192.168.204.50@tcp:101:ln.0 Request processed in 801us (876us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771165.999149:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771165.999154:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771165.999160:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5753 00010000:00010000:2.0:1790771165.999169:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771165.999174:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5754 00000100:00100000:3.0:1790771165.999192:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc34320450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14514:x1877759533785984:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 1789us (2081us total) trans 4294969209 rc 0/0 00000100:00100000:3.0:1790771165.999199:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5750 00000004:00200000:2.0:1790771165.999219:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771165.999264:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999275:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999283:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999290:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999301:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.999304:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999309:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999316:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.999318:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.999321:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999326:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0bd90 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999335:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999340:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999346:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999350:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771165.999353:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999358:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999368:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771165.999370:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771165.999373:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999377:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0befc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999406:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0bd7b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353a5 expref: 75 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999413:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771165.999415:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771165.999418:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0bd7b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353a5 expref: 75 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771165.999425:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02200, rc 0) 00000100:00100000:2.0:1790771165.999453:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:13885:x1877759533779584:12345-192.168.204.50@tcp:101:ls.0 Request processed in 20289us (20422us total) trans 4294968623 rc 301/301 00000100:00100000:2.0:1790771165.999458:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5736 00000100:00100000:3.0:1790771166.000231:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.000268:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533788544 00000100:00100000:1.0:1790771166.000274:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533788544 00000100:00100000:1.0:1790771166.000308:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5755 00000100:00100000:1.0:1790771166.000315:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:11973:x1877759533788544:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.000323:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.000330:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0bf0a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e353f9 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000358:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000365:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000372:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000379:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000384:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000388:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.000422:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.000447:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000452:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000456:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000460:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000463:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.000465:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000469:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000478:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.000480:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.000482:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000507:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf11 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000516:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000521:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000526:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000529:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.000532:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000536:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000541:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771166.000543:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.000545:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000549:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0bf18 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000571:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0bf0a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353f9 expref: 76 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000577:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.000579:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.000581:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0bf0a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353f9 expref: 76 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.000586:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85800, rc 0) 00000100:00100000:1.0:1790771166.000611:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:11973:x1877759533788544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 298us (381us total) trans 4294968624 rc 301/301 00000100:00100000:1.0:1790771166.000617:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5755 00000100:00100000:1.0:1790771166.009995:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.010052:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790464 00000100:00100000:0.0:1790771166.010059:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790464 00000100:00100000:0.0:1790771166.010098:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5756 00000100:00100000:0.0:1790771166.010107:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:14277:x1877759533790464:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:0.0:1790771166.010121:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.010134:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391200/0xfa0c505d97f0bf26 lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35407 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.010144:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.010169:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.010196:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792256 00000100:00100000:3.0:1790771166.010201:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533788288 00000100:00100000:2.0:1790771166.010202:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792256 00000100:00100000:3.0:1790771166.010208:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533788288 00000100:00100000:1.0:1790771166.010216:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.010236:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.010244:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533788800 00010000:00010000:0.0:1790771166.010248:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010252:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.010252:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533788800 00010000:00010000:0.0:1790771166.010263:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010278:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010287:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.010288:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.010288:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533788672 00000100:00100000:2.0:1790771166.010294:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533788672 00010000:00010000:0.0:1790771166.010298:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010317:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.010321:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00000100:00100000:2.0:1790771166.010330:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789184 00010000:00010000:0.0:1790771166.010332:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.010333:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789184 00010000:00010000:0.0:1790771166.010341:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010342:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789312 00000100:00100000:1.0:1790771166.010348:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789312 00010000:00010000:0.0:1790771166.010350:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010356:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.010360:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5757 00010000:00010000:0.0:1790771166.010365:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.010370:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.010376:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:13262:x1877759533792256:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.010379:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010386:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 941 00010000:00010000:0.0:1790771166.010387:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.010387:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.010392:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.010396:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010400:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:14551:x1877759533789312:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.010401:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bf3b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35431 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010406:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0bf2d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010416:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.010429:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3540e expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010431:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010448:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.010454:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (479232->483327) req@ffff8bfb0644e680 x1877759533788288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.010468:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010471:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.010474:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644e680 with x1877759533788288 ext(479232->483327) 00010000:00010000:1.0:1790771166.010479:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010514:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00002000:00010000:3.0:1790771166.010515:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644e680 00010000:00010000:2.0:1790771166.010520:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010522:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.010525:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790771166.010529:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010538:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.010540:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 384 00010000:00010000:0.0:1790771166.010544:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010544:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 24 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.010555:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533788288:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771166.010563:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010569:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc22108100) 00010000:00010000:0.0:1790771166.010578:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.010582:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010583:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010603:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0bf34 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010603:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010604:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010635:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 24 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010650:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539730176:192.168.204.50@tcp:104: 00000004:00200000:2.0:1790771166.010689:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.010690:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5758 00000100:00100000:3.0:1790771166.010705:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533788288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 154us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.010710:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13210:x1877759533788800:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1790771166.010718:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 384 00000100:00100000:1.0:1790771166.010720:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e896c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.010727:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1790771166.010727:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (479232->483327) req@ffff8bfb0644e680 x1877759533788288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.010736:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644e680 with x1877759533788288 ext(479232->483327) 00010000:00010000:0.0:1790771166.010741:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0bf5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35400 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.010741:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644e680 00010000:00010000:2.0:1790771166.010742:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.010749:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5759 00000100:00100000:1.0:1790771166.010765:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14203:x1877759533788672:12345-192.168.204.50@tcp:36:cp.0 00000100:00080000:3.0:1790771166.010765:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790771166.010766:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790771166.010771:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790771166.010780:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010786:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.010791:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5760 00010000:00010000:2.0:1790771166.010793:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.010806:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:14748:x1877759533789184:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.010807:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010808:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.010814:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010823:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010833:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010834:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.010838:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010845:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010863:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.010866:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010868:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 74 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010869:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.010876:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010896:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0bf49 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010896:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 87 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010916:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 74 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010918:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010927:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 87 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010928:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0bf5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010930:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010954:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010956:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 7/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010962:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.010962:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.010968:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010976:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.010982:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 87 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.010983:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.010989:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc0151fa00, rc 0) 00010000:00010000:2.0:1790771166.010990:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.010997:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 87 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011002:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771166.011006:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.011008:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.011009:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06543b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730304:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.011020:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13210:x1877759533788800:12345-192.168.204.50@tcp:101:cat.0 Request processed in 316us (805us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.011022:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0bf50 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011033:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5758 00010000:00010000:3.0:1790771166.011056:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 74 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011064:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bf3b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35431 expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011070:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 74 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011072:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391200/0xfa0c505d97f0bf26 lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35407 expref: 87 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011083:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000040:00080000:1.0:1790771166.011086:0:13762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 88 off10896 00010000:00010000:2.0:1790771166.011092:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.011101:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0bf3b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35431 expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011102:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:3.0:1790771166.011103:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06541500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730432:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.011110:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.011118:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391200/0xfa0c505d97f0bf26 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35407 expref: 87 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011123:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ee00, rc 0) 00010000:00010000:0.0:1790771166.011130:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391200, rc 0) 00000004:00010000:1.0:1790771166.011133:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004a77a5ab reply state 000000008b324108 transno 4294969211 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011138:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 86 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.011147:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011150:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 86 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.011161:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13262:x1877759533792256:12345-192.168.204.50@tcp:101:ls.0 Request processed in 786us (1018us total) trans 4294969210 rc 301/301 00010000:00010000:1.0:1790771166.011166:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000100:00100000:0.0:1790771166.011169:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14277:x1877759533790464:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1059us (1172us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.011176:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.011179:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730560:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.011182:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.011184:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5757 00000100:00100000:0.0:1790771166.011197:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5756 00010000:00010000:3.0:1790771166.011214:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 74 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011224:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 74 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.011235:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14203:x1877759533788672:12345-192.168.204.50@tcp:36:cp.0 Request processed in 471us (982us total) trans 4294969211 rc 0/0 00000100:00100000:3.0:1790771166.011235:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730688:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.011248:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5759 00000100:00100000:3.0:1790771166.011259:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35240 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.011288:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.011324:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533794048 00000100:00100000:3.0:1790771166.011329:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533794048 00000100:00100000:0.0:1790771166.011333:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.011382:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789440 00000100:00100000:0.0:1790771166.011386:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.011389:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789440 00000100:00100000:1.0:1790771166.011419:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789696 00000100:00100000:1.0:1790771166.011425:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789696 00000100:00100000:0.0:1790771166.011426:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.011432:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5761 00000100:00100000:2.0:1790771166.011436:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1453 00000100:00100000:3.0:1790771166.011446:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:13882:x1877759533794048:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.011453:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789824 00010000:00010000:3.0:1790771166.011455:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.011459:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789824 00010000:00010000:3.0:1790771166.011467:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0bf7a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35446 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.011482:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5762 00000100:00100000:1.0:1790771166.011519:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12241:x1877759533789696:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.011526:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5763 00010000:00010000:1.0:1790771166.011528:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.011539:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14580:x1877759533789824:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771166.011541:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0bf81 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35415 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011570:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011572:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539729408:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.011580:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011587:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011592:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.011593:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011598:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011614:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.011616:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011620:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539729536:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.011630:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011636:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.011637:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.011643:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 129 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011649:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011655:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011697:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000100:00100000:2.0:1790771166.011697:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba0700 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539730816:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.011698:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011706:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00200000:1.0:1790771166.011706:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.011712:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.011715:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011723:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 6 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.011724:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011734:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00000100:00100000:2.0:1790771166.011737:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffc00 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.011751:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0bf81 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.011755:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:13737:x1877759533789440:12345-192.168.204.50@tcp:35:ls.0 00000004:00200000:3.0:1790771166.011757:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.011776:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12128:x1877759539729280:12345-0@lo:101:mdt00_005.0 Request processed in 18425us (18539us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.011777:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011790:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00010000:00010000:1.0:1790771166.011793:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.011796:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.011798:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:3.0:1790771166.011803:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011811:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011816:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011821:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.011826:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:12241:x1877759533789696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 307us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.011827:0:12128:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968574 gen 2 00010000:00010000:3.0:1790771166.011830:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:0.0:1790771166.011835:0:12128:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968574 committed transno 4294968574 00010000:00010000:3.0:1790771166.011836:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.011841:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5762 00010000:00010000:3.0:1790771166.011848:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011856:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064aca80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-mdtlov_UUID:12128:1877759539729280:0@lo:101:mdt00_005.0 00010000:00010000:3.0:1790771166.011858:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771166.011863:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.011866:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011870:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0bf8f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.011872:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 4/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.011876:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:13737:x1877759533789440:12345-192.168.204.50@tcp:35:ls.0 Request processed in 425us (542us total) trans 4294968626 rc 0/0 00000100:00100000:1.0:1790771166.011889:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b21880 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539729664:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.011898:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 4/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.011899:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1453 00010000:00010000:3.0:1790771166.011910:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011917:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.011921:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011922:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011941:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.011944:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011950:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011959:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc20109b00) 00010000:00010000:3.0:1790771166.011963:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.011964:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.011968:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.011974:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0bf9d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.011983:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533794432 00000100:00100000:0.0:1790771166.011988:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533794432 00010000:00010000:3.0:1790771166.012006:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0bf7a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35446 expref: 78 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.012015:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:1.0:1790771166.012018:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.012020:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1790771166.012024:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5764 00010000:00010000:3.0:1790771166.012029:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0bf7a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35446 expref: 78 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.012037:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:11967:x1877759533794432:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.012039:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72000, rc 0) 00000100:00100000:2.0:1790771166.012045:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790080 00010000:00010000:0.0:1790771166.012049:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.012050:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790080 00010000:00010000:0.0:1790771166.012063:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0bfab lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35454 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012084:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5765 00000100:00100000:2.0:1790771166.012093:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:13675:x1877759533790080:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.012103:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d805880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539729792:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.012103:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.012109:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.012113:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3541c expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012124:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012131:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0bb59 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000020 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.012137:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 88 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012139:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:13882:x1877759533794048:12345-192.168.204.50@tcp:101:ls.0 Request processed in 634us (790us total) trans 4294968625 rc 301/301 00010000:00010000:0.0:1790771166.012143:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.012160:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.012160:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5761 00010000:00010000:0.0:1790771166.012167:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.012170:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 88 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.012191:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.012197:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.012200:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.012200:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fe00, rc 0) 00010000:00010000:0.0:1790771166.012211:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.012216:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012219:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790592 00000100:00100000:3.0:1790771166.012224:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790592 00010000:00010000:0.0:1790771166.012226:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.012230:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05796a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539729920:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.012235:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:13675:x1877759533790080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 139us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.012249:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc3607e000) 00000100:00100000:2.0:1790771166.012250:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5765 00010000:00010000:0.0:1790771166.012254:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.012256:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1454 00010000:00010000:0.0:1790771166.012259:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012262:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c7b5c36/0xfa0c505d97f0be85 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353cf expref: 26 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012267:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0bcd3 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012268:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:13668:x1877759533790592:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.012295:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c7b5c36/0xfa0c505d97f0be85 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353cf expref: 26 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012306:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.012313:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00000100:00100000:0.0:1790771166.012328:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:14211:x1877759533764608:12345-192.168.204.50@tcp:36:ln.0 Request processed in 61770us (62076us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.012336:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5702 00000100:00100000:3.0:1790771166.012337:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789952 00000100:00100000:1.0:1790771166.012341:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533785728:12345-192.168.204.50@tcp:101:cp.0 Request processed in 15780us (15902us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.012344:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789952 00000100:00100000:1.0:1790771166.012350:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 939 00000100:00100000:2.0:1790771166.012366:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.012367:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533787648 00000100:00100000:0.0:1790771166.012372:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533787648 00002000:00100000:3.0:1790771166.012375:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->32767) req@ffff8bfb06ba3b80 x1877759533789952/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.012388:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba3b80 with x1877759533789952 ext(0->32767) 00010000:00010000:3.0:1790771166.012398:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.012403:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790720 00000100:00100000:0.0:1790771166.012408:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790720 00010000:00010000:3.0:1790771166.012412:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.012419:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06ba3b80 00010000:00010000:0.0:1790771166.012422:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 130 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012430:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.012443:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789568 00000100:00100000:3.0:1790771166.012449:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789568 00010000:00010000:1.0:1790771166.012450:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.012460:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1579 00010000:00010000:1.0:1790771166.012460:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.012466:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (13015->18446744073709551615) 00000100:00100000:2.0:1790771166.012469:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1790771166.012475:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba0e00 with x1877759533789568 ext(13015->18446744073709551615) 00000100:00100000:0.0:1790771166.012476:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2399:x1877759533790720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.012480:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.012520:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba0e00. 00010000:00010000:1.0:1790771166.012522:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012522:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790208 00010000:00010000:0.0:1790771166.012526:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.012529:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790208 00010000:00010000:0.0:1790771166.012535:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 130 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012538:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012545:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 88 00002000:00100000:2.0:1790771166.012555:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xd:0x0] (4096->40959) req@ffff8bfb05c33800 x1877759533790208/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'timeout.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.012556:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 130 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012557:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012562:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533789952:12345-192.168.204.50@tcp:3:cat.0 00002000:00100000:2.0:1790771166.012586:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c33800 with x1877759533790208 ext(4096->40959) 00002000:00010000:2.0:1790771166.012591:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c33800 00010000:00010000:0.0:1790771166.012596:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0b850 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35271 expref: 130 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012612:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00000100:00100000:2.0:1790771166.012614:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 385 00010000:00010000:0.0:1790771166.012621:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.012622:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.012628:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533789568:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:0.0:1790771166.012642:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012647:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012659:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012667:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.012688:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012694:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012699:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012706:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 386 00000100:00100000:0.0:1790771166.012708:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2399:x1877759533790720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 234us (342us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.012709:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.012716:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.012721:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533790208:12345-192.168.204.50@tcp:3:timeout.0 00000100:00100000:0.0:1790771166.012724:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1579 00010000:00010000:1.0:1790771166.012733:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012743:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.012746:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.012749:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 768 00010000:00010000:1.0:1790771166.012750:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012756:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0bfb9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.012761:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2399:x1877759533787648:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:2.0:1790771166.012768:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 14872 -> 13015 00010000:00010000:1.0:1790771166.012770:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012773:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790771166.012773:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 1790771163 -> 1790771166 00010000:00010000:1.0:1790771166.012781:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.012781:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.012786:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 1790771164 -> 1790771166 00010000:00010000:0.0:1790771166.012790:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0bdcf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3511a expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.012793:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 32 -> 32 00010000:00010000:1.0:1790771166.012797:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012811:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.012815:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012817:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.012821:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.012822:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.012829:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2399:x1877759533789568:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 201us (399us total) trans 4294967594 rc 0/0 00010000:00010000:1.0:1790771166.012834:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771166.012838:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.012842:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 385 00010000:00010000:1.0:1790771166.012843:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.012850:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2399:x1877759533787648:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (694us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771166.012850:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (13015->18446744073709551615) 00010000:00010000:1.0:1790771166.012853:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0bfc0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.012860:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba0e00 with x1877759533789568 ext(13015->18446744073709551615) 00000100:00100000:3.0:1790771166.012864:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:13668:x1877759533790592:12345-192.168.204.50@tcp:35:ls.0 Request processed in 596us (755us total) trans 4294968628 rc 0/0 00000100:00100000:0.0:1790771166.012870:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 768 00002000:00010000:2.0:1790771166.012872:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba0e00. 00000100:00100000:3.0:1790771166.012883:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1454 00010000:00010000:1.0:1790771166.012914:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0bfab lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35454 expref: 77 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012926:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.012928:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.012931:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.012935:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.012938:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0bfab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35454 expref: 77 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012948:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790848 00010000:00010000:3.0:1790771166.012950:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.012954:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790848 00010000:00010000:1.0:1790771166.012961:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00000100:00100000:0.0:1790771166.012967:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.012974:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.012979:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 89 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.012985:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.012993:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:11967:x1877759533794432:12345-192.168.204.50@tcp:101:ls.0 Request processed in 956us (1030us total) trans 4294968627 rc 301/301 00010000:00010000:3.0:1790771166.012998:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013005:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5764 00000100:00100000:2.0:1790771166.013009:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1580 00000100:00100000:0.0:1790771166.013017:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.013023:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:2399:x1877759533790848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.013028:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533791104 00010000:00010000:2.0:1790771166.013033:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.013034:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533791104 00010000:00010000:2.0:1790771166.013042:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 90 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.013055:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.013059:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533791232 00000100:00100000:1.0:1790771166.013063:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533791232 00010000:00010000:2.0:1790771166.013066:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 90 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013081:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0ba17 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35304 expref: 91 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013092:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5766 00010000:00010000:2.0:1790771166.013095:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000100:00100000:1.0:1790771166.013102:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13734:x1877759533791104:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.013102:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013117:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.013118:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.013128:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.013129:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35423 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013129:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.013149:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 91 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013164:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 91 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.013165:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2399:x1877759533790848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.013177:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.013187:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1580 00010000:00010000:1.0:1790771166.013189:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.013194:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.013197:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82400, rc 0) 00000100:00100000:2.0:1790771166.013203:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533790976 00000100:00100000:2.0:1790771166.013207:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533790976 00010000:00010000:2.0:1790771166.013222:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 76 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013231:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13734:x1877759533791104:12345-192.168.204.50@tcp:101:ls.0 Request processed in 129us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.013238:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5766 00000100:00100000:0.0:1790771166.013248:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.013254:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1581 00000100:00100000:1.0:1790771166.013258:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533791488 00000100:00100000:1.0:1790771166.013262:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533791488 00000100:00100000:2.0:1790771166.013267:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:2399:x1877759533790976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.013279:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.013285:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 76 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013293:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5767 00010000:00010000:2.0:1790771166.013296:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 76 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013304:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:13733:x1877759533791232:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.013311:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0b2a7 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fa7 expref: 76 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013313:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.013324:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00010000:00010000:1.0:1790771166.013325:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3542a expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013329:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.013340:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.013356:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013363:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013367:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 90 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013379:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 90 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013386:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.013388:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.013391:0:13797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 5 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013393:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8200, rc 0) 00000100:00100000:2.0:1790771166.013406:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001_UUID:13797:1877759539730944:0@lo:105: 00000100:00100000:0.0:1790771166.013407:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.013416:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13733:x1877759533791232:12345-192.168.204.50@tcp:101:ls.0 Request processed in 115us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.013423:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5767 00000100:00100000:1.0:1790771166.013435:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792384 00000100:00100000:1.0:1790771166.013437:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792384 00000100:00100000:2.0:1790771166.013445:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.013466:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5768 00000100:00100000:1.0:1790771166.013474:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14424:x1877759533791488:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.013508:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff300 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.013513:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.013522:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013531:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.013534:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539730944 00000100:00100000:0.0:1790771166.013537:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792512 00000100:00100000:2.0:1790771166.013539:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539730944 00010000:00010000:1.0:1790771166.013540:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.013542:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792512 00000100:00100000:2.0:1790771166.013574:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790771166.013580:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5769 00000100:00100000:2.0:1790771166.013584:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:13797:x1877759539730944:12345-0@lo:105: 00000100:00100000:0.0:1790771166.013591:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:13263:x1877759533792384:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.013595:0:6478:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.013600:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.013605:0:6478:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.013611:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0bfea lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35438 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013613:0:6478:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013632:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 5/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013637:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.013639:0:7771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969212 00010000:00010000:2.0:1790771166.013647:0:6478:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013663:0:6478:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb063e1c00) 00000004:00080000:3.0:1790771166.013663:0:13767:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x25:0x0], index 1: 0 00010000:00010000:0.0:1790771166.013666:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.013666:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d221a97b reply state 00000000a90fc595 transno 4294969213 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013706:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.013707:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 2/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.013715:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:13797:x1877759539730944:12345-0@lo:105: Request processed in 132us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.013723:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:0.0:1790771166.013728:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013729:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771166.013733:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1790771166.013734:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.013747:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.013757:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.013769:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b23800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001_UUID:13797:1877759539730944:0@lo:105: 00000100:00100000:1.0:1790771166.013776:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14424:x1877759533791488:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 299us (602us total) trans 4294969213 rc 0/0 00010000:00010000:0.0:1790771166.013777:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.013782:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.013783:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0bff8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013795:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5768 00010000:00010000:0.0:1790771166.013802:0:12128:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.013803:0:7771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.013805:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:2399:x1877759533790976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 541us (753us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.013808:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013822:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5770 00000100:00100000:2.0:1790771166.013829:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1581 00010000:00010000:3.0:1790771166.013834:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0bff8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.013836:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14458:x1877759533792512:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771166.013858:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.013862:0:7771:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0b3e2) 00010000:00010000:1.0:1790771166.013864:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.013873:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.013882:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013888:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.013892:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.013906:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.013907:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.013929:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.013931:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.013935:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.013948:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:0.0:1790771166.013950:0:12128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].37, 344 off55192 00000100:00100000:1.0:1790771166.013976:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792768 00000100:00100000:1.0:1790771166.013980:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792768 00010000:00010000:3.0:1790771166.014011:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.014014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5771 00000100:00100000:1.0:1790771166.014026:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:14512:x1877759533792768:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771166.014029:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:3.0:1790771166.014036:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.014039:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.014040:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.014051:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3543f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.014051:0:13767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.014059:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.014076:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 91 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.014078:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792896 00000100:00100000:2.0:1790771166.014084:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792896 00010000:00010000:1.0:1790771166.014089:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 91 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.014096:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771166.014098:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.014101:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00000100:00100000:2.0:1790771166.014107:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5772 00000100:00100000:2.0:1790771166.014115:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14620:x1877759533792896:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:1.0:1790771166.014125:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14512:x1877759533792768:12345-192.168.204.50@tcp:101:rm.0 Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.014131:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5771 00010000:00010000:2.0:1790771166.014157:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.014168:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014173:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014184:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014196:0:13768:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014202:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.014242:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.014242:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.014255:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0be62 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.014270:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533791744 00000004:00010000:3.0:1790771166.014273:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ccfa32a reply state 00000000539a19bc transno 4294969214 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.014275:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533791744 00010000:00010000:3.0:1790771166.014288:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.014298:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.014304:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0xbc0ca3a9 (ffff8bfc20109400) 00000100:00100000:1.0:1790771166.014309:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792000 00010000:00010000:3.0:1790771166.014309:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.014313:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792000 00000100:00100000:3.0:1790771166.014317:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.014329:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533793024 00000100:00100000:2.0:1790771166.014335:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533793024 00000100:00100000:3.0:1790771166.014341:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533791360 00000100:00100000:1.0:1790771166.014347:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1455 00000100:00100000:3.0:1790771166.014348:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533791360 00000100:00100000:1.0:1790771166.014360:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:11974:x1877759533791744:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.014363:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.014369:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1456 00000100:00100000:2.0:1790771166.014378:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14064:x1877759533792000:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.014395:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.014414:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533792640 00000100:00100000:2.0:1790771166.014418:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533792640 00000100:00100000:0.0:1790771166.014425:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.014452:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 769 00000100:00100000:1.0:1790771166.014459:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:11974:x1877759533791744:12345-192.168.204.50@tcp:35:ls.0 Request processed in 101us (1210us total) trans 4294968629 rc 0/0 00000100:00100000:0.0:1790771166.014460:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.014467:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533792640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.014473:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1455 00010000:00010000:2.0:1790771166.014476:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.014513:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0be9a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351f3 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014527:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.014531:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.014553:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533792640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 91us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.014560:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533793408 00000100:00100000:2.0:1790771166.014561:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 769 00000100:00100000:1.0:1790771166.014567:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533793408 00000100:00100000:1.0:1790771166.014598:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533793792 00000100:00100000:1.0:1790771166.014602:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533793792 00000100:00100000:1.0:1790771166.014629:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1457 00000100:00100000:1.0:1790771166.014639:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13266:x1877759533793024:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771166.014692:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14064:x1877759533792000:12345-192.168.204.50@tcp:35:ls.0 Request processed in 316us (1360us total) trans 4294968630 rc 0/0 00000100:00100000:2.0:1790771166.014699:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1456 00000100:00100000:2.0:1790771166.014714:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1458 00000100:00100000:2.0:1790771166.014723:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14359:x1877759533793408:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:3.0:1790771166.014751:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533789056 00000100:00100000:3.0:1790771166.014758:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533789056 00000100:00100000:2.0:1790771166.014781:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1790771166.014784:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xd:0x0] (4096->40959) req@ffff8bfb04b23800 x1877759533789056/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'timeout.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.014797:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04b23800 with x1877759533789056 ext(4096->40959) 00002000:00010000:3.0:1790771166.014803:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb04b23800 00000100:00100000:0.0:1790771166.014809:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.014835:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 387 00000100:00100000:2.0:1790771166.014838:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533794688 00000100:00100000:2.0:1790771166.014844:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533794688 00000100:00100000:3.0:1790771166.014848:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533791360:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:2.0:1790771166.014884:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5773 00000100:00100000:2.0:1790771166.014893:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14277:x1877759533794688:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:2.0:1790771166.014902:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.014912:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c01b lrc: 2/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3545b expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.014916:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.014972:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014981:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.014987:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.014988:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533793280 00000100:00100000:0.0:1790771166.014994:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533793280 00010000:00010000:2.0:1790771166.015003:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015010:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.015015:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb size from disk: 11504 -> 23456 00010000:00010000:2.0:1790771166.015016:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.015024:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000100:00100000:0.0:1790771166.015025:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 942 00002000:00010000:3.0:1790771166.015030:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.015035:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771166.015038:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb blocks from disk: 16 -> 32 00000004:00200000:2.0:1790771166.015039:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00010000:00010000:2.0:1790771166.015051:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015056:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015061:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015063:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533793280:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:2.0:1790771166.015074:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015076:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533791360:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 228us (1944us total) trans 4294967597 rc 0/0 00010000:00010000:2.0:1790771166.015085:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.015090:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015095:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 387 00010000:00010000:2.0:1790771166.015105:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015112:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.015115:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.015117:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015121:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 388 00010000:00010000:2.0:1790771166.015130:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c022 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015137:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533789056:12345-192.168.204.50@tcp:3:timeout.0 00010000:00010000:2.0:1790771166.015149:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015159:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015167:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.015170:0:13793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1790771166.015177:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79e00 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:0.0:1790771166.015178:0:13793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:2.0:1790771166.015183:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.015184:0:13793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.015193:0:13793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb ctime from disk: 0 -> 1790771165 00010000:00010000:2.0:1790771166.015196:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.015198:0:13793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771166.015204:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533794176 00000100:00100000:1.0:1790771166.015211:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533794176 00010000:00010000:2.0:1790771166.015212:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc0ab7fc00) 00010000:00010000:2.0:1790771166.015216:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.015219:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015228:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c029 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015236:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533793280:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 190us (877us total) trans 4294967598 rc 0/0 00000100:00100000:1.0:1790771166.015243:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5774 00000100:00100000:0.0:1790771166.015248:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 942 00000100:00100000:1.0:1790771166.015257:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14523:x1877759533794176:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771166.015266:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.015267:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0be54 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353d6 expref: 119 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015271:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c01b lrc: 1/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3545b expref: 92 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015277:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c030 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3544d expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.015300:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.015303:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.015303:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0bff8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353d6 expref: 119 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.015310:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969215 is committed 00010000:00010000:2.0:1790771166.015311:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c01b lrc: 0/0,0 mode: --/CW res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3545b expref: 92 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015317:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.015323:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969213 is committed 00010000:00010000:3.0:1790771166.015325:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfc20109f00) 00010000:00010000:3.0:1790771166.015335:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.015337:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.015340:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ae00, rc 0) 00010000:00010000:2.0:1790771166.015342:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78000, rc 0) 00010000:00010000:1.0:1790771166.015345:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015352:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.015355:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015360:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015369:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:1.0:1790771166.015372:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.015375:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14277:x1877759533794688:12345-192.168.204.50@tcp:101:touch.0 Request processed in 482us (568us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.015377:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790771166.015378:0:13767:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000040:00080000:0.0:1790771166.015390:0:12128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].37, 552 off61552 00010000:00010000:1.0:1790771166.015391:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0bd0b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.015392:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5773 00000100:00100000:3.0:1790771166.015393:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:11056:x1877759533786624:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 22113us (22471us total) trans 4294969214 rc 0/0 00000004:00080000:0.0:1790771166.015399:0:12128:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb05e87e40 with version 76 00000100:00100000:3.0:1790771166.015415:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5746 00000004:00080000:0.0:1790771166.015417:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 76 rpc_version 76 00010000:00010000:1.0:1790771166.015418:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015426:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015430:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015435:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.015438:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1790771166.015439:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1790771166.015445:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015450:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3f91a300 x1877759539731200/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1784/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771166.015450:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533793664 00010000:00010000:1.0:1790771166.015454:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0xbc0ca3a9 (ffff8bfc20109400) 00000100:00100000:3.0:1790771166.015457:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533793664 00010000:00010000:1.0:1790771166.015462:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.015466:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015472:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0bfce lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015481:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539731200:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.015530:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015540:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015548:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015557:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.015560:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c72800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.015565:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015574:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015587:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00000100:00100000:0.0:1790771166.015588:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.015588:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539731200 00010000:00010000:1.0:1790771166.015593:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.015595:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539731200 00010000:00010000:1.0:1790771166.015600:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015607:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0bef5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015619:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.015624:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00010000:00010000:1.0:1790771166.015627:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015632:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.015634:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539731200:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.015645:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.015649:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015653:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015662:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000100:00100000:3.0:1790771166.015664:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1459 00010000:00010000:1.0:1790771166.015665:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.015686:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015690:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0bf6c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015702:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015707:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015712:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015715:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.015718:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015723:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015731:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:1.0:1790771166.015733:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.015737:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015743:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:13885:x1877759533793792:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.015744:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0bfe3 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015783:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015791:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015797:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790771166.015798:0:7771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 88 off10784 00010000:00010000:1.0:1790771166.015814:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.015817:0:7771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 166221329654ns, next at 167221325766ns, rc = 0 00010000:00010000:1.0:1790771166.015821:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015829:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015839:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:13885:x1877759533793792:12345-192.168.204.50@tcp:35:ls.0 Request processed in 100us (1383us total) trans 4294968631 rc 0/0 00000100:00100000:3.0:1790771166.015848:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1459 00000100:00100000:3.0:1790771166.015862:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1460 00010000:00010000:1.0:1790771166.015870:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.015871:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:14762:x1877759533793664:12345-192.168.204.50@tcp:37:getfattr.0 00000004:00010000:0.0:1790771166.015884:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001f4d10b4 reply state 0000000082136df3 transno 4294969216 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015887:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.015911:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015912:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.015919:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539731200:12345-0@lo:1000:osp_up1-0.0 Request processed in 285us (365us total) trans 4294968632 rc 0/0 00010000:00010000:0.0:1790771166.015931:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.015936:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.015936:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:0.0:1790771166.015941:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.015948:0:7771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.015951:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.015953:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.015955:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.015969:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.015976:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.015978:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.015980:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91a300 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539731200:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.015992:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.015997:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016001:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.016004:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.016006:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070718c96 reply state 00000000a8cd41a5 transno 4294969215 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016009:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.016023:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14458:x1877759533792512:12345-192.168.204.50@tcp:36:chown.0 Request processed in 2188us (2537us total) trans 4294969216 rc 0/0 00010000:00010000:1.0:1790771166.016031:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.016040:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.016041:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5770 00010000:00010000:1.0:1790771166.016044:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016045:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016062:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c037 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016063:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:2.0:1790771166.016070:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.016074:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.016079:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016082:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016088:0:12128:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016091:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.016103:0:12128:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:1.0:1790771166.016107:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016112:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f400 already unused, calling callback (ffffffffc18aa4f0) 00000004:00010000:2.0:1790771166.016113:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070718c96 reply state 00000000a8cd41a5 transno 4294969215 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016115:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016134:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016137:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016142:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfc0ab7e100) 00010000:00010000:1.0:1790771166.016147:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.016150:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016150:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:2.0:1790771166.016158:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.016163:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c03e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016164:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.016175:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.016188:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016194:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016203:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016209:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3544d expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016210:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016235:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3544d expref: 108 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016242:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00000100:00100000:2.0:1790771166.016244:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1790771166.016245:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.016250:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ec00, rc 0) 00000004:00200000:2.0:1790771166.016253:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.016277:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539730176:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.016285:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00080000:2.0:1790771166.016293:0:12128:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771166.016304:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.016309:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795328 00000100:00100000:2.0:1790771166.016310:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14396:x1877759533755520:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 150690us (150766us total) trans 4294969215 rc 0/0 00000100:00100000:0.0:1790771166.016315:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795328 00000100:00100000:2.0:1790771166.016327:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5667 00010000:00010000:1.0:1790771166.016328:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b400, rc 0) 00010000:00010000:0.0:1790771166.016334:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 79 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.016354:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:14551:x1877759533789312:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 5958us (6036us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.016354:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.016361:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1582 00010000:00010000:2.0:1790771166.016371:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.016375:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 941 00000100:00100000:0.0:1790771166.016376:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:2398:x1877759533795328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.016393:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.016399:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 79 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016401:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016417:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016425:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.016427:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 79 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.016429:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.016431:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfc800 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771166.016436:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1790771166.016437:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.016449:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016452:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016478:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771166.016480:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.016517:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.016523:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771166.016524:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.016530:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016548:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.016549:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016550:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0bc32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.016569:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.016575:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0b8c0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016584:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 115 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.016595:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 115 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016596:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.016597:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:2398:x1877759533795328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 224us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.016616:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1582 00010000:00010000:2.0:1790771166.016619:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00030200, rc 0) 00010000:00010000:1.0:1790771166.016621:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016628:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016632:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.016636:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.016641:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.016650:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13742:x1877759533770112:12345-192.168.204.50@tcp:101:ls.0 Request processed in 61448us (61654us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.016651:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7e800) 00010000:00010000:1.0:1790771166.016659:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.016664:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.016664:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5713 00000100:00100000:3.0:1790771166.016664:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533790208:12345-192.168.204.50@tcp:3:timeout.0 Request processed in 3945us (4196us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1790771166.016685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.016696:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0bbfa lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.016697:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 386 00002000:00100000:3.0:1790771166.016707:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xd:0x0] (4096->40959) req@ffff8bfb05c33800 x1877759533790208/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 36864/36864 job:'timeout.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.016714:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c33800 with x1877759533790208 ext(4096->40959) 00002000:00010000:3.0:1790771166.016719:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c33800 00000100:00100000:3.0:1790771166.016748:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795072 00000100:00100000:3.0:1790771166.016753:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795072 00000100:00100000:1.0:1790771166.016756:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14523:x1877759533794176:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 1501us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.016763:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5774 00000100:00100000:2.0:1790771166.016771:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14359:x1877759533793408:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 2048us (2344us total) trans 4294969217 rc 0/0 00000100:00100000:2.0:1790771166.016783:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1458 00000100:00100000:0.0:1790771166.016789:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.016803:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533794944 00000100:00100000:2.0:1790771166.016807:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533794944 00000100:00100000:1.0:1790771166.016814:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533796096 00000100:00100000:1.0:1790771166.016819:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533796096 00000100:00100000:2.0:1790771166.016834:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1461 00010000:00010000:3.0:1790771166.016838:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.016849:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13262:x1877759533794944:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.016855:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5775 00000100:00100000:1.0:1790771166.016869:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13208:x1877759533796096:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.016884:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.016884:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1583 00000100:00100000:2.0:1790771166.016889:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba0700 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539730816:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.016897:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.016899:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0c04c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e352a2 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.016904:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533795072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.016908:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.016922:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.016934:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795456 00000100:00100000:2.0:1790771166.016937:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795456 00010000:00010000:2.0:1790771166.016952:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 91 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.016975:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5d:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.016980:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1584 00010000:00010000:3.0:1790771166.016984:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.016992:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2398:x1877759533795456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.017004:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.017012:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 91 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017012:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.017026:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0c04c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352a2 expref: 117 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017033:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017042:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 91 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017055:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.017056:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:2.0:1790771166.017062:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771166.017063:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.017069:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.017071:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0c04c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352a2 expref: 117 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.017081:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.017084:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.017087:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.017093:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00010000:00010000:2.0:1790771166.017096:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1790771166.017100:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017121:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0bfea lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35438 expref: 107 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.017134:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13208:x1877759533796096:12345-192.168.204.50@tcp:101:ls.0 Request processed in 267us (351us total) trans 4294969218 rc 301/301 00000100:00100000:2.0:1790771166.017137:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2398:x1877759533795456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 144us (240us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.017148:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35438 expref: 106 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.017155:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5775 00000100:00100000:2.0:1790771166.017161:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1584 00010000:00010000:3.0:1790771166.017166:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040d3ae4a/0xfa0c505d97f0a977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 20480->32767) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c82 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017169:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:0.0:1790771166.017177:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.017182:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686800, rc 0) 00010000:00010000:3.0:1790771166.017188:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771166.017193:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771166.017200:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017212:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.017215:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13263:x1877759533792384:12345-192.168.204.50@tcp:101:ls.0 Request processed in 3622us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.017228:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06543b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730304:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.017235:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5769 00010000:00010000:1.0:1790771166.017248:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0b524 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35191 expref: 79 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017255:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.017274:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06541500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730432:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.017277:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13262:x1877759533794944:12345-192.168.204.50@tcp:35:ls.0 Request processed in 431us (1104us total) trans 4294969219 rc 0/0 00000100:00100000:3.0:1790771166.017280:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539731328:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.017290:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0baa3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3512f expref: 90 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.017291:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.017298:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1461 00000100:00100000:1.0:1790771166.017311:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730560:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.017329:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795584 00000100:00100000:1.0:1790771166.017330:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a11180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539730688:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.017335:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795584 00010000:00010000:2.0:1790771166.017353:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 79 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.017356:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.017356:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017389:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795712 00000100:00100000:2.0:1790771166.017394:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795712 00000100:00100000:0.0:1790771166.017400:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.017409:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c350c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.017410:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 116 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.017435:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795968 00000100:00100000:2.0:1790771166.017440:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1585 00000100:00100000:1.0:1790771166.017441:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795968 00000100:00100000:2.0:1790771166.017449:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:2398:x1877759533795584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.017457:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.017461:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 79 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790771166.017467:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790771166.017471:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 79 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.017479:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1462 00000100:00100000:1.0:1790771166.017511:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:13675:x1877759533795968:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771166.017514:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0af74 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e7a expref: 79 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017526:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771166.017531:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.017535:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.017542:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.017546:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1586 00010000:00010000:2.0:1790771166.017553:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.017560:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2396:x1877759533795712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.017569:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533796864 00010000:00010000:3.0:1790771166.017570:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.017575:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533796864 00010000:00010000:3.0:1790771166.017577:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 116 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017582:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:2398:x1877759533795584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.017597:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1585 00010000:00010000:3.0:1790771166.017598:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 116 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.017606:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5776 00000100:00100000:0.0:1790771166.017618:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:13884:x1877759533796864:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.017620:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0b26f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f84 expref: 116 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017626:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017631:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.017635:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017641:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0c05a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35462 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017702:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017704:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000004:00010000:2.0:1790771166.017708:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000271324fa reply state 00000000b81d9faa transno 4294969220 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017713:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017720:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017733:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017735:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017738:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017750:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.017755:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.017757:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.017761:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.017781:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017786:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.017790:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017797:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017803:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14620:x1877759533792896:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 3687us (3747us total) trans 4294969220 rc 0/0 00000100:00100000:2.0:1790771166.017812:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5772 00000100:00100000:3.0:1790771166.017813:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759533795712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 254us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.017821:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1586 00000004:00200000:0.0:1790771166.017842:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.017855:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017866:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.017875:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017885:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017889:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017894:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017899:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.017902:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.017916:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017918:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017936:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:2.0:1790771166.017940:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.017941:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.017945:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017950:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c061 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017955:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533797248 00010000:00010000:0.0:1790771166.017958:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017959:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533797248 00010000:00010000:0.0:1790771166.017967:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017972:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017975:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.017978:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.017983:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.017988:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5777 00010000:00010000:0.0:1790771166.017991:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc3607e100) 00010000:00010000:0.0:1790771166.017994:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.017997:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.018000:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14409:x1877759533797248:12345-192.168.204.50@tcp:101:dd.0 00000001:00080000:3.0:1790771166.018004:0:13771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969221 00010000:00010000:0.0:1790771166.018009:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c068 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.018015:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1790771166.018031:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006ed148cf reply state 000000002966538c transno 4294969222 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.018037:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795200 00000100:00100000:0.0:1790771166.018042:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795200 00010000:00010000:3.0:1790771166.018042:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018059:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 92 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.018060:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771166.018068:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.018074:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.018092:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1587 00000100:00100000:0.0:1790771166.018101:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:2396:x1877759533795200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.018109:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.018111:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c076 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35469 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018116:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 92 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.018117:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14580:x1877759533789824:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 6578us (6691us total) trans 4294969222 rc 0/0 00010000:00010000:0.0:1790771166.018141:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 92 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.018141:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5763 00000020:00080000:3.0:1790771166.018149:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771166.018159:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0bc78 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3535f expref: 92 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018176:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771166.018181:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018182:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.018204:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 82 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018205:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.018205:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533789952:12345-192.168.204.50@tcp:3:cat.0 Request processed in 5649us (5904us total) trans 0 rc 32768/32768 00000100:00100000:3.0:1790771166.018226:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 88 00010000:00010000:0.0:1790771166.018229:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.018230:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 4/0,1 mode: --/CW res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x2 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.018234:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->32767) req@ffff8bfb06ba3b80 x1877759533789952/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 32768/32768 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.018254:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1790771166.018263:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba3b80 with x1877759533789952 ext(0->32767) 00010000:00010000:3.0:1790771166.018270:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 25 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.018280:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2396:x1877759533795200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 180us (415us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.018282:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 25 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.018287:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 82 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.018295:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1587 00002000:00010000:3.0:1790771166.018308:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb06ba3b80 00010000:00010000:2.0:1790771166.018314:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 82 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.018325:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539731456:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.018333:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0c05a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35462 expref: 82 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018346:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.018350:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.018356:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0c05a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35462 expref: 82 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.018361:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.018376:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00000100:00100000:0.0:1790771166.018406:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:13884:x1877759533796864:12345-192.168.204.50@tcp:101:ls.0 Request processed in 790us (877us total) trans 4294968633 rc 301/301 00000100:00100000:0.0:1790771166.018416:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5776 00000100:00100000:3.0:1790771166.018417:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533789056:12345-192.168.204.50@tcp:3:timeout.0 Request processed in 3281us (4120us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1790771166.018426:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 388 00002000:00100000:3.0:1790771166.018433:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xd:0x0] (4096->40959) req@ffff8bfb04b23800 x1877759533789056/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 36864/36864 job:'timeout.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.018445:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04b23800 with x1877759533789056 ext(4096->40959) 00002000:00010000:3.0:1790771166.018449:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb04b23800 00010000:00010000:0.0:1790771166.018473:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018481:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.018629:0:12030:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968634 00000100:00100000:2.0:1790771166.018644:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771166.018651:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c5e811b8 reply state 000000007800b972 transno 4294968635 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018662:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.018682:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:0.0:1790771166.018684:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.018687:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.018729:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14748:x1877759533789184:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 7927us (8445us total) trans 4294968635 rc 0/0 00000100:00100000:1.0:1790771166.018731:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:13266:x1877759533793024:12345-192.168.204.50@tcp:37:ls.0 Request processed in 4094us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.018742:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5760 00000100:00100000:1.0:1790771166.018747:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1457 00000100:00100000:2.0:1790771166.018747:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533796224 00000020:00080000:0.0:1790771166.018749:0:12030:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.018754:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533796224 00002000:00100000:2.0:1790771166.018777:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (483328->487423) req@ffff8bfb0566fb80 x1877759533796224/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.018784:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566fb80 with x1877759533796224 ext(483328->487423) 00002000:00010000:2.0:1790771166.018788:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0566fb80 00000100:00100000:2.0:1790771166.018806:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 389 00000100:00100000:2.0:1790771166.018815:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533796224:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771166.018912:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533796224:12345-192.168.204.50@tcp:3:cat.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.018920:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 389 00002000:00100000:2.0:1790771166.018927:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (483328->487423) req@ffff8bfb0566fb80 x1877759533796224/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.018934:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566fb80 with x1877759533796224 ext(483328->487423) 00002000:00010000:2.0:1790771166.018937:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0566fb80 00000100:00100000:0.0:1790771166.018963:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.018988:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533796480 00000100:00100000:2.0:1790771166.018992:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533796480 00000100:00100000:2.0:1790771166.019018:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1463 00000100:00100000:0.0:1790771166.019032:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.019032:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:13882:x1877759533796480:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.019077:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.019098:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533795840 00000100:00100000:3.0:1790771166.019104:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533795840 00000100:00100000:0.0:1790771166.019124:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.019124:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:13882:x1877759533796480:12345-192.168.204.50@tcp:35:ls.0 Request processed in 94us (158us total) trans 4294968636 rc 0/0 00000100:00100000:2.0:1790771166.019141:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1463 00000100:00100000:3.0:1790771166.019141:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 943 00000100:00100000:3.0:1790771166.019155:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533795840:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:2.0:1790771166.019166:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533796992 00000100:00100000:2.0:1790771166.019172:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533796992 00000100:00100000:2.0:1790771166.019202:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533797632 00000100:00100000:2.0:1790771166.019206:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533797632 00000100:00100000:2.0:1790771166.019225:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1464 00000100:00100000:0.0:1790771166.019230:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.019239:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:13677:x1877759533796992:12345-192.168.204.50@tcp:35:ls.0 00002000:00010000:3.0:1790771166.019253:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790771166.019256:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00002000:00010000:3.0:1790771166.019259:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.019262:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:3.0:1790771166.019264:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771166.019285:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533797760 00000100:00100000:0.0:1790771166.019290:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533797760 00000100:00100000:3.0:1790771166.019296:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533795840:12345-192.168.204.50@tcp:2:cp.0 Request processed in 143us (217us total) trans 4294967599 rc 0/0 00000100:00100000:3.0:1790771166.019303:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 943 00000100:00100000:0.0:1790771166.019324:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5778 00000100:00100000:2.0:1790771166.019334:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13677:x1877759533796992:12345-192.168.204.50@tcp:35:ls.0 Request processed in 96us (306us total) trans 4294968637 rc 0/0 00000100:00100000:0.0:1790771166.019337:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13973:x1877759533797760:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:3.0:1790771166.019340:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1465 00000100:00100000:2.0:1790771166.019354:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1464 00000100:00100000:3.0:1790771166.019355:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13734:x1877759533797632:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.019365:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771166.019378:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0b9ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352da expref: 118 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019394:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f09836 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34623 expref: 117 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019404:0:7771:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0ab4c) 00010000:00010000:0.0:1790771166.019406:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:0.0:1790771166.019409:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.019418:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019426:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019431:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019440:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019446:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019451:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019482:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019525:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019531:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.019637:0:7771:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000402:0xa2:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1790771166.019697:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019704:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019708:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019712:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.019715:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019720:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019730:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:0.0:1790771166.019732:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790771166.019734:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019738:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c092 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xa2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019747:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019751:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019755:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019759:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019763:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.019765:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019769:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019774:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.019775:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.019777:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019784:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0c084 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.019790:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000691eb6cd reply state 00000000d8a6f9ca transno 4294969223 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019796:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.019801:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc3607e000) 00010000:00010000:0.0:1790771166.019803:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.019804:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.019839:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13973:x1877759533797760:12345-192.168.204.50@tcp:36:rm.0 Request processed in 508us (617us total) trans 4294969223 rc 0/0 00000100:00100000:1.0:1790771166.019845:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:14762:x1877759533793664:12345-192.168.204.50@tcp:37:getfattr.0 Request processed in 3974us (5064us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.019851:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5778 00000100:00100000:1.0:1790771166.019859:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1460 00000100:00100000:0.0:1790771166.020523:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:13675:x1877759533795968:12345-192.168.204.50@tcp:37:ls.0 Request processed in 3036us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.020531:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1462 00000100:00100000:3.0:1790771166.021114:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.021133:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.021153:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798144 00000100:00100000:2.0:1790771166.021160:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798144 00000100:00100000:0.0:1790771166.021176:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798016 00000100:00100000:0.0:1790771166.021184:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798016 00000100:00100000:2.0:1790771166.021199:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5779 00000100:00100000:2.0:1790771166.021209:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14492:x1877759533798144:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:0.0:1790771166.021228:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 944 00000100:00100000:0.0:1790771166.021240:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533798016:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:2.0:1790771166.021243:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.021256:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.021266:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 4/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.021290:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.021299:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 118 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.021308:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539731584:192.168.204.50@tcp:104: 00002000:00010000:0.0:1790771166.021311:0:13788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 29064 -> 29064 00002000:00010000:0.0:1790771166.021316:0:13788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771166.021319:0:13788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771166.021322:0:13788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:0.0:1790771166.021325:0:13788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:2.0:1790771166.021351:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.021362:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533798016:12345-192.168.204.50@tcp:2:chown.0 Request processed in 123us (223us total) trans 4294967595 rc 0/0 00000100:00100000:0.0:1790771166.021369:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 944 00000100:00100000:1.0:1790771166.021806:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:13734:x1877759533797632:12345-192.168.204.50@tcp:37:ls.0 Request processed in 2455us (2689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.021813:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1465 00000100:00100000:3.0:1790771166.024945:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.024981:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.024997:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798400 00000100:00100000:1.0:1790771166.025003:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798400 00000100:00100000:2.0:1790771166.025035:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799040 00000100:00100000:1.0:1790771166.025040:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5780 00000100:00100000:2.0:1790771166.025042:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799040 00000100:00100000:1.0:1790771166.025050:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14480:x1877759533798400:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.025062:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.025071:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c0a0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35477 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.025078:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5781 00000100:00100000:2.0:1790771166.025090:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:12014:x1877759533799040:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.025101:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.025110:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c0a7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35485 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025135:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025152:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025153:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025177:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025179:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025194:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025204:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025208:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025216:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025223:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025230:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025235:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025255:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c0ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025266:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025274:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c0ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025283:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025289:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.025293:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.025296:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025304:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.025315:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025325:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025325:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025342:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025347:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.025348:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025355:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.025357:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025363:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025363:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.025369:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025382:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025384:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025392:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.025398:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.025402:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025404:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c0ae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025423:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c0b5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025426:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025434:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025435:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025457:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025457:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025476:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.025478:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025480:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025508:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.025514:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025517:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025525:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025529:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xea196397 (ffff8bfc0ab7e800) 00010000:00010000:1.0:1790771166.025533:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.025535:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc0ab7fc00) 00010000:00010000:1.0:1790771166.025536:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025541:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.025545:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025547:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c0bc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025559:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c0c3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025579:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c0a0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35477 expref: 85 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025586:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c0a7 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35485 expref: 85 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.025595:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c0ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35477 expref: 84 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025607:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.025609:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:2.0:1790771166.025612:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.025614:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.025617:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104e00, rc 0) 00010000:00010000:2.0:1790771166.025620:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c0a7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35485 expref: 84 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.025630:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72a00, rc 0) 00000100:00100000:1.0:1790771166.025648:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14480:x1877759533798400:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 600us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.025655:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:12014:x1877759533799040:12345-192.168.204.50@tcp:101:ls.0 Request processed in 565us (674us total) trans 4294968638 rc 301/301 00000100:00100000:1.0:1790771166.025665:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5780 00000100:00100000:2.0:1790771166.025687:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5781 00000100:00100000:2.0:1790771166.027719:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.027741:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.027764:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798528 00000100:00100000:2.0:1790771166.027765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.027771:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798528 00000100:00100000:0.0:1790771166.027794:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798272 00000100:00100000:2.0:1790771166.027801:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.027802:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798272 00000100:00100000:1.0:1790771166.027803:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533797888 00000100:00100000:1.0:1790771166.027810:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533797888 00000100:00100000:3.0:1790771166.027811:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 945 00000100:00100000:3.0:1790771166.027823:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:11056:x1877759533798528:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:2.0:1790771166.027824:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533798912 00002000:00100000:0.0:1790771166.027830:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (10289152->10485759) req@ffff8bfb0566f800 x1877759533798272/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.027832:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533798912 00010000:00010000:3.0:1790771166.027836:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1790771166.027839:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x19:0x0] (10485760->11206655) req@ffff8bfb0566e300 x1877759533797888/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.027848:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566f800 with x1877759533798272 ext(10289152->10485759) 00010000:00010000:3.0:1790771166.027853:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd817bf4/0xfa0c505d97f0c0d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3547e expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.027856:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0566f800 00000100:00100000:2.0:1790771166.027873:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1466 00002000:00010000:3.0:1790771166.027879:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00100000:1.0:1790771166.027880:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566e300 with x1877759533797888 ext(10485760->11206655) 00000100:00100000:0.0:1790771166.027882:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 390 00000100:00100000:2.0:1790771166.027887:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:11973:x1877759533798912:12345-192.168.204.50@tcp:35:ls.0 00002000:00010000:1.0:1790771166.027892:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0566e300 00000100:00100000:0.0:1790771166.027898:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759533798272:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:3.0:1790771166.027899:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=166s v=(0 0) 00010000:00010000:3.0:1790771166.027908:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790771166.027916:0:8406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd817bf4/0xfa0c505d97f0c0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3547e expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.027926:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 391 00010000:00010000:3.0:1790771166.027930:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd817bf4/0xfa0c505d97f0c0d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3547e expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.027939:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533797888:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:3.0:1790771166.027940:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02000, rc 0) 00000100:00100000:3.0:1790771166.027976:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:11056:x1877759533798528:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 155us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.027977:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:11973:x1877759533798912:12345-192.168.204.50@tcp:35:ls.0 Request processed in 94us (178us total) trans 4294968639 rc 0/0 00000100:00100000:3.0:1790771166.027993:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 945 00000100:00100000:2.0:1790771166.027994:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1466 00000100:00100000:3.0:1790771166.028116:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.028141:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.028144:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799168 00000100:00100000:2.0:1790771166.028150:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799168 00000100:00100000:2.0:1790771166.028180:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799296 00000100:00100000:2.0:1790771166.028183:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799296 00000100:00100000:2.0:1790771166.028207:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5782 00000100:00100000:2.0:1790771166.028214:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13742:x1877759533799168:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.028222:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.028229:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5783 00010000:00010000:2.0:1790771166.028236:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c0df lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3548c expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.028244:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14523:x1877759533799296:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:3.0:1790771166.028261:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.028270:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0c0e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35493 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028286:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028294:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028301:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028304:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028315:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.028318:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.028322:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.028323:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1790771166.028339:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028348:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c0df lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 121 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028348:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028369:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028375:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 120 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028382:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771166.028384:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.028386:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00000100:00100000:2.0:1790771166.028408:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13742:x1877759533799168:12345-192.168.204.50@tcp:101:ls.0 Request processed in 195us (292us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.028409:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028419:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5782 00010000:00010000:3.0:1790771166.028421:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028428:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.028448:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.028458:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028466:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028472:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028473:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.028481:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028512:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028518:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028521:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799552 00010000:00010000:3.0:1790771166.028523:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.028526:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799552 00010000:00010000:3.0:1790771166.028527:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028534:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028544:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.028546:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.028549:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028554:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c0f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028562:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 770 00010000:00010000:3.0:1790771166.028563:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028570:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028574:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:2396:x1877759533799552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.028584:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.028585:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028589:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.028592:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.028597:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028603:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028604:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c045 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3544d expref: 106 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028615:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:2.0:1790771166.028618:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.028635:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2396:x1877759533799552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 66us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.028644:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 770 00010000:00010000:3.0:1790771166.028654:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfc20109c00) 00010000:00010000:3.0:1790771166.028658:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.028661:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028663:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799424 00010000:00010000:3.0:1790771166.028684:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0c0fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028686:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799424 00010000:00010000:2.0:1790771166.028703:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 120 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028717:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.028726:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1588 00000100:00100000:2.0:1790771166.028734:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533799424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.028741:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.028747:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 120 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028751:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.028764:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 120 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028781:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.028791:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0bc40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35351 expref: 120 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028805:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:3.0:1790771166.028806:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02600/0xfa0c505d97f0c0e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 105 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028811:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.028813:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028824:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028832:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.028858:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.028862:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.028867:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.028879:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028884:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799936 00000100:00100000:0.0:1790771166.028891:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799936 00000100:00100000:2.0:1790771166.028893:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2396:x1877759533799424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 155us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.028905:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1588 00010000:00010000:1.0:1790771166.028907:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028908:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 104 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.028922:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800064 00000100:00100000:0.0:1790771166.028928:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800064 00010000:00010000:3.0:1790771166.028929:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:1.0:1790771166.028933:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 119 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.028934:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.028942:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.028944:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800192 00000100:00100000:0.0:1790771166.028951:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1467 00000100:00100000:2.0:1790771166.028951:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800192 00000100:00100000:0.0:1790771166.028962:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14002:x1877759533799936:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.028968:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 120 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.028976:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 120 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.028987:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539731712:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.028993:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f400, rc 0) 00000100:00100000:2.0:1790771166.028994:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1468 00000100:00100000:2.0:1790771166.029010:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:13263:x1877759533800064:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771166.029032:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e89a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.029033:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14523:x1877759533799296:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 792us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.029043:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5783 00000100:00100000:1.0:1790771166.029056:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1469 00000100:00100000:3.0:1790771166.029062:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799808 00000100:00100000:0.0:1790771166.029065:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14002:x1877759533799936:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (287us total) trans 4294969224 rc 0/0 00000100:00100000:3.0:1790771166.029067:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799808 00000100:00100000:1.0:1790771166.029068:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14008:x1877759533800192:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.029084:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1467 00000100:00100000:3.0:1790771166.029097:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5784 00000100:00100000:3.0:1790771166.029106:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14781:x1877759533799808:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.029137:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.029146:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 122 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.029152:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 104 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.029158:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.029177:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 104 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.029189:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14008:x1877759533800192:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (325us total) trans 4294969225 rc 0/0 00010000:00010000:3.0:1790771166.029190:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 104 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.029204:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1469 00000100:00100000:3.0:1790771166.029209:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d61880 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539731840:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.029242:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 121 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.029251:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 121 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.029262:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539731456:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.029266:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d60380 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539731968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.029280:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x2 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.029310:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533799680 00000100:00100000:0.0:1790771166.029315:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533799680 00002000:00010000:0.0:1790771166.029331:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (17258->18446744073709551615) 00002000:00100000:0.0:1790771166.029334:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0673b100 with x1877759533799680 ext(17258->18446744073709551615) 00002000:00010000:0.0:1790771166.029341:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0673b100. 00000100:00100000:1.0:1790771166.029345:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ffc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539731328:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.029356:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.029362:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35000 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.029367:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 392 00000100:00100000:0.0:1790771166.029377:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759533799680:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:1.0:1790771166.029382:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533795072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12484us (12712us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.029389:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1583 00002000:00010000:0.0:1790771166.029568:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 32696 -> 17258 00002000:00010000:0.0:1790771166.029572:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771165 -> 1790771166 00002000:00010000:0.0:1790771166.029574:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 1790771165 -> 0 00002000:00010000:0.0:1790771166.029576:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:0.0:1790771166.029577:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 24 -> 0 00000100:00100000:0.0:1790771166.029611:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2396:x1877759533799680:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 236us (866us total) trans 4294967600 rc 0/0 00000100:00100000:0.0:1790771166.029618:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 392 00002000:00010000:0.0:1790771166.029621:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (17258->18446744073709551615) 00002000:00100000:0.0:1790771166.029623:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0673b100 with x1877759533799680 ext(17258->18446744073709551615) 00002000:00010000:0.0:1790771166.029628:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0673b100. 00000100:00100000:1.0:1790771166.036325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.036375:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800960 00000100:00100000:0.0:1790771166.036381:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800960 00000100:00100000:0.0:1790771166.036413:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5785 00000100:00100000:0.0:1790771166.036421:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14068:x1877759533800960:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.036432:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.036442:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0c117 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354a1 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036482:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036516:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036523:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036533:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036537:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036542:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.036593:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.036628:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036633:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036637:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036641:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.036643:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036651:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036659:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.036661:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.036663:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036686:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0c11e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036695:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036699:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036704:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036707:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.036708:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036712:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036717:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc3607e100) 00010000:00010000:0.0:1790771166.036719:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.036720:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036725:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c125 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036747:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0c117 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a1 expref: 85 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036753:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.036754:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.036757:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0c117 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a1 expref: 85 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.036762:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687000, rc 0) 00000100:00100000:0.0:1790771166.036792:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14068:x1877759533800960:12345-192.168.204.50@tcp:101:ls.0 Request processed in 372us (469us total) trans 4294968640 rc 301/301 00000100:00100000:0.0:1790771166.036796:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5785 00000100:00100000:3.0:1790771166.045383:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.045409:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.045426:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.045443:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.045464:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801088 00000100:00100000:3.0:1790771166.045465:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.045473:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801088 00000100:00100000:0.0:1790771166.045512:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800448 00000100:00100000:3.0:1790771166.045518:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.045519:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800704 00000100:00100000:0.0:1790771166.045520:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800448 00010000:00010000:2.0:1790771166.045525:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 84 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.045527:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800704 00000100:00100000:3.0:1790771166.045539:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533800320 00000100:00100000:3.0:1790771166.045544:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533800320 00000100:00100000:2.0:1790771166.045562:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1589 00000100:00100000:0.0:1790771166.045567:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1470 00000100:00100000:2.0:1790771166.045576:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:2399:x1877759533801088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.045580:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1471 00000100:00100000:3.0:1790771166.045581:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801344 00000100:00100000:0.0:1790771166.045582:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12237:x1877759533800448:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.045586:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801344 00010000:00010000:2.0:1790771166.045594:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.045597:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:13884:x1877759533800704:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.045603:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 85 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045613:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 85 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045627:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0831a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ee4 expref: 85 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045638:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:2.0:1790771166.045643:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x7:0x0].0x0 bits 0x5/0x2 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045653:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045661:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045704:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.045729:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:13884:x1877759533800704:12345-192.168.204.50@tcp:35:ls.0 Request processed in 136us (300us total) trans 4294968641 rc 0/0 00000100:00100000:0.0:1790771166.045736:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12237:x1877759533800448:12345-192.168.204.50@tcp:35:ls.0 Request processed in 158us (322us total) trans 4294969226 rc 0/0 00000100:00100000:1.0:1790771166.045747:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1471 00000100:00100000:2.0:1790771166.045747:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:2399:x1877759533801088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 172us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.045757:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1470 00000100:00100000:2.0:1790771166.045761:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1589 00000100:00100000:0.0:1790771166.045799:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801472 00000100:00100000:0.0:1790771166.045804:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801472 00000100:00100000:2.0:1790771166.045808:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5786 00000100:00100000:1.0:1790771166.045812:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.045821:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13208:x1877759533800320:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.045830:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.045841:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c133 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3549a expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045881:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c13a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045889:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.045897:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.045920:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5d:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.045922:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.045928:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801600 00000100:00100000:3.0:1790771166.045933:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801600 00000004:00010000:2.0:1790771166.045934:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c13a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.045955:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5787 00010000:00010000:2.0:1790771166.045956:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c133 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3549a expref: 125 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.045967:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14796:x1877759533801472:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.045973:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597c00/0xfa0c505d97f0c13a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3549a expref: 124 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.045979:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.045980:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d:0x0].0x0 (ffff8bfc3da48700) 00010000:00010000:2.0:1790771166.045984:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.045987:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597c00, rc 0) 00010000:00010000:0.0:1790771166.045992:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0c141 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354a8 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.046011:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13208:x1877759533800320:12345-192.168.204.50@tcp:101:ls.0 Request processed in 193us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.046016:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5786 00010000:00010000:0.0:1790771166.046027:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.046037:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 2/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.046043:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.046050:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 946 00010000:00010000:0.0:1790771166.046055:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.046064:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14783:x1877759533801600:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771166.046066:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.046115:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.046129:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.046132:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354af expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.046161:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801856 00000100:00100000:1.0:1790771166.046166:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801856 00000100:00100000:1.0:1790771166.046195:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1472 00010000:00010000:3.0:1790771166.046196:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 27 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.046206:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:13664:x1877759533801856:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.046208:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xf:0x0].0x0 since=3s v=(1 0) 00010000:00010000:3.0:1790771166.046215:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(1 1) 00000100:00100000:1.0:1790771166.046287:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:13664:x1877759533801856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 84us (158us total) trans 4294968642 rc 0/0 00010000:00010000:3.0:1790771166.046292:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.046299:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1472 00010000:00010000:3.0:1790771166.046354:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 27 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.046366:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 27 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.046379:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539732096:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.046425:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.046443:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803904 00000100:00100000:1.0:1790771166.046447:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803904 00000100:00100000:1.0:1790771166.046479:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5788 00000100:00100000:1.0:1790771166.046506:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14480:x1877759533803904:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.046514:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.046523:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c156 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354cb expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.046601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.046602:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.046617:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c156 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354cb expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.046627:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00000100:00100000:0.0:1790771166.046633:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.046633:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.046640:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c156 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354cb expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.046650:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533801984 00000100:00100000:0.0:1790771166.046655:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533801984 00010000:00010000:1.0:1790771166.046660:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105800, rc 0) 00000100:00100000:2.0:1790771166.046682:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13263:x1877759533800064:12345-192.168.204.50@tcp:37:ls.0 Request processed in 17659us (17856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.046692:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533802368 00000100:00100000:0.0:1790771166.046696:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533802368 00000100:00100000:2.0:1790771166.046699:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1468 00000100:00100000:1.0:1790771166.046709:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14480:x1877759533803904:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 220us (281us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.046723:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1473 00000100:00100000:1.0:1790771166.046723:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5788 00000100:00100000:0.0:1790771166.046735:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14201:x1877759533801984:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790771166.046748:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1474 00000100:00100000:2.0:1790771166.046758:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13266:x1877759533802368:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.046794:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.046835:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14201:x1877759533801984:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 98us (231us total) trans 4294969227 rc 0/0 00000100:00100000:1.0:1790771166.046836:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.046856:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13266:x1877759533802368:12345-192.168.204.50@tcp:35:ls.0 Request processed in 96us (223us total) trans 4294969228 rc 0/0 00000100:00100000:0.0:1790771166.046857:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1473 00000100:00100000:2.0:1790771166.046868:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1474 00000100:00100000:1.0:1790771166.046888:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.046895:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533802624 00000100:00100000:0.0:1790771166.046901:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533802624 00010000:00010000:2.0:1790771166.046908:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.046915:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.046916:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533802880 00000100:00100000:1.0:1790771166.046924:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533802880 00000004:00200000:2.0:1790771166.046929:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 13015 00000100:00100000:0.0:1790771166.046930:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5789 00000100:00100000:0.0:1790771166.046941:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13637:x1877759533802624:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1790771166.046950:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1790771166.046957:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e:0x0] (29064->4222975) req@ffff8bfb03ffc380 x1877759533802880/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.046960:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c164 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354bd expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.046984:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ffc380 with x1877759533802880 ext(29064->4222975) 00010000:00010000:2.0:1790771166.046987:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c076 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35469 expref: 85 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.046993:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c16b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.046995:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.047005:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35469 expref: 84 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.047014:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c16b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.047024:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.047027:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:2.0:1790771166.047034:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 7 00010000:00010000:2.0:1790771166.047038:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73800, rc 0) 00002000:00010000:1.0:1790771166.047045:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb03ffc380 00010000:00010000:0.0:1790771166.047046:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c16b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.047062:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14409:x1877759533797248:12345-192.168.204.50@tcp:101:dd.0 Request processed in 29066us (29124us total) trans 4294968643 rc 0/0 00000100:00100000:1.0:1790771166.047067:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:2.0:1790771166.047073:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5777 00000100:00100000:1.0:1790771166.047078:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533802880:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1790771166.047126:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5790 00010000:00010000:0.0:1790771166.047135:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0c164 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354bd expref: 127 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.047136:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14498:x1877759533801344:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:0.0:1790771166.047157:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686200/0xfa0c505d97f0c16b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354bd expref: 126 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.047161:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.047170:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:2.0:1790771166.047171:0:13763:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.047177:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.047183:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686200, rc 0) 00010000:00010000:2.0:1790771166.047187:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.047192:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.047197:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.047202:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.047208:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13637:x1877759533802624:12345-192.168.204.50@tcp:101:dd.0 Request processed in 269us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.047214:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5789 00000100:00100000:2.0:1790771166.047266:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14498:x1877759533801344:12345-192.168.204.50@tcp:36:ln.0 Request processed in 132us (1800us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771166.047272:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5790 00000100:00100000:0.0:1790771166.047309:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2399:x1877759533798272:12345-192.168.204.50@tcp:4:dd.0 Request processed in 19412us (19564us total) trans 4294967601 rc 0/0 00000100:00100000:0.0:1790771166.047318:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 390 00000100:00100000:2.0:1790771166.047328:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:0.0:1790771166.047329:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x19:0x0] (10289152->10485759) req@ffff8bfb0566f800 x1877759533798272/t4294967601(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.047337:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566f800 with x1877759533798272 ext(10289152->10485759) 00002000:00010000:0.0:1790771166.047341:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0566f800 00000100:00100000:0.0:1790771166.047359:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803008 00000100:00100000:0.0:1790771166.047361:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803008 00002000:00100000:0.0:1790771166.047376:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1e:0x0] (28672->32767) req@ffff8bfc3fa6c380 x1877759533803008/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.047382:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa6c380 with x1877759533803008 ext(28672->32767) 00010000:00010000:0.0:1790771166.047387:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 29 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.047396:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 29 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.047402:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3fa6c380 00000100:00100000:0.0:1790771166.047421:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 90 00000100:00100000:0.0:1790771166.047429:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759533803008:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771166.047479:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.047518:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803136 00000100:00100000:0.0:1790771166.047521:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803136 00002000:00100000:0.0:1790771166.047534:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (487424->491519) req@ffff8bfc3fa94380 x1877759533803136/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.047541:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa94380 with x1877759533803136 ext(487424->491519) 00002000:00010000:0.0:1790771166.047544:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa94380 00000100:00100000:0.0:1790771166.047552:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 393 00000100:00100000:0.0:1790771166.047558:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759533803136:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771166.047629:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759533803136:12345-192.168.204.50@tcp:3:cat.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.047634:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 393 00002000:00100000:0.0:1790771166.047639:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (487424->491519) req@ffff8bfc3fa94380 x1877759533803136/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.047646:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa94380 with x1877759533803136 ext(487424->491519) 00002000:00010000:0.0:1790771166.047648:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa94380 00000100:00100000:0.0:1790771166.047696:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.047708:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803264 00000100:00100000:0.0:1790771166.047711:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803264 00002000:00100000:0.0:1790771166.047723:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e:0x0] (4222976->4223367) req@ffff8bfc3fa95500 x1877759533803264/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 880/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.047729:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa95500 with x1877759533803264 ext(4222976->4223367) 00010000:00010000:0.0:1790771166.047733:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 30 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.047741:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 30 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.047751:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3fa95500 00000100:00100000:3.0:1790771166.047755:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.047762:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 91 00000100:00100000:0.0:1790771166.047770:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2396:x1877759533803264:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:3.0:1790771166.047778:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533802752 00000100:00100000:3.0:1790771166.047783:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533802752 00010000:00010000:3.0:1790771166.047855:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 84 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.047945:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1590 00000100:00100000:3.0:1790771166.047954:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:2397:x1877759533802752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.047963:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.047969:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 84 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.047995:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566f480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539731584:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.048010:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048042:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 84 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048058:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0bc2b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35343 expref: 84 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.048072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.048078:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.048083:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048090:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048096:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048103:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 83 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048123:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.048124:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803392 00000100:00100000:2.0:1790771166.048129:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803392 00010000:00010000:2.0:1790771166.048145:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.048150:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04b21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:2397:x1877759533802752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 195us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.048200:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1590 00000100:00100000:2.0:1790771166.048223:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1591 00000100:00100000:2.0:1790771166.048233:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2397:x1877759533803392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.048240:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.048245:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048254:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048267:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0bf96 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35415 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048277:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.048280:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048286:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048291:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048308:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.048332:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2397:x1877759533803392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.048337:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1591 00010000:00010000:2.0:1790771166.048357:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.048363:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048514:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048521:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048541:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048547:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048558:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048606:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048749:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 82 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048758:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048778:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 82 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.048787:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 82 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.048797:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94e300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539732224:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.048840:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c359c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.049473:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049481:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2399:x1877759533797888:12345-192.168.204.50@tcp:4:dd.0 Request processed in 21542us (21713us total) trans 4294967597 rc 0/0 00000004:00010000:2.0:1790771166.049511:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049530:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 391 00002000:00100000:0.0:1790771166.049536:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x19:0x0] (10485760->11206655) req@ffff8bfb0566e300 x1877759533797888/t4294967597(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.049543:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566e300 with x1877759533797888 ext(10485760->11206655) 00010000:00010000:2.0:1790771166.049546:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.049547:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0566e300 00010000:00010000:2.0:1790771166.049556:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771166.049577:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e1c00/0xfa0c505d97f0be4d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0be5b expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049592:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.049594:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969229 is committed 00000001:00080000:2.0:1790771166.049600:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969228 is committed 00010000:00010000:3.0:1790771166.049603:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049610:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049618:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.049621:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049627:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.049635:0:6473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:3.0:1790771166.049638:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.049641:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.049644:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049647:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539732352:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1790771166.049653:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0c006 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049692:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1790771166.049696:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000429f2ab8 reply state 0000000036e4500a transno 4294969229 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.049710:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.049720:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.049721:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.049722:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.049727:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.049732:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.049733:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.049743:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049747:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.049750:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049755:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049769:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.049772:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.049775:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790771166.049776:0:13764:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1790771166.049783:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c014 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.049792:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14492:x1877759533798144:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 28585us (28677us total) trans 4294969229 rc 0/0 00010000:00010000:3.0:1790771166.049795:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049812:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.049813:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5779 00010000:00010000:3.0:1790771166.049821:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049828:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533f000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.049831:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049836:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049840:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732352 00010000:00010000:3.0:1790771166.049843:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000100:00100000:0.0:1790771166.049845:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732352 00010000:00010000:3.0:1790771166.049847:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.049850:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049854:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0bf88 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049868:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049873:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049877:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049882:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc029cbc00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.049884:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00010000:00010000:3.0:1790771166.049887:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049892:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.049894:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+7:3624:x1877759539732352:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1790771166.049906:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc3607e000) 00010000:00010000:0.0:1790771166.049907:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.049909:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.049913:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.049917:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0c08b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.049923:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0be5b lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0be4d expref: 7 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.049923:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967596 is committed 00000001:00080000:2.0:1790771166.049933:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967595 is committed 00010000:00010000:0.0:1790771166.049938:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfb0321af00) 00000001:00080000:2.0:1790771166.049940:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967593 is committed 00010000:00010000:0.0:1790771166.049950:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.049981:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1877759539732352:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.049982:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539732608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790771166.049994:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1790771166.050022:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539732736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790771166.050023:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539732864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790771166.050027:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539732480:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790771166.050067:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.050096:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732736 00000100:00100000:1.0:1790771166.050103:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732736 00000100:00100000:0.0:1790771166.050111:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533803264:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2341us (2413us total) trans 4294967596 rc 0/0 00000100:00100000:0.0:1790771166.050118:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 91 00002000:00100000:0.0:1790771166.050123:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e:0x0] (4222976->4223367) req@ffff8bfc3fa95500 x1877759533803264/t4294967596(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 880/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.050133:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:0.0:1790771166.050137:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa95500 with x1877759533803264 ext(4222976->4223367) 00010000:00010000:0.0:1790771166.050144:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050154:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.050159:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3fa95500 00000100:00080000:2.0:1790771166.050173:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790771166.050196:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050203:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050208:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050211:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.050213:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050218:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050225:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.050227:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.050229:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.050234:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c099 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.050269:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732608 00000100:00100000:1.0:1790771166.050274:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732608 00000100:00100000:2.0:1790771166.050284:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1790771166.050293:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539733120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790771166.050295:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3627:x1877759539732736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790771166.050305:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1790771166.050315:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3626:x1877759539732608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790771166.050330:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.050366:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539733120 00000100:00100000:3.0:1790771166.050370:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539733120 00000100:00100000:3.0:1790771166.050399:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:3.0:1790771166.050406:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3626:x1877759539733120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1790771166.050462:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.050482:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539732992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790771166.050531:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.050566:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732480 00000100:00100000:2.0:1790771166.050571:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732480 00000100:00100000:3.0:1790771166.050590:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732992 00000100:00100000:1.0:1790771166.050595:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.050596:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732992 00000100:00100000:2.0:1790771166.050604:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:2.0:1790771166.050614:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539732480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1790771166.050618:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803520 00000100:00100000:1.0:1790771166.050623:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803520 00000100:00100000:3.0:1790771166.050628:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1790771166.050639:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539732992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790771166.050653:0:13788:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:24 count 1 00000100:00100000:1.0:1790771166.050655:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5791 00000100:00100000:2.0:1790771166.050662:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.050683:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14777:x1877759533803520:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771166.050685:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.050697:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.050700:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.050708:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x18:0x0].0x0 since=3s v=(1 0) 00010000:00010000:1.0:1790771166.050710:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.050712:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(1 1) 00000100:00100000:2.0:1790771166.050717:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539732352:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1790771166.050720:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.050744:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 84 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.050746:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539732864 00000100:00100000:2.0:1790771166.050752:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539732864 00010000:00010000:3.0:1790771166.050753:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.050764:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 84 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.050779:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 26 pid: 13782 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.050781:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:2.0:1790771166.050786:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00010000:00010000:1.0:1790771166.050788:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.050797:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 84 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.050798:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3624:x1877759539732864:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790771166.050804:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539733248:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.050815:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104400, rc 0) 00002000:00080000:2.0:1790771166.050819:0:13782:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:13 count 1 00010000:00010000:2.0:1790771166.050833:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.050846:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 23 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.050853:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.050858:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14777:x1877759533803520:12345-192.168.204.50@tcp:101:chown.0 Request processed in 188us (262us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.050867:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xd:0x0].0x0 since=1s v=(1 2) 00010000:00010000:2.0:1790771166.050872:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(2 2) 00000100:00100000:1.0:1790771166.050873:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5791 00010000:00010000:2.0:1790771166.050877:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.050896:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 23 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.050905:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 23 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.050916:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539733376:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.050924:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.050949:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff540 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.051000:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533803648 00000100:00100000:0.0:1790771166.051005:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533803648 00002000:00010000:3.0:1790771166.051024:0:13793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 29064 -> 4223368 00002000:00010000:3.0:1790771166.051028:0:13793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771166 00002000:00010000:3.0:1790771166.051031:0:13793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1752421453 -> 1790771165 00002000:00010000:3.0:1790771166.051034:0:13793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00000100:00100000:0.0:1790771166.051037:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 953 00002000:00010000:3.0:1790771166.051039:0:13793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 16 -> 24 00000100:00100000:0.0:1790771166.051049:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533803648:12345-192.168.204.50@tcp:2:chmod.0 00002000:00010000:1.0:1790771166.051056:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size from disk: 38336 -> 0 00002000:00010000:1.0:1790771166.051060:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00002000:00010000:1.0:1790771166.051062:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime from disk: 1790771165 -> 1752421453 00002000:00010000:1.0:1790771166.051064:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771166.051066:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 1 -> 0 00000100:00100000:3.0:1790771166.051118:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3626:x1877759539733120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 710us (785us total) trans 4294967598 rc 0/0 00002000:00010000:0.0:1790771166.051126:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4223368 -> 4223368 00000100:00100000:3.0:1790771166.051126:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00002000:00010000:0.0:1790771166.051132:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.051135:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771166.051137:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.051139:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1790771166.051148:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3626:x1877759539732608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 832us (1019us total) trans 4294967599 rc 0/0 00000100:00100000:1.0:1790771166.051158:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1790771166.051170:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533803648:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 120us (244us total) trans 4294967600 rc 0/0 00000100:00100000:3.0:1790771166.051170:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967541 gen 2 00000004:00080000:3.0:1790771166.051179:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb064bdc00, transno 4294967534 00000100:00100000:0.0:1790771166.051181:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 953 00000004:00080000:3.0:1790771166.051195:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb064bce00, transno 4294967535 00000004:00080000:3.0:1790771166.051203:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb064bc700, transno 4294967536 00000004:00080000:3.0:1790771166.051208:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3f919180, transno 4294967537 00000004:00080000:3.0:1790771166.051214:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb057b3b80, transno 4294967538 00000004:00080000:3.0:1790771166.051220:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb029c0000, transno 4294967539 00000004:00080000:3.0:1790771166.051225:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb057b2300, transno 4294967541 00000100:00100000:0.0:1790771166.051229:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.051235:0:3626:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfc3fa94000 x1877759539732608/t4294967599(4294967599) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790771166.051243:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa94000/2, rc 0, transno 4294967599 00000100:00100000:3.0:1790771166.051249:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539732608:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1790771166.051266:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb057b5180/2, rc 0, transno 4294967598 00000100:00100000:3.0:1790771166.051271:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539733120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790771166.051285:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533804032 00000100:00100000:0.0:1790771166.051289:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533804032 00000100:00100000:0.0:1790771166.051328:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 772 00000100:00100000:0.0:1790771166.051337:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:2397:x1877759533804032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.051344:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790771166.051351:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb size from disk: 19586 -> 19586 00002000:00010000:1.0:1790771166.051355:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb mtime from disk: 1790771161 -> 1790771161 00010000:00010000:0.0:1790771166.051356:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c0ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35477 expref: 84 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.051359:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb atime from disk: 1790771163 -> 0 00002000:00010000:1.0:1790771166.051364:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb ctime from disk: 1790771164 -> 1790771164 00002000:00010000:1.0:1790771166.051369:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:0.0:1790771166.051375:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:0.0:1790771166.051379:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.051411:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3625:x1877759539732480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 796us (943us total) trans 4294967601 rc 0/0 00000100:00100000:0.0:1790771166.051412:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:2397:x1877759533804032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (182us total) trans 0 rc 0/0 00000004:00080000:3.0:1790771166.051420:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa95880/2, rc 0, transno 4294967601 00000100:00100000:1.0:1790771166.051425:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1790771166.051426:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 772 00000004:00080000:2.0:1790771166.051428:0:9561:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 6 in progress, 3 in flight, 7 done 00000100:00100000:3.0:1790771166.051429:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539732480:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790771166.051515:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 21450 -> 21450 00002000:00010000:1.0:1790771166.051519:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790771163 -> 1790771163 00002000:00010000:1.0:1790771166.051521:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:1.0:1790771166.051523:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771166.051526:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 56 -> 56 00000100:00100000:2.0:1790771166.051563:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539731712:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.051571:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3627:x1877759539732736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1275us (1500us total) trans 4294967602 rc 0/0 00000100:00100000:0.0:1790771166.051575:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.051580:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.051581:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000004:00080000:3.0:1790771166.051592:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa97800/2, rc 0, transno 4294967602 00000100:00100000:3.0:1790771166.051598:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539732736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790771166.051610:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.051611:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533804288 00000100:00100000:1.0:1790771166.051615:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533804288 00000100:00100000:2.0:1790771166.051638:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533804416 00000100:00100000:0.0:1790771166.051642:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.051644:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533804416 00000100:00100000:1.0:1790771166.051649:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1475 00000100:00100000:1.0:1790771166.051660:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:13733:x1877759533804288:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.051660:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533804672 00000100:00100000:3.0:1790771166.051680:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533804672 00000100:00100000:0.0:1790771166.051688:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.051709:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5792 00000100:00100000:0.0:1790771166.051712:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533804928 00000100:00100000:0.0:1790771166.051717:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533804928 00000100:00100000:3.0:1790771166.051719:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1476 00000100:00100000:2.0:1790771166.051725:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:13742:x1877759533804416:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.051733:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:11056:x1877759533804672:12345-192.168.204.50@tcp:35:dir_create.sh.0 00010000:00010000:2.0:1790771166.051735:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.051749:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c195 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354d2 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.051751:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1477 00000100:00100000:0.0:1790771166.051763:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:11967:x1877759533804928:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.051775:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13733:x1877759533804288:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (206us total) trans 4294968644 rc 0/0 00000100:00100000:1.0:1790771166.051781:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1475 00010000:00010000:2.0:1790771166.051788:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/1,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.051797:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.051804:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.051824:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.051828:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1790771166.051837:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.051850:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c195 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 96 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.051860:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:11967:x1877759533804928:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (172us total) trans 4294968645 rc 0/0 00010000:00010000:2.0:1790771166.051865:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 95 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.051872:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1477 00010000:00010000:2.0:1790771166.051879:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224700) 00010000:00010000:2.0:1790771166.051882:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.051885:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597e00, rc 0) 00000100:00100000:3.0:1790771166.051896:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:11056:x1877759533804672:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 166us (255us total) trans 4294969230 rc 0/0 00000100:00100000:2.0:1790771166.051901:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805056 00000100:00100000:3.0:1790771166.051906:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1476 00000100:00100000:1.0:1790771166.051907:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.051907:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805056 00010000:00010000:2.0:1790771166.051929:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 109 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.051951:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805184 00000100:00100000:1.0:1790771166.051956:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805184 00000100:00100000:2.0:1790771166.051960:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1592 00000100:00100000:2.0:1790771166.051971:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2399:x1877759533805056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.051980:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.051985:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 109 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.051994:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5793 00010000:00010000:2.0:1790771166.051997:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 109 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.052011:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14584:x1877759533805184:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771166.052012:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c0ed lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3548c expref: 109 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.052016:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.052027:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.052028:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771166.052033:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052038:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354d9 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052040:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052059:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052077:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.052084:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.052085:0:13771:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000ef08a3b1 x1877759539731840) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052106:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2399:x1877759533805056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 137us (270us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.052107:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.052109:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0bee7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353eb expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052125:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1592 00010000:00010000:1.0:1790771166.052136:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052143:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d61880 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539731840:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.052160:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052168:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d60380 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539731968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.052170:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052176:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052196:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13742:x1877759533804416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 475us (586us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.052198:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052199:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052212:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5792 00010000:00010000:1.0:1790771166.052232:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.052237:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.052239:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052242:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.052246:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052255:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052264:0:13765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052273:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.052273:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052277:0:13765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052279:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.052296:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052299:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.052305:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-mdtlov_UUID:13765:1877759539733504:0@lo:101:mdt00_010.0 00010000:00010000:1.0:1790771166.052319:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771166.052321:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805312 00010000:00010000:1.0:1790771166.052322:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.052327:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052333:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c1aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.052340:0:13765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.052343:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052349:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052354:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052359:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104c00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.052360:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b780 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.052361:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052369:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052378:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc0ab7e800) 00010000:00010000:1.0:1790771166.052380:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.052380:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539733504 00010000:00010000:1.0:1790771166.052385:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052386:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539733504 00010000:00010000:1.0:1790771166.052392:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c1b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052402:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805312 00010000:00010000:1.0:1790771166.052418:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1a3 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d9 expref: 106 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052425:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:1.0:1790771166.052429:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.052432:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.052435:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13765:x1877759539733504:12345-0@lo:101:mdt00_010.0 00010000:00010000:1.0:1790771166.052437:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d9 expref: 106 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052448:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1478 00010000:00010000:2.0:1790771166.052450:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.052451:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104000, rc 0) 00010000:00010000:2.0:1790771166.052463:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0c1b8 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052464:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14432:x1877759533805312:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:0.0:1790771166.052480:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.052509:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14584:x1877759533805184:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 481us (580us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.052516:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 94 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.052521:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805696 00000100:00100000:1.0:1790771166.052525:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5793 00000100:00100000:0.0:1790771166.052526:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805696 00010000:00010000:2.0:1790771166.052532:0:6499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 4/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052546:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 25 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052552:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 94 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052566:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 94 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052576:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6499:1877759539733632:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.052582:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1593 00000100:00100000:0.0:1790771166.052597:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533805696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.052599:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.052613:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.052625:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 25 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052625:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.052637:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14432:x1877759533805312:12345-192.168.204.50@tcp:35:rm.0 Request processed in 177us (627us total) trans 4294969231 rc 0/0 00010000:00010000:0.0:1790771166.052639:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 25 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.052646:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.052649:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805568 00000100:00100000:2.0:1790771166.052657:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805568 00000100:00100000:3.0:1790771166.052657:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1478 00010000:00010000:0.0:1790771166.052692:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771166.052694:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 109 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.052695:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533805952 00010000:00010000:0.0:1790771166.052697:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(1 1) 00000100:00100000:3.0:1790771166.052701:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533805952 00010000:00010000:0.0:1790771166.052710:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052719:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052736:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1594 00000100:00100000:3.0:1790771166.052740:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1479 00010000:00010000:0.0:1790771166.052744:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052750:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2397:x1877759533805568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.052757:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14068:x1877759533805952:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.052765:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1877759539733760:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.052766:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.052774:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 109 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052782:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000993fc00a/0xfa0c505d97f03f6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->20479) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e327bb expref: 25 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052786:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 109 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.052799:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.052804:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539732096:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.052809:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0b413 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35121 expref: 109 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052823:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.052825:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 27 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052828:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052844:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.052845:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fe00, rc 0) 00010000:00010000:2.0:1790771166.052851:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.052874:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.052885:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.052887:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:14783:x1877759533801600:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 6827us (7080us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.052900:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.052901:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2397:x1877759533805568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.052907:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 946 00000100:00100000:2.0:1790771166.052921:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1594 00010000:00010000:0.0:1790771166.052970:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052976:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052982:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052989:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.052991:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.052996:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.053004:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.053006:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.053009:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.053013:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c110 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.053070:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:14068:x1877759533805952:12345-192.168.204.50@tcp:35:ls.0 Request processed in 318us (426us total) trans 4294968646 rc 0/0 00000100:00100000:0.0:1790771166.053071:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14781:x1877759533799808:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 23965us (24354us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.053085:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.053093:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5784 00000100:00100000:3.0:1790771166.053093:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1479 00000100:00100000:1.0:1790771166.053107:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533806336 00000100:00100000:1.0:1790771166.053113:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533806336 00000100:00100000:1.0:1790771166.053152:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5794 00000100:00100000:1.0:1790771166.053161:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14633:x1877759533806336:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771166.053179:0:13774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790771166.053189:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0b6ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35201 expref: 108 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053203:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f05ddc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3319a expref: 107 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053214:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.053217:0:13774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.053237:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053244:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053248:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771166.053387:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 88 off10984 00000004:00010000:1.0:1790771166.053411:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e457cdf0 reply state 00000000e6c060d6 transno 4294969232 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053419:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.053424:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.053426:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.053428:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.053467:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14633:x1877759533806336:12345-192.168.204.50@tcp:36:chown.0 Request processed in 308us (390us total) trans 4294969232 rc 0/0 00000100:00100000:1.0:1790771166.053472:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5794 00000100:00100000:0.0:1790771166.055392:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.055427:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533806464 00000100:00100000:2.0:1790771166.055432:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533806464 00000100:00100000:2.0:1790771166.055457:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5795 00000100:00100000:2.0:1790771166.055462:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:13886:x1877759533806464:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.055470:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.055476:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c1cd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354e0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055546:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055553:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055559:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055568:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055573:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055578:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.055621:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.055652:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055659:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055665:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055684:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055696:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.055699:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055706:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055716:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.055718:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.055720:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055725:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c1d4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055732:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055736:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055740:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055744:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.055745:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055749:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055756:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc34224100) 00010000:00010000:2.0:1790771166.055758:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.055760:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055764:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c1db lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055782:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c1cd lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354e0 expref: 87 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055787:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.055789:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.055791:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c1cd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354e0 expref: 87 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.055796:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596c00, rc 0) 00000100:00100000:2.0:1790771166.055821:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:13886:x1877759533806464:12345-192.168.204.50@tcp:101:ls.0 Request processed in 360us (431us total) trans 4294968647 rc 301/301 00000100:00100000:2.0:1790771166.055826:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5795 00000100:00100000:3.0:1790771166.059083:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.059151:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808256 00000100:00100000:2.0:1790771166.059157:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808256 00000100:00100000:2.0:1790771166.059187:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5796 00000100:00100000:2.0:1790771166.059193:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14763:x1877759533808256:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771166.059202:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.059210:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c1e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35470 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.059290:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c1f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.059302:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.059309:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.059316:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 38336 00010000:00010000:2.0:1790771166.059363:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c1e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35470 expref: 111 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.059373:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35470 expref: 110 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.059378:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:2.0:1790771166.059380:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.059382:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596400, rc 0) 00000100:00100000:2.0:1790771166.059411:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14763:x1877759533808256:12345-192.168.204.50@tcp:101:cp.0 Request processed in 218us (332us total) trans 4294969233 rc 0/0 00000100:00100000:2.0:1790771166.059416:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5796 00000100:00100000:0.0:1790771166.064284:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.064308:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.064329:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533806080 00000100:00100000:2.0:1790771166.064336:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533806080 00000100:00100000:0.0:1790771166.064341:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.064351:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533806720 00010000:00010000:2.0:1790771166.064360:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 110 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.064360:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533806720 00000100:00100000:0.0:1790771166.064384:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.064396:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533806976 00000100:00100000:2.0:1790771166.064399:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1595 00000100:00100000:3.0:1790771166.064402:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533807232 00000100:00100000:1.0:1790771166.064403:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533806976 00000100:00100000:3.0:1790771166.064408:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533807232 00000100:00100000:2.0:1790771166.064413:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759533806080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.064424:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.064427:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.064432:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 111 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064446:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 111 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.064449:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533807488 00000100:00100000:3.0:1790771166.064451:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1480 00000100:00100000:1.0:1790771166.064455:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533807488 00000100:00100000:0.0:1790771166.064466:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.064466:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13735:x1877759533806720:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.064474:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3e00/0xfa0c505d97efa868 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f1c1 expref: 111 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.064506:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5797 00010000:00010000:2.0:1790771166.064507:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00000100:00100000:0.0:1790771166.064511:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533807616 00010000:00010000:2.0:1790771166.064513:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.064517:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533807616 00000100:00100000:1.0:1790771166.064518:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14409:x1877759533806976:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:2.0:1790771166.064530:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064536:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.064551:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1481 00010000:00010000:1.0:1790771166.064553:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.064557:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.064563:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13208:x1877759533807232:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771166.064570:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c07d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x7:0x0].0x0 bits 0x7/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35469 expref: 87 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.064583:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:1.0:1790771166.064589:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.064589:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759533806080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 178us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.064596:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1595 00000100:00100000:3.0:1790771166.064612:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13735:x1877759533806720:12345-192.168.204.50@tcp:35:ls.0 Request processed in 149us (300us total) trans 4294968648 rc 0/0 00000100:00100000:3.0:1790771166.064619:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1480 00000100:00100000:2.0:1790771166.064625:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5798 00000100:00100000:2.0:1790771166.064636:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:14563:x1877759533807488:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771166.064641:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1482 00000100:00100000:3.0:1790771166.064651:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14369:x1877759533807616:12345-192.168.204.50@tcp:49:setfattr.0 00010000:00010000:1.0:1790771166.064705:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: --/PW res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.064712:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14369:x1877759533807616:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 62us (250us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771166.064718:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.064722:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1482 00010000:00010000:1.0:1790771166.064732:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.064742:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14563:x1877759533807488:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 108us (316us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771166.064749:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5798 00000100:00100000:3.0:1790771166.064771:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:1.0:1790771166.064775:0:13761:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968649 00000004:00010000:1.0:1790771166.064795:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000498ad480 reply state 000000002e57cdc7 transno 4294968650 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.064804:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.064808:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533807744 00010000:00010000:1.0:1790771166.064810:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00000100:00100000:2.0:1790771166.064813:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533807744 00010000:00010000:1.0:1790771166.064814:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.064818:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.064847:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5799 00000100:00100000:2.0:1790771166.064856:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13837:x1877759533807744:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:1.0:1790771166.064881:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:14409:x1877759533806976:12345-192.168.204.50@tcp:36:dd.0 Request processed in 355us (531us total) trans 4294968650 rc 0/0 00000100:00100000:3.0:1790771166.064887:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.064889:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.064898:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5797 00010000:00010000:2.0:1790771166.064903:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.064904:0:13761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.064914:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064928:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.064931:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064934:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.064945:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064948:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064965:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.064971:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.064975:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94e300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539732224:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.064978:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.064997:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065050:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.065110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771166.065139:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef08a3b1 reply state 00000000ea4415c1 transno 4294969234 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.065144:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.065150:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065157:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:1.0:1790771166.065159:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065160:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771166.065164:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.065169:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065170:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065176:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808384 00000100:00100000:3.0:1790771166.065182:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.065185:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808384 00010000:00010000:1.0:1790771166.065191:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065193:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065204:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.065206:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065209:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065209:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808640 00010000:00010000:2.0:1790771166.065214:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065217:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808640 00010000:00010000:1.0:1790771166.065220:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065226:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5800 00010000:00010000:2.0:1790771166.065236:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.065240:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:2.0:1790771166.065242:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065243:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:12241:x1877759533808384:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.065244:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771166.065250:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065259:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.065265:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0bc4e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065267:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065271:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354ee expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065283:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065290:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.065297:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.065299:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065301:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065306:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 114 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065318:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065322:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1483 00010000:00010000:2.0:1790771166.065323:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c205 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065339:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfc000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.065341:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13263:x1877759533808640:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.065344:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 114 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065346:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.065347:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef08a3b1 reply state 00000000ea4415c1 transno 4294969234 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065367:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065371:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065372:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.065376:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.065380:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.065384:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.065386:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f600, rc 0) 00010000:00010000:1.0:1790771166.065389:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065390:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc34224f00) 00010000:00010000:2.0:1790771166.065396:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.065400:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1790771166.065403:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065409:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065418:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:12241:x1877759533808384:12345-192.168.204.50@tcp:101:ls.0 Request processed in 178us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.065424:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5800 00010000:00010000:1.0:1790771166.065430:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065439:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0ba1e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.065439:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13837:x1877759533807744:12345-192.168.204.50@tcp:36:ln.0 Request processed in 582us (665us total) trans 4294969234 rc 0/0 00000100:00100000:2.0:1790771166.065453:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5799 00000004:00010000:1.0:1790771166.065458:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dc254de8 reply state 000000007262c953 transno 4294969235 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.065472:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065478:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc0ab7e500) 00010000:00010000:1.0:1790771166.065480:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.065481:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808000 00000100:00100000:1.0:1790771166.065482:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.065511:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808000 00002000:00100000:2.0:1790771166.065537:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (491520->495615) req@ffff8bfb06541500 x1877759533808000/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.065538:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:2.0:1790771166.065551:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06541500 with x1877759533808000 ext(491520->495615) 00000100:00100000:3.0:1790771166.065552:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13263:x1877759533808640:12345-192.168.204.50@tcp:35:ls.0 Request processed in 212us (374us total) trans 4294969236 rc 0/0 00002000:00010000:2.0:1790771166.065557:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06541500 00000100:00100000:0.0:1790771166.065561:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808768 00000100:00100000:1.0:1790771166.065562:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13975:x1877759533761408:12345-192.168.204.50@tcp:36:rm.0 Request processed in 158575us (158667us total) trans 4294969235 rc 0/0 00000100:00100000:0.0:1790771166.065568:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808768 00000100:00100000:3.0:1790771166.065573:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1483 00000100:00100000:1.0:1790771166.065574:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5683 00000100:00100000:2.0:1790771166.065580:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 394 00000100:00100000:2.0:1790771166.065591:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533808000:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771166.065600:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808896 00000100:00100000:1.0:1790771166.065604:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808896 00000100:00100000:0.0:1790771166.065608:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5801 00000100:00100000:0.0:1790771166.065617:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14625:x1877759533808768:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:1.0:1790771166.065635:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5802 00010000:00010000:0.0:1790771166.065639:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:1.0:1790771166.065645:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14015:x1877759533808896:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:0.0:1790771166.065654:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f08dcb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34305 expref: 115 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065692:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f06919 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3364e expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065692:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04878e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539733248:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.065716:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00000100:00100000:1.0:1790771166.065718:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14015:x1877759533808896:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 74us (180us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.065720:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.065728:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533808000:12345-192.168.204.50@tcp:3:cat.0 Request processed in 138us (844us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.065728:0:13788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.065729:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5802 00010000:00010000:0.0:1790771166.065734:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.065749:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 394 00010000:00010000:1.0:1790771166.065751:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065760:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 106 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.065762:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (491520->495615) req@ffff8bfb06541500 x1877759533808000/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.065763:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065781:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065793:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.065797:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00002000:00100000:2.0:1790771166.065801:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06541500 with x1877759533808000 ext(491520->495615) 00000004:00200000:1.0:1790771166.065802:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00010000:2.0:1790771166.065809:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06541500 00000004:00010000:1.0:1790771166.065815:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065824:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 107 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.065835:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 107 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.065835:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533808128 00010000:00010000:1.0:1790771166.065840:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0c141 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 107 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.065841:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533808128 00000100:00100000:0.0:1790771166.065852:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539733888:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.065859:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 88 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.065868:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 106 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.065872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.065883:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.065886:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1790771166.065886:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809024 00000100:00100000:2.0:1790771166.065891:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809024 00010000:00010000:1.0:1790771166.065893:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00000100:00100000:0.0:1790771166.065901:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8bcc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.065907:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 27 pid: 13782 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.065923:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809152 00000100:00100000:1.0:1790771166.065923:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14796:x1877759533801472:12345-192.168.204.50@tcp:101:ls.0 Request processed in 19957us (20405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.065930:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809152 00000100:00100000:1.0:1790771166.065936:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5787 00000100:00100000:2.0:1790771166.065937:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1596 00000100:00100000:3.0:1790771166.065942:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539733376:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.065951:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 25 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.065952:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:2396:x1877759533808128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.065962:0:13782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.065966:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.065975:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1597 00010000:00010000:2.0:1790771166.065975:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 88 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.065990:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533809024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.065994:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 88 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.066001:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1598 00010000:00010000:1.0:1790771166.066002:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.066012:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 27 pid: 13782 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066015:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0a5b1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b2b expref: 88 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.066019:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533809152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.066036:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.066043:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 27 pid: 13782 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066044:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 25 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066045:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6a:0x0].0x0 (ffff8bfc2900ad00) 00010000:00010000:2.0:1790771166.066054:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066074:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066078:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 25 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066079:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfdaef55/0xfa0c505d97f02208 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31d26 expref: 27 pid: 13782 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066091:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066116:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008dce35f8/0xfa0c505d97f0a01d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34972 expref: 25 pid: 8406 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066118:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771166.066122:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.066129:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(1 1) 00010000:00010000:1.0:1790771166.066137:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066146:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:2396:x1877759533808128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (1095us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.066153:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066154:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1596 00010000:00010000:0.0:1790771166.066160:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(2 2) 00010000:00010000:0.0:1790771166.066169:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(2 2) 00010000:00010000:0.0:1790771166.066176:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066178:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066184:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.066195:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066199:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.066215:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533809024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 229us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.066222:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1597 00010000:00010000:3.0:1790771166.066224:0:13788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066229:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.066240:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.066253:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.066258:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533809152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 243us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.066268:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1598 00010000:00010000:1.0:1790771166.066286:0:13782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066294:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066300:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066305:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.066316:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6a:0x0]: returning size 2 00010000:00010000:1.0:1790771166.066324:0:13782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790771166.066326:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066328:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066344:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066348:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.066351:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066358:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066358:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.066363:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066381:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.066384:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066386:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066396:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6a:0x0].0x0 (ffff8bfc2900ad00) 00010000:00010000:0.0:1790771166.066398:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066399:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771166.066404:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066411:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c179 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066415:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.066419:0:13788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771166.066421:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3624:x1877759539732864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15622us (15763us total) trans 4294967603 rc 0/0 00010000:00010000:2.0:1790771166.066427:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066436:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009d1a01a/0xfa0c505d97f0c18e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.066438:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00010000:00010000:2.0:1790771166.066438:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066457:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066463:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.066466:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066471:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066472:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:1.0:1790771166.066474:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa96a00/2, rc 0, transno 4294967603 00010000:00010000:0.0:1790771166.066479:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.066507:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539732864:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790771166.066510:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00030200 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:0.0:1790771166.066516:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066523:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.066530:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.066532:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.066532:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.066536:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 86 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066555:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066561:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 86 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066567:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060ff24b2/0xfa0c505d97f0c180 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066574:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 86 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066584:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 86 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066589:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.066591:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 86 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.066593:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.066598:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.066601:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 86 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066608:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 86 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066614:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 86 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.066620:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3625:x1877759539732992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15983us (16087us total) trans 4294967604 rc 0/0 00010000:00010000:2.0:1790771166.066625:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 86 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.066643:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00010000:00010000:2.0:1790771166.066644:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 86 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.066650:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa96d80/2, rc 0, transno 4294967604 00000100:00100000:3.0:1790771166.066661:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539732992:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1790771166.066683:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 86 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066695:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 86 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066706:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 86 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066715:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 86 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066721:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 86 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.066737:0:13770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 86 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066744:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734016:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.066788:0:13770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 86 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066796:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04b21880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734144:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.066822:0:13770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 86 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066839:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734272:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.066879:0:13770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 86 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066889:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb56300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734400:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.066914:0:13770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 86 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.066922:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734528:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.066941:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.080284:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.080307:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.080327:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.080340:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809408 00000100:00100000:0.0:1790771166.080350:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809408 00000100:00100000:3.0:1790771166.080368:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809664 00000100:00100000:3.0:1790771166.080375:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809664 00000100:00100000:1.0:1790771166.080380:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.080393:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809792 00000100:00100000:0.0:1790771166.080398:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809792 00000100:00100000:1.0:1790771166.080409:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.080420:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810304 00000100:00100000:3.0:1790771166.080425:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810304 00000100:00100000:0.0:1790771166.080429:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810176 00000100:00100000:2.0:1790771166.080430:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6499:1877759539733632:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.080435:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810176 00000100:00100000:1.0:1790771166.080441:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.080460:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.080462:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1484 00000100:00100000:1.0:1790771166.080468:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810432 00000100:00100000:1.0:1790771166.080475:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810432 00010000:00010000:2.0:1790771166.080476:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224700) 00000100:00100000:0.0:1790771166.080479:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5803 00000100:00100000:3.0:1790771166.080480:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:12014:x1877759533809664:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.080482:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.080516:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.080525:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.080532:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14006:x1877759533809408:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.080536:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5804 00010000:00010000:2.0:1790771166.080536:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596a00, rc 0) 00000100:00100000:1.0:1790771166.080550:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14002:x1877759533809792:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.080551:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.080561:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.080572:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354f5 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.080574:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354fc expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.080586:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13765:x1877759539733504:12345-0@lo:101:mdt00_010.0 Request processed in 28152us (28245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.080599:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00010000:00010000:0.0:1790771166.080618:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 118 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.080638:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 118 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.080639:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:12014:x1877759533809664:12345-192.168.204.50@tcp:35:ls.0 Request processed in 165us (328us total) trans 4294968652 rc 0/0 00000100:00100000:3.0:1790771166.080657:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1484 00010000:00010000:0.0:1790771166.080661:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 118 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.080662:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 118 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.080695:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1485 00010000:00010000:0.0:1790771166.080699:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.080703:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.080707:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00000100:00100000:3.0:1790771166.080707:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14004:x1877759533810304:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.080708:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.080714:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.080718:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104c00, rc 0) 00000100:00100000:0.0:1790771166.080739:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14006:x1877759533809408:12345-192.168.204.50@tcp:101:ls.0 Request processed in 217us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.080745:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5803 00000100:00100000:1.0:1790771166.080752:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14002:x1877759533809792:12345-192.168.204.50@tcp:101:ls.0 Request processed in 205us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.080759:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5804 00000100:00100000:0.0:1790771166.080772:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5805 00000100:00100000:2.0:1790771166.080781:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5806 00000100:00100000:0.0:1790771166.080784:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14609:x1877759533810176:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:2.0:1790771166.080796:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14203:x1877759533810432:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:3.0:1790771166.080796:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14004:x1877759533810304:12345-192.168.204.50@tcp:35:ls.0 Request processed in 89us (384us total) trans 4294969237 rc 0/0 00000100:00100000:3.0:1790771166.080810:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1485 00000100:00100000:1.0:1790771166.080820:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.080831:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.080851:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0b5b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35175 expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.080868:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771166.080873:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.080888:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14609:x1877759533810176:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 108us (507us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771166.080891:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.080891:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.080904:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5805 00010000:00010000:2.0:1790771166.080906:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.080915:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.080943:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810560 00000100:00100000:0.0:1790771166.080946:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1877759539733760:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.080948:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810560 00010000:00010000:0.0:1790771166.080965:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.080969:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 97 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.080997:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533805696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 28406us (28518us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.081006:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1593 00000100:00100000:1.0:1790771166.081009:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771166.081013:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000573da22b reply state 00000000c9ae76a8 transno 4294969238 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081024:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.081030:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1599 00010000:00010000:2.0:1790771166.081031:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000100:00100000:1.0:1790771166.081032:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810816 00010000:00010000:2.0:1790771166.081037:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.081038:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810816 00000100:00100000:2.0:1790771166.081040:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.081045:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533810560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.081055:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.081061:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 97 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081064:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810688 00000100:00100000:3.0:1790771166.081070:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810688 00010000:00010000:0.0:1790771166.081077:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 97 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.081078:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 954 00000100:00100000:2.0:1790771166.081081:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14203:x1877759533810432:12345-192.168.204.50@tcp:36:cp.0 Request processed in 287us (639us total) trans 4294969238 rc 0/0 00002000:00010000:3.0:1790771166.081087:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/15 (1621->18446744073709551615) 00000100:00100000:1.0:1790771166.081094:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2396:x1877759533810816:12345-192.168.204.50@tcp:2:chown.0 00002000:00100000:3.0:1790771166.081097:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f91bb80 with x1877759533810688 ext(1621->18446744073709551615) 00002000:00010000:3.0:1790771166.081108:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f91bb80. 00010000:00010000:0.0:1790771166.081109:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c19c lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354d2 expref: 97 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.081114:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5806 00010000:00010000:0.0:1790771166.081129:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224700) 00000100:00100000:3.0:1790771166.081134:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 395 00010000:00010000:0.0:1790771166.081137:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081145:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533810688:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:0.0:1790771166.081149:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.081166:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.081169:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.081183:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533810944 00000100:00100000:2.0:1790771166.081188:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533810944 00010000:00010000:0.0:1790771166.081201:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.081215:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 25161 -> 25161 00000100:00100000:2.0:1790771166.081219:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5807 00000100:00100000:0.0:1790771166.081221:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6480:1877759539734656:0@lo:105: 00002000:00010000:1.0:1790771166.081221:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771166.081228:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00000100:00100000:2.0:1790771166.081231:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14763:x1877759533810944:12345-192.168.204.50@tcp:101:cp.0 00002000:00010000:1.0:1790771166.081233:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:1.0:1790771166.081240:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 48 -> 48 00010000:00010000:2.0:1790771166.081246:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.081257:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c23d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3550a expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.081269:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.081269:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2396:x1877759533810816:12345-192.168.204.50@tcp:2:chown.0 Request processed in 178us (262us total) trans 4294967602 rc 0/0 00010000:00010000:2.0:1790771166.081276:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.081282:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 954 00010000:00010000:2.0:1790771166.081292:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081300:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.081317:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.081326:0:10372:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539734656 00000100:00100000:2.0:1790771166.081330:0:10372:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539734656 00000100:00100000:1.0:1790771166.081345:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.081368:0:10372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790771166.081373:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000-mdtlov_UUID:13765:1877759539733504:0@lo:101:mdt00_010.0 00002000:00010000:3.0:1790771166.081374:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb size from disk: 19586 -> 1621 00000100:00100000:2.0:1790771166.081380:0:10372:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-mdtlov_UUID+4:6480:x1877759539734656:12345-0@lo:105: 00002000:00010000:3.0:1790771166.081382:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb mtime from disk: 1790771161 -> 1790771166 00002000:00010000:3.0:1790771166.081390:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1790771166.081392:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 4/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.081394:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:3.0:1790771166.081395:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb ctime from disk: 1790771164 -> 1790771166 00002000:00010000:3.0:1790771166.081402:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb blocks from disk: 8 -> 0 00010000:00010000:0.0:1790771166.081414:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081416:0:10372:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081430:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2398:x1877759533810688:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 285us (539us total) trans 4294967605 rc 0/0 00010000:00010000:2.0:1790771166.081433:0:10372:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081443:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 395 00002000:00010000:3.0:1790771166.081449:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/15 (1621->18446744073709551615) 00000100:00100000:1.0:1790771166.081456:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1790771166.081456:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f91bb80 with x1877759533810688 ext(1621->18446744073709551615) 00010000:00010000:2.0:1790771166.081458:0:10372:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.081463:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f91bb80. 00010000:00010000:2.0:1790771166.081467:0:10372:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 5/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081473:0:10372:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081480:0:10372:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081520:0:10372:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb05687c00) 00000100:00100000:1.0:1790771166.081523:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.081561:0:10372:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0000-mdtlov_UUID+4:6480:x1877759539734656:12345-0@lo:105: Request processed in 186us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.081568:0:10372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790771166.081580:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533811328 00000100:00100000:1.0:1790771166.081585:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.081586:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533811328 00000100:00100000:2.0:1790771166.081615:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812096 00000100:00100000:2.0:1790771166.081619:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812096 00000100:00100000:1.0:1790771166.081623:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.081645:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533811968 00000100:00100000:1.0:1790771166.081649:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533811968 00000100:00100000:3.0:1790771166.081650:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533811584 00000100:00100000:2.0:1790771166.081655:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 773 00000100:00100000:3.0:1790771166.081655:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533811584 00000100:00100000:2.0:1790771166.081683:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533812096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.081694:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812352 00010000:00010000:2.0:1790771166.081694:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.081700:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812352 00000100:00100000:3.0:1790771166.081702:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1486 00010000:00010000:2.0:1790771166.081709:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c1f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35470 expref: 118 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081716:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13743:x1877759533811328:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.081729:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:2.0:1790771166.081733:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.081734:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5808 00000100:00100000:1.0:1790771166.081744:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14369:x1877759533811968:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.081762:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759533812096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.081769:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 773 00010000:00010000:1.0:1790771166.081776:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.081787:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 116 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.081794:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 116 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.081801:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5809 00010000:00010000:1.0:1790771166.081802:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 5/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081808:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13743:x1877759533811328:12345-192.168.204.50@tcp:35:ls.0 Request processed in 94us (462us total) trans 4294968653 rc 0/0 00000100:00100000:2.0:1790771166.081816:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14563:x1877759533812352:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:3.0:1790771166.081822:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1486 00010000:00010000:1.0:1790771166.081827:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 116 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081831:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.081839:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 116 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081846:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1487 00010000:00010000:2.0:1790771166.081847:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c252 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35518 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081862:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:13886:x1877759533811584:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.081867:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539734784:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.081904:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081914:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081921:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.081932:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 116 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.081935:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081946:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:13886:x1877759533811584:12345-192.168.204.50@tcp:35:ls.0 Request processed in 87us (555us total) trans 4294968654 rc 0/0 00010000:00010000:2.0:1790771166.081951:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.081952:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 116 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.081962:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1487 00010000:00010000:2.0:1790771166.081974:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.081978:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539734912:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.082003:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e89840 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.082007:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082014:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082019:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.082032:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082040:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082046:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.082050:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812480 00010000:00010000:2.0:1790771166.082052:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.082055:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812480 00010000:00010000:2.0:1790771166.082059:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082065:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.082068:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.082072:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00010000:00010000:2.0:1790771166.082074:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.082079:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba1180 with x1877759533812480 ext(0->18446744073709551615) 00010000:00010000:3.0:1790771166.082080:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c23d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.082088:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba1180. 00010000:00010000:3.0:1790771166.082100:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082105:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.082110:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.082111:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000100:00100000:0.0:1790771166.082113:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 396 00010000:00010000:2.0:1790771166.082117:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.082117:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771166.082122:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72a00, rc 0) 00000100:00100000:0.0:1790771166.082126:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533812480:12345-192.168.204.50@tcp:10:dd.0 00010000:00010000:2.0:1790771166.082128:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c259 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082142:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082147:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082152:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082156:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.082159:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.082165:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13208:x1877759533807232:12345-192.168.204.50@tcp:37:ls.0 Request processed in 17602us (17779us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.082174:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082189:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc34224100) 00000100:00100000:1.0:1790771166.082190:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1481 00010000:00010000:2.0:1790771166.082196:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.082197:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14763:x1877759533810944:12345-192.168.204.50@tcp:101:cp.0 Request processed in 967us (1032us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.082200:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082208:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c260 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.082209:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5807 00010000:00010000:2.0:1790771166.082241:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c252 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35518 expref: 91 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082257:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35518 expref: 90 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.082272:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:2.0:1790771166.082275:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.082279:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1800, rc 0) 00010000:00010000:1.0:1790771166.082291:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.082299:0:13765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.082319:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14563:x1877759533812352:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 506us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.082328:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5809 00002000:00010000:0.0:1790771166.082338:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size from disk: 13015 -> 0 00002000:00010000:0.0:1790771166.082342:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.082345:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.082347:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.082349:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks from disk: 32 -> 0 00000100:00100000:0.0:1790771166.082375:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533812480:12345-192.168.204.50@tcp:10:dd.0 Request processed in 252us (792us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1790771166.082377:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6480:1877759539734656:0@lo:105: 00000100:00100000:0.0:1790771166.082388:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 396 00002000:00010000:0.0:1790771166.082392:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/3 (0->18446744073709551615) 00010000:00010000:3.0:1790771166.082393:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1790771166.082395:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba1180 with x1877759533812480 ext(0->18446744073709551615) 00002000:00010000:0.0:1790771166.082400:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba1180. 00000100:00100000:2.0:1790771166.082452:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533810560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1410us (1631us total) trans 0 rc 0/0 00000040:00080000:1.0:1790771166.082453:0:13765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].38, 344 off55536 00000100:00100000:2.0:1790771166.082463:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1599 00000001:00080000:3.0:1790771166.083435:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969239 is committed 00000001:00080000:3.0:1790771166.083447:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969236 is committed 00010000:00010000:1.0:1790771166.083472:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083476:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083480:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083509:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083515:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083518:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083521:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.083527:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083528:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfca00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.083534:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083536:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083547:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083552:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.083556:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.083559:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc0ab7e500) 00000040:00080000:2.0:1790771166.083559:0:13765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].38, 552 off62104 00010000:00010000:1.0:1790771166.083560:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083569:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.083572:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c1c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.083572:0:13765:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb05e89c00 with version 77 00010000:00010000:0.0:1790771166.083574:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.083590:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0bc47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083597:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.083603:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 77 rpc_version 77 00010000:00010000:1.0:1790771166.083604:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083612:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083616:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.083618:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083622:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083630:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc34224f00) 00000020:00100000:3.0:1790771166.083630:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1790771166.083634:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.083638:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083644:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c20c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.083644:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3f919180 x1877759539735168/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1790771166.083683:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083691:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.083694:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f919180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539735168:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.083699:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083704:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.083706:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083710:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083717:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:1.0:1790771166.083719:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.083721:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083725:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c213 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x41:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083733:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083737:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083741:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083745:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.083746:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083750:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083757:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771166.083759:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.083761:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.083764:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c236 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.084941:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.084976:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539735168 00000100:00100000:1.0:1790771166.084981:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539735168 00000100:00100000:2.0:1790771166.084997:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87b40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.085016:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1790771166.085023:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539735168:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1790771166.085065:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.085091:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.085108:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812608 00000100:00100000:3.0:1790771166.085116:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812608 00000100:00100000:2.0:1790771166.085127:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812736 00000100:00100000:2.0:1790771166.085133:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812736 00000100:00100000:0.0:1790771166.085143:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3480 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539733888:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.085163:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1488 00010000:00010000:0.0:1790771166.085164:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085174:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1489 00000100:00100000:1.0:1790771166.085176:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7768:x1877759539735168:12345-0@lo:1000:osp_up1-0.0 Request processed in 151us (234us total) trans 4294968655 rc 0/0 00000100:00100000:3.0:1790771166.085182:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:11807:x1877759533812608:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.085191:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1790771166.085192:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:12241:x1877759533812736:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:0.0:1790771166.085217:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.085241:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f919180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539735168:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1790771166.085273:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.085282:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734016:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.085302:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:11807:x1877759533812608:12345-192.168.204.50@tcp:35:ls.0 Request processed in 128us (237us total) trans 4294969240 rc 0/0 00000004:00010000:1.0:1790771166.085305:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe9bedb6 reply state 0000000085dddb40 transno 4294969239 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.085314:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1488 00010000:00010000:1.0:1790771166.085319:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085326:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7f200) 00010000:00010000:1.0:1790771166.085328:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.085330:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.085335:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085345:0:13765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.085353:0:13765:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000100:00100000:3.0:1790771166.085355:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812864 00000100:00100000:3.0:1790771166.085360:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812864 00000004:00010000:1.0:1790771166.085362:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe9bedb6 reply state 0000000085dddb40 transno 4294969239 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085369:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085374:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771166.085376:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.085378:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1790771166.085384:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.085384:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812992 00000100:00100000:3.0:1790771166.085388:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812992 00000100:00100000:0.0:1790771166.085395:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00080000:1.0:1790771166.085423:0:13765:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790771166.085433:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14174:x1877759533786112:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 87831us (88281us total) trans 4294969239 rc 0/0 00000100:00100000:0.0:1790771166.085438:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04b21880 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734144:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771166.085443:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5751 00000100:00100000:3.0:1790771166.085464:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813504 00000100:00100000:3.0:1790771166.085468:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813504 00000100:00100000:1.0:1790771166.085469:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5810 00000100:00100000:1.0:1790771166.085478:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14392:x1877759533812864:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771166.085513:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.085517:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5811 00010000:00010000:1.0:1790771166.085525:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c26e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3551f expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.085526:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14502:x1877759533812992:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1790771166.085545:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.085557:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c275 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35526 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085560:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085562:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085583:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085586:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085592:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085595:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085598:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.085603:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085609:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085612:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085617:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:1.0:1790771166.085619:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085622:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.085627:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085630:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085639:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0bea8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085649:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085653:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085658:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085679:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.085683:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085685:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085696:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085699:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085702:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085709:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc0ab7f200) 00010000:00010000:0.0:1790771166.085718:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.085718:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085724:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085730:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c109 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.085745:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00000004:00200000:1.0:1790771166.085749:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.085759:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.085765:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5812 00010000:00010000:3.0:1790771166.085766:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085771:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085779:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.085780:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14481:x1877759533813504:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.085783:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085796:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.085805:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085809:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085812:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085814:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0c298 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35534 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085814:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.085820:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085834:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085836:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.085844:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085847:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085864:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.085868:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.085870:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085873:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085892:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c27c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085894:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085905:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085909:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085912:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.085918:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085931:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085932:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.085941:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085948:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.085951:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085953:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813632 00010000:00010000:0.0:1790771166.085954:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085954:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085959:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813632 00010000:00010000:1.0:1790771166.085973:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.085975:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.085985:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813888 00000100:00100000:2.0:1790771166.085988:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813888 00010000:00010000:1.0:1790771166.085989:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc0ab7e800) 00010000:00010000:0.0:1790771166.085990:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.085995:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.086001:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.086010:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5813 00010000:00010000:3.0:1790771166.086012:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.086013:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086016:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c283 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086019:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.086025:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14504:x1877759533813632:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771166.086034:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086043:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.086046:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086053:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c2b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3553b expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086059:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086059:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086060:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c26e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 109 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086087:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.086087:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.086090:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086092:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086094:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.086113:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771166.086116:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.086119:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105800, rc 0) 00010000:00010000:3.0:1790771166.086142:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086144:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086145:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.086149:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14392:x1877759533812864:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 669us (932us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.086165:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c291 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.086172:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5810 00010000:00010000:2.0:1790771166.086174:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086175:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086180:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.086193:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5814 00010000:00010000:2.0:1790771166.086198:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086202:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086205:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.086209:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14546:x1877759533813888:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:2.0:1790771166.086210:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086212:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.086218:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086222:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086226:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.086232:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086236:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c2c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35542 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086240:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0c2a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086243:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.086248:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086264:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086269:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086272:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc08974300) 00010000:00010000:0.0:1790771166.086276:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086276:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.086279:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086281:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086286:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086300:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c29f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086302:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086306:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086315:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086329:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.086331:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086335:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086337:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086340:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c275 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35526 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086349:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086361:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086370:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.086371:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086374:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.086376:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc3607ef00) 00010000:00010000:0.0:1790771166.086385:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.086385:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.086389:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086390:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086398:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086398:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c275 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35526 expref: 110 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086413:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0c2ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086424:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086428:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0c2e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086430:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00010000:00010000:2.0:1790771166.086444:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086447:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086451:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0c298 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35534 expref: 109 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086458:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.086465:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.086466:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14502:x1877759533812992:12345-192.168.204.50@tcp:101:dd.0 Request processed in 937us (1190us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.086468:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086509:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.086515:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x90:0x0]: returning size 5 00000100:00100000:3.0:1790771166.086520:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5811 00010000:00010000:0.0:1790771166.086527:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000004:00010000:1.0:1790771166.086530:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0c2e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086531:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.086540:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0c298 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35534 expref: 108 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086542:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.086549:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.086555:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086556:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.086558:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4c00, rc 0) 00010000:00010000:1.0:1790771166.086574:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086574:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c2bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.086583:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14481:x1877759533813504:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 807us (1190us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.086596:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086600:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.086601:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5812 00010000:00010000:1.0:1790771166.086610:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.086613:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086615:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086631:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086633:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086647:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.086652:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.086653:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.086654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.086659:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.086664:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086679:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086686:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c2d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086691:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59d92b11 (ffff8bfc34224c00) 00010000:00010000:2.0:1790771166.086695:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.086698:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086700:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.086708:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814400 00010000:00010000:2.0:1790771166.086711:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c2c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086717:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.086717:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814400 00010000:00010000:1.0:1790771166.086726:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086731:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.086734:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086740:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086744:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c2b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3553b expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.086751:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdd6ff3 (ffff8bfc0ab7e100) 00010000:00010000:1.0:1790771166.086754:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.086757:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086761:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3553b expref: 107 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.086763:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5815 00010000:00010000:1.0:1790771166.086775:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c2de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.086777:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00000100:00100000:3.0:1790771166.086783:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14583:x1877759533814400:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:2.0:1790771166.086785:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.086790:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00010000:00010000:3.0:1790771166.086798:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.086817:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c2c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35542 expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.086827:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14504:x1877759533813632:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 802us (996us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.086837:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339e00/0xfa0c505d97f0c2e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35542 expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.086841:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5813 00010000:00010000:1.0:1790771166.086852:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x90:0x0].0x0 (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771166.086854:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.086857:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339e00, rc 0) 00010000:00010000:3.0:1790771166.086887:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c2ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35550 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.086894:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14546:x1877759533813888:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 687us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.086907:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5814 00010000:00010000:3.0:1790771166.086933:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.086997:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087003:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087013:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087019:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087023:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087083:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087091:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087095:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.087114:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x42:0x0]: returning size 20905984 00000004:00200000:3.0:1790771166.087117:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.087124:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087131:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087136:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087140:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087145:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087148:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087152:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.087154:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087158:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087163:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.087164:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.087166:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087174:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c2f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087181:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087185:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087189:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087192:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.087194:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087197:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087201:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc08974a00) 00010000:00010000:3.0:1790771166.087203:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.087204:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087208:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c2fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087221:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c2ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35550 expref: 107 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087229:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35550 expref: 106 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.087234:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:3.0:1790771166.087236:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.087238:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597200, rc 0) 00000100:00100000:3.0:1790771166.087264:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14583:x1877759533814400:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 490us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.087268:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5815 00000100:00100000:2.0:1790771166.124548:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.124613:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814656 00000100:00100000:1.0:1790771166.124625:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814656 00000100:00100000:1.0:1790771166.124703:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5816 00000100:00100000:1.0:1790771166.124716:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14199:x1877759533814656:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.124737:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.124756:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c308 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35557 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.124773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.124808:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813376 00000100:00100000:2.0:1790771166.124813:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813376 00010000:00010000:1.0:1790771166.124814:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124828:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124836:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124839:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124861:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124867:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.124872:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1600 00010000:00010000:1.0:1790771166.124881:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.124884:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:2396:x1877759533813376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.124899:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.124905:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124915:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124931:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0aa34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34cf9 expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124938:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124946:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:1.0:1790771166.124947:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124955:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124958:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124968:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124974:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.124982:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.124994:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.124997:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.124999:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125006:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125011:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125016:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.125019:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125025:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.125035:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125035:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771166.125039:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533813376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 156us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.125041:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.125047:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.125058:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.125058:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1600 00010000:00010000:1.0:1790771166.125062:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c30f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125083:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125088:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125093:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125097:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.125100:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125104:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125110:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x84832a57 (ffff8bfc0ab7e100) 00010000:00010000:1.0:1790771166.125112:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.125114:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125118:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c316 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125142:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c308 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35557 expref: 107 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125151:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35557 expref: 106 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.125158:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:1.0:1790771166.125161:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.125165:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105000, rc 0) 00000100:00100000:1.0:1790771166.125210:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14199:x1877759533814656:12345-192.168.204.50@tcp:101:cat.0 Request processed in 497us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.125219:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5816 00000100:00100000:3.0:1790771166.126073:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.126103:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.126123:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813760 00000100:00100000:0.0:1790771166.126128:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813760 00000100:00100000:3.0:1790771166.126132:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.126187:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814144 00000100:00100000:0.0:1790771166.126188:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814016 00000100:00100000:0.0:1790771166.126193:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814016 00000100:00100000:2.0:1790771166.126196:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814144 00000100:00100000:1.0:1790771166.126204:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 955 00000100:00100000:1.0:1790771166.126217:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2399:x1877759533813760:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:3.0:1790771166.126226:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.126229:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 956 00000100:00100000:2.0:1790771166.126236:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 957 00000100:00100000:0.0:1790771166.126241:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759533814016:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:2.0:1790771166.126249:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2399:x1877759533814144:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:3.0:1790771166.126251:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815296 00000100:00100000:3.0:1790771166.126257:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815296 00002000:00100000:3.0:1790771166.126284:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (495616->499711) req@ffff8bfb0644fb80 x1877759533815296/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.126292:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644fb80 with x1877759533815296 ext(495616->499711) 00002000:00010000:3.0:1790771166.126297:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644fb80 00000100:00100000:3.0:1790771166.126321:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 397 00000100:00100000:3.0:1790771166.126330:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533815296:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771166.126373:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.126383:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.126413:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.126418:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790771166.126438:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb05687c00/0xfa0c505d97f0c1b8 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0c1bf expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.126451:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0644fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533815296:12345-192.168.204.50@tcp:3:cat.0 Request processed in 121us (230us total) trans 0 rc 0/0 00000001:00080000:2.0:1790771166.126452:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969241 is committed 00000100:00100000:3.0:1790771166.126462:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 397 00002000:00100000:3.0:1790771166.126469:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (495616->499711) req@ffff8bfb0644fb80 x1877759533815296/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.126480:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539735296:0@lo:103:jbd2/dm-0-8.0 00002000:00100000:3.0:1790771166.126514:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0644fb80 with x1877759533815296 ext(495616->499711) 00002000:00010000:3.0:1790771166.126518:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0644fb80 00000100:00100000:2.0:1790771166.126547:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.126562:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.126609:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539735296 00000100:00100000:2.0:1790771166.126612:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539735296 00000100:00100000:2.0:1790771166.126646:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1790771166.126654:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3627:x1877759539735296:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:2.0:1790771166.126662:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.126690:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c1bf lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0c1b8 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.126700:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224700) 00010000:00010000:2.0:1790771166.126707:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.126724:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.126741:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+7:3627:x1877759539735296:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.126747:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1790771166.126759:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb56300 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734400:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.126766:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815424 00000100:00100000:3.0:1790771166.126773:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815424 00000100:00100000:1.0:1790771166.126779:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815680 00000100:00100000:1.0:1790771166.126784:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815680 00000100:00100000:2.0:1790771166.126787:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539735296:0@lo:103:jbd2/dm-0-8.0 00000004:00010000:0.0:1790771166.126796:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007b626db7 reply state 00000000f2cee5c9 transno 4294969241 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.126809:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1490 00010000:00010000:0.0:1790771166.126819:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.126821:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1491 00000100:00100000:3.0:1790771166.126825:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14732:x1877759533815424:12345-192.168.204.50@tcp:37:chown.0 00000100:00100000:1.0:1790771166.126837:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14006:x1877759533815680:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.126839:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771166.126845:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.126850:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.126852:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.126857:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.126885:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00080000:0.0:1790771166.126901:0:13771:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771166.126907:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815936 00000100:00100000:2.0:1790771166.126913:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815936 00000100:00100000:2.0:1790771166.126946:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816064 00000100:00100000:2.0:1790771166.126950:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816064 00000100:00100000:0.0:1790771166.126964:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14625:x1877759533808768:12345-192.168.204.50@tcp:36:chown.0 Request processed in 61303us (61454us total) trans 4294969241 rc 0/0 00000100:00100000:0.0:1790771166.126973:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5801 00000100:00100000:2.0:1790771166.126981:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5817 00000100:00100000:2.0:1790771166.126993:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:14447:x1877759533815936:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771166.126997:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5818 00000100:00100000:0.0:1790771166.127009:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14004:x1877759533816064:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.127019:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.127029:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c324 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3557a expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127030:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.127051:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0b498 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3516e expref: 91 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127064:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127066:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.127073:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.127080:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127087:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127088:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127107:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 90 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127110:0:13771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127121:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 90 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127133:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127141:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 90 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127147:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 6/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127155:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127163:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127166:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 90 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127173:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127180:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.127181:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 90 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127187:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127193:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.127194:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735424:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.127207:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc113f3400) 00010000:00010000:0.0:1790771166.127210:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.127213:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127217:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0c221 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127250:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 90 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.127259:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734528:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.127260:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 90 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.127274:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.127302:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 90 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.127309:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 90 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.127319:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735680:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.127335:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.127390:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0001_UUID:13770:1877759539734272:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.127452:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127458:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0bc8d lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000020 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.127470:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003cc3ba01 reply state 00000000813bb8a3 transno 4294968651 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127478:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.127510:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfc10471800) 00010000:00010000:0.0:1790771166.127512:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.127515:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.127607:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14198:x1877759533771776:12345-192.168.204.50@tcp:36:rm.0 Request processed in 171236us (171386us total) trans 4294968651 rc 0/0 00000100:00100000:3.0:1790771166.127608:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.127617:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5717 00000100:00100000:3.0:1790771166.127689:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533818368 00000100:00100000:3.0:1790771166.127693:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533818368 00000100:00100000:3.0:1790771166.127725:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5819 00000100:00100000:3.0:1790771166.127733:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14652:x1877759533818368:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.127764:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.127775:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 106 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.127782:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.127800:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 106 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.127809:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 106 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.127819:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539735808:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.127863:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87000 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.127955:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.128036:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:1.0:1790771166.128073:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967602 is committed 00000001:00080000:1.0:1790771166.128111:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967596 is committed 00000100:00100000:3.0:1790771166.128149:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.128176:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533818752 00000100:00100000:1.0:1790771166.128182:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533813760:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1965us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.128183:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533818752 00000100:00100000:1.0:1790771166.128197:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 955 00000100:00100000:3.0:1790771166.128212:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819264 00000100:00100000:3.0:1790771166.128216:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819264 00000100:00100000:1.0:1790771166.128234:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819136 00000100:00100000:1.0:1790771166.128240:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819136 00000100:00100000:3.0:1790771166.128240:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1492 00000100:00100000:2.0:1790771166.128257:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:12241:x1877759533812736:12345-192.168.204.50@tcp:37:ls.0 Request processed in 43067us (43160us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.128257:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13667:x1877759533818752:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.128272:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1489 00000100:00100000:1.0:1790771166.128286:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5820 00000100:00100000:2.0:1790771166.128297:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1493 00000100:00100000:1.0:1790771166.128303:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14392:x1877759533819136:12345-192.168.204.50@tcp:101:mrename.0 00000100:00100000:2.0:1790771166.128311:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14003:x1877759533819264:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.128314:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.128326:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c340 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355e3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128360:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128369:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.128377:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13667:x1877759533818752:12345-192.168.204.50@tcp:35:ls.0 Request processed in 126us (419us total) trans 4294968656 rc 0/0 00010000:00010000:1.0:1790771166.128380:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.128387:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1492 00010000:00010000:1.0:1790771166.128397:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128404:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128411:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128424:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14003:x1877759533819264:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (308us total) trans 4294969242 rc 0/0 00000100:00100000:2.0:1790771166.128436:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1493 00000100:00100000:3.0:1790771166.128440:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.128456:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128464:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128471:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.128478:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.128519:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759533814144:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2273us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.128526:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 957 00000100:00100000:3.0:1790771166.128527:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819392 00000100:00100000:3.0:1790771166.128531:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819392 00000004:00200000:1.0:1790771166.128536:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.128540:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.128553:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128562:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128564:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1494 00010000:00010000:1.0:1790771166.128573:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128579:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14404:x1877759533819392:12345-192.168.204.50@tcp:49:setfattr.0 00010000:00010000:1.0:1790771166.128592:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128598:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128604:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.128607:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128613:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128623:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.128625:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.128629:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128633:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14404:x1877759533819392:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 57us (158us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771166.128641:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c347 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128647:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1494 00000100:00100000:3.0:1790771166.128655:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.128679:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128686:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128690:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819776 00010000:00010000:1.0:1790771166.128691:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128697:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819776 00010000:00010000:1.0:1790771166.128699:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.128703:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128710:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128720:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x391d5834 (ffff8bfb03218300) 00000100:00100000:3.0:1790771166.128720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.128725:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.128729:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128734:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c34e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.128740:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1495 00000100:00100000:2.0:1790771166.128752:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14203:x1877759533819776:12345-192.168.204.50@tcp:35:cp.0 00010000:00010000:1.0:1790771166.128769:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c340 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 112 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.128780:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.128789:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 111 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.128795:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:1.0:1790771166.128797:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.128800:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105e00, rc 0) 00000100:00100000:3.0:1790771166.128811:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.128833:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539734784:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.128848:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.128853:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba3480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539734912:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.128876:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.128881:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814784 00000100:00100000:3.0:1790771166.128884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.128890:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814784 00000100:00100000:1.0:1790771166.128904:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819904 00000100:00100000:2.0:1790771166.128907:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14203:x1877759533819776:12345-192.168.204.50@tcp:35:cp.0 Request processed in 156us (254us total) trans 4294969243 rc 0/0 00000100:00100000:1.0:1790771166.128910:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819904 00000100:00100000:3.0:1790771166.128920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.128926:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1495 00000100:00100000:0.0:1790771166.128931:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820032 00000100:00100000:0.0:1790771166.128936:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820032 00000100:00100000:3.0:1790771166.128946:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815040 00000100:00100000:1.0:1790771166.128947:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533815168 00000100:00100000:1.0:1790771166.128953:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815168 00000100:00100000:3.0:1790771166.128953:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533815040 00000100:00100000:2.0:1790771166.128964:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816448 00000100:00100000:0.0:1790771166.128970:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5821 00000100:00100000:2.0:1790771166.128970:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816448 00000100:00100000:0.0:1790771166.128982:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14560:x1877759533814784:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771166.128990:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.128996:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5822 00010000:00010000:0.0:1790771166.129001:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c35c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3555e expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.129011:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:14504:x1877759533819904:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:3.0:1790771166.129011:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5823 00010000:00010000:1.0:1790771166.129024:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.129024:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5824 00000100:00100000:3.0:1790771166.129025:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14563:x1877759533820032:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1790771166.129032:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129037:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.129038:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c36a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355ea expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129041:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.129045:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14616:x1877759533815168:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.129050:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c371 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355f1 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129065:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129066:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.129083:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c378 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35573 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129085:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129088:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129091:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c38d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129109:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129118:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129119:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129119:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c38d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129144:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129145:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129146:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c38d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129153:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129174:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129183:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.129185:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.129186:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.129191:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:1.0:1790771166.129193:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.129201:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.129208:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.129208:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129215:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c371 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355f1 expref: 115 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129217:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129232:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c36a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 94 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129235:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129240:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129244:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c38d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355f1 expref: 114 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129264:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129267:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.129270:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.129271:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 93 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129273:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.129279:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.129279:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597800, rc 0) 00010000:00010000:0.0:1790771166.129286:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129290:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129300:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:3.0:1790771166.129302:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14563:x1877759533820032:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 278us (526us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.129306:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c363 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129308:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.129314:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104a00, rc 0) 00000100:00100000:3.0:1790771166.129327:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5823 00010000:00010000:0.0:1790771166.129336:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.129341:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14504:x1877759533819904:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 335us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.129350:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5825 00010000:00010000:2.0:1790771166.129356:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129357:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.129361:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5822 00000100:00100000:3.0:1790771166.129365:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14540:x1877759533815040:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771166.129379:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.129383:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5826 00010000:00010000:0.0:1790771166.129384:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129384:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129387:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c3a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3556c expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.129395:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14662:x1877759533816448:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771166.129410:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.129411:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129413:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.129415:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129425:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c3b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35581 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129431:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129437:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.129454:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 21450 00010000:00010000:3.0:1790771166.129455:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129457:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc1ae7f700) 00000004:00200000:2.0:1790771166.129463:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.129465:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.129471:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129471:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129474:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.129481:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129511:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c37f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129516:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129530:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129539:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129541:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129545:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129550:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129551:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c35c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3555e expref: 115 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129566:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129580:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129583:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129590:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129596:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129597:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.129600:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129600:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129606:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.129613:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c35c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3555e expref: 115 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129620:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.129628:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129629:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129632:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ec00, rc 0) 00000100:00100000:0.0:1790771166.129653:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14560:x1877759533814784:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 673us (1220us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.129653:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129655:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129656:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129691:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5821 00010000:00010000:2.0:1790771166.129697:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.129700:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129701:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.129707:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.129709:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 25161 00000004:00200000:3.0:1790771166.129717:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.129728:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c394 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.129729:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129731:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129739:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820288 00000100:00100000:0.0:1790771166.129746:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820288 00010000:00010000:2.0:1790771166.129750:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129755:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129757:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.129769:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.129773:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.129774:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.129774:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129780:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 775 00010000:00010000:2.0:1790771166.129787:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00010000:1.0:1790771166.129788:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129791:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129793:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:2396:x1877759533820288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.129808:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.129810:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129811:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.129821:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c267 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35518 expref: 93 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129831:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc310f2500) 00010000:00010000:1.0:1790771166.129833:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129839:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.129842:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:0.0:1790771166.129847:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.129848:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.129848:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129865:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:2396:x1877759533820288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (945us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.129872:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c39b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129873:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.129882:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 775 00010000:00010000:1.0:1790771166.129883:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129900:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129912:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.129916:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.129920:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129927:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c3be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129945:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129952:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129957:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129962:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.129965:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129969:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14392:x1877759533819136:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 1672us (1932us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.129973:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.129979:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5820 00010000:00010000:1.0:1790771166.129984:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.129987:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.129990:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.129993:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.129998:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c3cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130006:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.130012:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c378 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 114 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130015:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.130021:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130029:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.130030:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c3b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 114 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.130034:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 114 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130046:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.130055:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.130057:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771166.130059:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.130061:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.130064:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.130066:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5000, rc 0) 00010000:00010000:3.0:1790771166.130087:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c3b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.130088:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14616:x1877759533815168:12345-192.168.204.50@tcp:101:cp.0 Request processed in 1050us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.130108:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5824 00010000:00010000:1.0:1790771166.130109:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.130113:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.130116:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38800, rc 0) 00000100:00100000:1.0:1790771166.130138:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14662:x1877759533816448:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 748us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.130145:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5826 00010000:00010000:3.0:1790771166.130148:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130154:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130159:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130163:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.130165:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.130171:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967606 is committed 00010000:00010000:3.0:1790771166.130171:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130182:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc08974a00) 00010000:00010000:3.0:1790771166.130184:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000001:00080000:0.0:1790771166.130186:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967604 is committed 00010000:00010000:3.0:1790771166.130187:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130194:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c3c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.130199:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967600 is committed 00010000:00010000:3.0:1790771166.130217:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c3a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 112 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130234:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 111 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130240:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771166.130243:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.130245:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597e00, rc 0) 00000100:00100000:1.0:1790771166.130253:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.130256:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+20:2399:x1877759533814016:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 4016us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.130267:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 956 00000100:00100000:1.0:1790771166.130293:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.130294:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814912 00000100:00100000:3.0:1790771166.130300:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14540:x1877759533815040:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 938us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.130302:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814912 00000100:00100000:3.0:1790771166.130309:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5825 00000100:00100000:3.0:1790771166.130327:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533809280 00000100:00100000:1.0:1790771166.130332:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.130333:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533809280 00000100:00100000:0.0:1790771166.130340:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5827 00000100:00100000:0.0:1790771166.130350:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14775:x1877759533814912:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771166.130353:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820544 00010000:00010000:0.0:1790771166.130358:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.130359:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820544 00000100:00100000:3.0:1790771166.130364:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5828 00010000:00010000:0.0:1790771166.130370:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c3e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35565 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.130375:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14096:x1877759533809280:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:1.0:1790771166.130391:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 958 00010000:00010000:3.0:1790771166.130391:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.130402:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533820544:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:3.0:1790771166.130403:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c3e8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354b6 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130407:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.130413:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.130424:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0c3f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355ff expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130427:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130445:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130458:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130462:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130464:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130472:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539735936:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.130479:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 112 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130512:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130518:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130534:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 112 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130543:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 112 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130547:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.130554:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539736064:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.130556:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130565:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130571:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.130580:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87540 going to sleep for 11 seconds 00000004:00200000:0.0:1790771166.130590:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x61:0x0]: returning size 0 00000100:00100000:1.0:1790771166.130591:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.130596:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.130607:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.130614:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533811072 00010000:00010000:0.0:1790771166.130615:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.130620:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533811072 00000100:00100000:1.0:1790771166.130626:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.130631:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130637:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130641:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130645:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.130646:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820800 00010000:00010000:0.0:1790771166.130649:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130651:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820800 00000100:00100000:3.0:1790771166.130655:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5829 00010000:00010000:0.0:1790771166.130662:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.130683:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14008:x1877759533811072:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.130688:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.130691:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.130691:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.130693:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130701:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 959 00010000:00010000:0.0:1790771166.130703:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130704:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e354e7 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130713:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759533820800:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771166.130725:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c3ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.130729:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.130736:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.130740:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0c419 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3560d expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130742:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130758:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130763:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.130766:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130767:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c420 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130773:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130781:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c420 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130782:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13782:1877759539736192:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.130783:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xea196397 (ffff8bfc1ae7f100) 00010000:00010000:0.0:1790771166.130790:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.130794:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130798:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c420 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130810:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633d80 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.130817:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c3fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.130819:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.130845:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c3e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35565 expref: 113 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130849:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.130865:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35565 expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.130875:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00010000:00010000:3.0:1790771166.130876:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354e7 expref: 116 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130879:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.130884:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.130889:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669400, rc 0) 00010000:00010000:3.0:1790771166.130897:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c420 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354e7 expref: 115 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.130900:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821056 00000100:00100000:1.0:1790771166.130907:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821056 00010000:00010000:3.0:1790771166.130907:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:3.0:1790771166.130913:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1790771166.130916:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14775:x1877759533814912:12345-192.168.204.50@tcp:101:ln.0 Request processed in 566us (664us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.130916:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73200, rc 0) 00000100:00100000:0.0:1790771166.130926:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5827 00000100:00100000:3.0:1790771166.130940:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14008:x1877759533811072:12345-192.168.204.50@tcp:101:ls.0 Request processed in 276us (350us total) trans 4294969244 rc 0/0 00000100:00100000:0.0:1790771166.130945:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533812224 00000100:00100000:1.0:1790771166.130950:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 960 00000100:00100000:3.0:1790771166.130950:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5829 00000100:00100000:0.0:1790771166.130952:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533812224 00000100:00100000:1.0:1790771166.130968:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533821056:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:3.0:1790771166.130974:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5830 00010000:00010000:1.0:1790771166.130977:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.130985:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:13888:x1877759533812224:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.130990:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad094963/0xfa0c505d97f0c42e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3561b expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.130993:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.131004:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c435 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35511 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.131020:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.131029:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539736320:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.131033:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533813248 00010000:00010000:3.0:1790771166.131036:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.131037:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533813248 00010000:00010000:3.0:1790771166.131047:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131055:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633480 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.131055:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.131063:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5831 00000100:00100000:0.0:1790771166.131074:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14608:x1877759533813248:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:3.0:1790771166.131077:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131082:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.131084:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131092:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131094:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c44a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3552d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131107:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.131130:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.131132:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.131140:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.131141:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131141:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533814528 00000100:00100000:1.0:1790771166.131146:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533814528 00010000:00010000:0.0:1790771166.131152:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131168:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131174:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131178:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131183:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5832 00010000:00010000:3.0:1790771166.131189:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131201:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131201:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14487:x1877759533814528:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771166.131202:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131219:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.131222:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131223:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790771166.131231:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.131234:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131240:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0984b lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346f5 expref: 95 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131241:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131259:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771166.131262:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.131264:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc36078200) 00010000:00010000:3.0:1790771166.131265:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131267:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131274:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.131284:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c43c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131289:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131289:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0c46d lrc: 2/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35549 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131294:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131309:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.131328:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 47794 00010000:00010000:3.0:1790771166.131329:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131337:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131341:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.131343:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131347:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131353:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc08974300) 00010000:00010000:3.0:1790771166.131354:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.131356:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131359:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131361:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c443 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131366:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131384:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131386:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 97 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131397:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131399:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c435 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35511 expref: 95 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131401:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 4/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131415:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131425:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.131426:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.131432:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.131433:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131436:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 97 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131439:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c435 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35511 expref: 95 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131450:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131463:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 97 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131472:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.131479:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.131511:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72000, rc 0) 00000100:00100000:1.0:1790771166.131514:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539736448:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.131520:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131528:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.131535:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:13888:x1877759533812224:12345-192.168.204.50@tcp:101:ls.0 Request processed in 549us (686us total) trans 4294968657 rc 301/301 00010000:00010000:0.0:1790771166.131536:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c451 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131544:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de780 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.131549:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5830 00010000:00010000:0.0:1790771166.131554:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131560:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131565:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131570:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.131574:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.131575:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820160 00000100:00100000:3.0:1790771166.131580:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820160 00010000:00010000:0.0:1790771166.131581:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131589:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.131598:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd6e9df9d (ffff8bfc1ae7f200) 00010000:00010000:0.0:1790771166.131601:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.131603:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131607:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c45f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131611:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820416 00000100:00100000:1.0:1790771166.131616:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820416 00000100:00100000:3.0:1790771166.131620:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 776 00000100:00100000:3.0:1790771166.131629:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:2396:x1877759533820160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.131636:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c44a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 116 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.131638:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.131655:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c2d7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3553b expref: 115 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.131657:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 115 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.131657:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 961 00000100:00100000:1.0:1790771166.131690:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533820416:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771166.131692:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:3.0:1790771166.131693:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:0.0:1790771166.131699:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790771166.131701:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.131701:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.131703:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668800, rc 0) 00010000:00010000:1.0:1790771166.131714:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a42aa73/0xfa0c505d97f0c482 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355f8 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.131722:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:2396:x1877759533820160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.131728:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14608:x1877759533813248:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 653us (705us total) trans 4294969245 rc 0/0 00000100:00100000:3.0:1790771166.131735:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 776 00000100:00100000:0.0:1790771166.131740:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5831 00000100:00100000:1.0:1790771166.131744:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13787:1877759539736576:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771166.131770:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de000 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.131797:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.131829:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820672 00000100:00100000:1.0:1790771166.131834:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820672 00000100:00100000:0.0:1790771166.131835:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.131842:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.131866:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533820928 00000100:00100000:1.0:1790771166.131870:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533820928 00000100:00100000:0.0:1790771166.131875:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.131889:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 962 00000100:00100000:1.0:1790771166.131898:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 963 00000100:00100000:3.0:1790771166.131902:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533820672:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:0.0:1790771166.131903:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816320 00000100:00100000:0.0:1790771166.131911:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816320 00000100:00100000:1.0:1790771166.131911:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533820928:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771166.131914:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.131923:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.131925:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744a2171/0xfa0c505d97f0c489 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35606 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.131932:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b93aab5/0xfa0c505d97f0c490 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35614 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.131938:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821312 00000100:00100000:0.0:1790771166.131943:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821312 00000100:00100000:0.0:1790771166.131960:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5833 00000100:00100000:0.0:1790771166.131968:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14432:x1877759533816320:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:3.0:1790771166.131973:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539736704:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.131977:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.131979:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539736832:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.131989:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c497 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35503 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.132003:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.132011:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.132022:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5834 00010000:00010000:0.0:1790771166.132028:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0c49e lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.132033:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14763:x1877759533821312:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:0.0:1790771166.132044:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0c49e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.132051:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0c49e lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.132058:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.132060:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.132074:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0a0c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3499c expref: 117 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.132087:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771166.132090:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.132108:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c497 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35503 expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.132122:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669e00/0xfa0c505d97f0c49e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35503 expref: 117 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.132127:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:0.0:1790771166.132130:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.132133:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669e00, rc 0) 00000100:00100000:0.0:1790771166.132154:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14432:x1877759533816320:12345-192.168.204.50@tcp:101:rm.0 Request processed in 187us (315us total) trans 4294969246 rc 0/0 00000100:00100000:0.0:1790771166.132166:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5833 00000100:00100000:0.0:1790771166.132923:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.132964:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816704 00000100:00100000:1.0:1790771166.132969:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816704 00000100:00100000:1.0:1790771166.132999:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5835 00000100:00100000:1.0:1790771166.133007:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14626:x1877759533816704:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.133016:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.133026:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0c4ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35588 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.133028:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.133052:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 114 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.133059:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.133077:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 114 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133079:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.133089:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 114 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133092:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.133103:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539736960:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.133104:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133122:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133128:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133134:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14006:x1877759533815680:12345-192.168.204.50@tcp:37:ls.0 Request processed in 6298us (6409us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.133138:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133145:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1491 00000100:00100000:0.0:1790771166.133150:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.133191:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.133202:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133213:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133215:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821568 00000100:00100000:2.0:1790771166.133220:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821568 00010000:00010000:1.0:1790771166.133225:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.133234:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.133242:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133254:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133255:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5836 00000100:00100000:0.0:1790771166.133261:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.133269:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14199:x1877759533821568:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.133272:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133282:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.133285:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821696 00010000:00010000:1.0:1790771166.133287:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133289:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821696 00010000:00010000:1.0:1790771166.133300:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133311:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfb03218500) 00000100:00100000:3.0:1790771166.133313:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14732:x1877759533815424:12345-192.168.204.50@tcp:37:chown.0 Request processed in 6492us (6751us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.133315:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.133322:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.133323:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 777 00000100:00100000:3.0:1790771166.133329:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1490 00000100:00100000:2.0:1790771166.133336:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:2397:x1877759533821696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.133341:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c4c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133345:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.133355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.133361:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c31d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35557 expref: 115 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133370:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133376:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:2.0:1790771166.133382:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.133383:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133393:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133401:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.133401:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821824 00000100:00100000:2.0:1790771166.133405:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:2397:x1877759533821696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.133407:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821824 00000100:00100000:2.0:1790771166.133420:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 777 00010000:00010000:1.0:1790771166.133421:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.133426:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.133431:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (499712->503807) req@ffff8bfb06791f80 x1877759533821824/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.133434:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133448:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.133449:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.133450:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.133455:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133462:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c4ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133462:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c4cf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35630 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133482:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133511:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133522:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133527:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.133529:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133533:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133542:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfb03218a00) 00010000:00010000:1.0:1790771166.133544:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.133547:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0c4d6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133548:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.133554:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06791f80 with x1877759533821824 ext(499712->503807) 00002000:00010000:3.0:1790771166.133562:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06791f80 00010000:00010000:1.0:1790771166.133571:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c4c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133572:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0c4d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133585:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0c4d6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.133592:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 398 00000100:00100000:3.0:1790771166.133601:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2397:x1877759533821824:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.133604:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0c4ac lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35588 expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.133604:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.133610:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.133620:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.133623:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.133626:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0c4ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35588 expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133633:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c4cf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35630 expref: 94 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.133634:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00010000:00010000:2.0:1790771166.133648:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5c00/0xfa0c505d97f0c4d6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35630 expref: 93 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.133654:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.133657:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1790771166.133660:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5c00, rc 0) 00000100:00100000:1.0:1790771166.133689:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14626:x1877759533816704:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 680us (763us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.133699:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14199:x1877759533821568:12345-192.168.204.50@tcp:101:cat.0 Request processed in 433us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.133701:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5835 00000100:00100000:3.0:1790771166.133708:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2397:x1877759533821824:12345-192.168.204.50@tcp:3:cat.0 Request processed in 105us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.133722:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5836 00000100:00100000:3.0:1790771166.133727:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 398 00002000:00100000:3.0:1790771166.133734:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (499712->503807) req@ffff8bfb06791f80 x1877759533821824/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.133741:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06791f80 with x1877759533821824 ext(499712->503807) 00002000:00010000:3.0:1790771166.133745:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06791f80 00000001:00080000:0.0:1790771166.135097:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967607 is committed 00000100:00100000:2.0:1790771166.135215:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533802880:12345-192.168.204.50@tcp:4:cat.0 Request processed in 88138us (88328us total) trans 4294967607 rc 0/0 00000100:00100000:2.0:1790771166.135221:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 89 00000100:00100000:0.0:1790771166.135231:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533803008:12345-192.168.204.50@tcp:3:cat.0 Request processed in 87800us (87904us total) trans 0 rc 4096/4096 00002000:00100000:2.0:1790771166.135231:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1e:0x0] (29064->4222975) req@ffff8bfb03ffc380 x1877759533802880/t4294967607(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.135247:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ffc380 with x1877759533802880 ext(29064->4222975) 00000100:00100000:0.0:1790771166.135251:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 90 00010000:00010000:2.0:1790771166.135258:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.135261:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x1e:0x0] (28672->32767) req@ffff8bfc3fa6c380 x1877759533803008/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.135278:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa6c380 with x1877759533803008 ext(28672->32767) 00010000:00010000:2.0:1790771166.135280:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.135287:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 28 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.135289:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb03ffc380 00010000:00010000:0.0:1790771166.135302:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.135311:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfc3fa6c380 00000100:00100000:0.0:1790771166.142381:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.142402:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.142427:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822208 00000100:00100000:3.0:1790771166.142433:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822208 00000100:00100000:0.0:1790771166.142438:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.142441:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735424:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.142458:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 93 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.142460:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822464 00000100:00100000:2.0:1790771166.142463:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735552:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.142468:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822464 00000100:00100000:0.0:1790771166.142475:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.142507:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001_UUID:6494:1877759539735680:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.142519:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822336 00010000:00010000:1.0:1790771166.142520:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 94 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.142525:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822336 00010000:00010000:2.0:1790771166.142535:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.142545:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 95 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142548:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.142555:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1601 00000100:00100000:1.0:1790771166.142573:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2397:x1877759533822208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.142573:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1602 00000100:00100000:3.0:1790771166.142583:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1603 00010000:00010000:1.0:1790771166.142587:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.142589:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2397:x1877759533822464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.142596:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 95 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.142602:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.142608:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 95 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.142612:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 95 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142619:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.142635:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0b48a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35167 expref: 95 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.142637:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 95 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.142649:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2397:x1877759533822336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.142656:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.142661:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.142663:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.142685:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 94 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.142691:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.142707:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.142720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.142720:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0a8ac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c2e expref: 94 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.142721:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 94 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.142740:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2397:x1877759533822208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 173us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.142752:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1601 00000100:00100000:1.0:1790771166.142793:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823232 00000100:00100000:1.0:1790771166.142797:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823232 00000100:00100000:0.0:1790771166.142798:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.142813:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 112 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142822:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.142840:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1604 00000100:00100000:0.0:1790771166.142845:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.142852:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2396:x1877759533823232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.142859:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.142864:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822848 00010000:00010000:1.0:1790771166.142866:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 112 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142870:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822848 00010000:00010000:1.0:1790771166.142882:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 112 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.142885:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.142888:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0a8b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c35 expref: 92 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142892:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823104 00010000:00010000:2.0:1790771166.142893:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142897:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823104 00000100:00100000:0.0:1790771166.142913:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823488 00010000:00010000:2.0:1790771166.142915:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142917:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823488 00010000:00010000:1.0:1790771166.142917:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:1.0:1790771166.142926:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.142929:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142931:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823872 00000100:00100000:0.0:1790771166.142935:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823872 00010000:00010000:1.0:1790771166.142946:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142947:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1496 00010000:00010000:3.0:1790771166.142948:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.142956:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.142958:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.142962:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13208:x1877759533822848:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.142965:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.142976:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.142987:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:2397:x1877759533822336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 393us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.142998:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:2397:x1877759533822464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 412us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.142998:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1603 00000100:00100000:1.0:1790771166.143006:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2396:x1877759533823232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.143012:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1602 00000100:00100000:1.0:1790771166.143020:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1604 00000100:00100000:3.0:1790771166.143027:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822720 00000100:00100000:3.0:1790771166.143031:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822720 00000100:00100000:2.0:1790771166.143055:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1497 00000100:00100000:3.0:1790771166.143058:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823360 00000100:00100000:1.0:1790771166.143062:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533823616 00000100:00100000:3.0:1790771166.143062:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823360 00000100:00100000:2.0:1790771166.143068:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13739:x1877759533823104:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.143069:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533823616 00000100:00100000:0.0:1790771166.143083:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13208:x1877759533822848:12345-192.168.204.50@tcp:35:ls.0 Request processed in 123us (540us total) trans 4294969248 rc 0/0 00000100:00100000:0.0:1790771166.143091:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1496 00000100:00100000:3.0:1790771166.143095:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5837 00000100:00100000:1.0:1790771166.143107:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 964 00000100:00100000:3.0:1790771166.143108:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14020:x1877759533822720:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:0.0:1790771166.143115:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1498 00000100:00100000:1.0:1790771166.143120:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:14077:x1877759533823616:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1790771166.143129:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:12255:x1877759533823488:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.143130:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.143142:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3564c expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143169:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.143176:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:13739:x1877759533823104:12345-192.168.204.50@tcp:35:ls.0 Request processed in 110us (567us total) trans 4294968658 rc 0/0 00000100:00100000:2.0:1790771166.143188:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1497 00010000:00010000:1.0:1790771166.143190:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa:0x0].0x0 since=1s v=(3 8) 00000100:00100000:3.0:1790771166.143195:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:14020:x1877759533822720:12345-192.168.204.50@tcp:36:ln.0 Request processed in 90us (724us total) trans 0 rc -17/-17 00010000:00010000:1.0:1790771166.143199:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(4 8) 00000100:00100000:3.0:1790771166.143205:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5837 00010000:00010000:1.0:1790771166.143210:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 30 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.143211:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1499 00000100:00100000:2.0:1790771166.143225:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14001:x1877759533823872:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.143230:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5838 00000100:00100000:0.0:1790771166.143240:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:12255:x1877759533823488:12345-192.168.204.50@tcp:35:ls.0 Request processed in 110us (437us total) trans 4294969249 rc 0/0 00010000:00010000:1.0:1790771166.143240:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.143241:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14003:x1877759533823360:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.143257:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.143260:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1498 00010000:00010000:1.0:1790771166.143267:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 23 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143270:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c4e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35645 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.143296:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539737088:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.143302:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14001:x1877759533823872:12345-192.168.204.50@tcp:35:ls.0 Request processed in 79us (455us total) trans 4294969250 rc 0/0 00010000:00010000:3.0:1790771166.143309:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143310:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.143319:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1499 00010000:00010000:3.0:1790771166.143324:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143337:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143340:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816832 00000100:00100000:0.0:1790771166.143345:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816832 00000100:00100000:1.0:1790771166.143350:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de300 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.143379:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5839 00000100:00100000:2.0:1790771166.143390:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14664:x1877759533816832:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771166.143395:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c102 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35493 expref: 112 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143399:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.143409:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d61500 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539735808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.143411:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c4f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3558f expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143423:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143431:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143436:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143442:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.143443:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.143458:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143465:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143481:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533824384 00010000:00010000:2.0:1790771166.143481:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143513:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533824384 00010000:00010000:2.0:1790771166.143518:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.143519:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.143528:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143550:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533824640 00000100:00100000:0.0:1790771166.143555:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533824640 00000100:00100000:1.0:1790771166.143566:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:3.0:1790771166.143569:0:13774:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969251 00010000:00010000:2.0:1790771166.143572:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143580:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143586:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143590:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825024 00000100:00100000:0.0:1790771166.143595:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825024 00000004:00010000:3.0:1790771166.143596:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ff92e52 reply state 0000000078a0d86e transno 4294969252 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.143604:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.143607:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.143608:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.143609:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.143619:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00000004:00010000:2.0:1790771166.143622:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143622:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.143624:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.143628:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825152 00000100:00100000:0.0:1790771166.143635:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825152 00010000:00010000:2.0:1790771166.143635:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.143646:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5840 00010000:00010000:2.0:1790771166.143646:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143659:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.143659:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14652:x1877759533818368:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 15924us (16050us total) trans 4294969252 rc 0/0 00000100:00100000:1.0:1790771166.143682:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:14504:x1877759533824384:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771166.143683:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5841 00010000:00010000:2.0:1790771166.143692:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.143695:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5819 00010000:00010000:2.0:1790771166.143698:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143700:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14563:x1877759533824640:12345-192.168.204.50@tcp:36:mkdir.0 00000020:00080000:3.0:1790771166.143703:0:13774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.143712:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143721:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771166.143722:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5842 00010000:00010000:1.0:1790771166.143727:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143728:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.143733:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.143736:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.143736:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14662:x1877759533825024:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771166.143753:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 98 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143753:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c4f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.143758:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c38d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355f1 expref: 116 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143769:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143777:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143783:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 91 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143796:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 120 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143802:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143813:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 5/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.143817:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.143827:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.143827:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143828:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 115 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143844:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 91 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143845:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.143848:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143852:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143871:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143876:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 91 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143880:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x391d5834 (ffff8bfc310f2500) 00010000:00010000:2.0:1790771166.143887:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.143889:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14563:x1877759533824640:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 189us (397us total) trans 0 rc -17/-17 00010000:00010000:3.0:1790771166.143889:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 115 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143891:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.143908:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539737216:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.143910:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5841 00010000:00010000:2.0:1790771166.143913:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c500 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143920:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 115 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.143934:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5843 00000100:00100000:3.0:1790771166.143935:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4000 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539737344:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.143946:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:14619:x1877759533825152:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771166.143949:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c4f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 115 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.143957:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.143970:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c51c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3565a expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143971:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 114 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.143974:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 98 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.143978:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 120 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.143999:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:2.0:1790771166.144004:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.144005:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 98 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144008:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 120 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144009:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5800, rc 0) 00010000:00010000:0.0:1790771166.144017:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144033:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539737472:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.144038:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14664:x1877759533816832:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 649us (730us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.144042:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144058:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5839 00010000:00010000:0.0:1790771166.144061:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.144061:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539737600:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.144065:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc086296c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.144084:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144091:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144093:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.144095:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35600 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.144102:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144104:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144125:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.144139:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817088 00000100:00100000:3.0:1790771166.144144:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817088 00010000:00010000:0.0:1790771166.144154:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144164:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144176:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.144176:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5844 00010000:00010000:0.0:1790771166.144179:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.144188:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14657:x1877759533817088:12345-192.168.204.50@tcp:101:touch.0 00000001:00080000:2.0:1790771166.144196:0:6494:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968659 00010000:00010000:3.0:1790771166.144197:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.144207:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825280 00000004:00200000:0.0:1790771166.144208:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.144209:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c538 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3559d expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144214:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825280 00000004:00200000:0.0:1790771166.144216:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.144219:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045c3e30e reply state 00000000da1a62d6 transno 4294968660 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144232:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.144235:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144242:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771166.144246:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144247:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 965 00010000:00010000:3.0:1790771166.144247:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144248:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771166.144253:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.144267:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144267:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533825280:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.144269:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144282:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14447:x1877759533815936:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 17290us (17431us total) trans 4294968660 rc 0/0 00010000:00010000:1.0:1790771166.144287:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.144290:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144292:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5817 00010000:00010000:1.0:1790771166.144302:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c546 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35661 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.144306:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771166.144309:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.144315:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144322:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144323:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144342:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539737728:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.144345:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144347:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.144354:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.144358:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144359:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.144371:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629600 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.144377:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0c523 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144392:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144398:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144406:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144407:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.144415:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.144419:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144424:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144433:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc3607db00) 00000100:00100000:2.0:1790771166.144434:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533816960 00010000:00010000:0.0:1790771166.144435:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.144439:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533816960 00010000:00010000:0.0:1790771166.144440:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144446:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0c554 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144447:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c52a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144463:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0c554 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144470:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5845 00010000:00010000:3.0:1790771166.144475:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0c554 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.144482:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14782:x1877759533816960:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771166.144515:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1790771166.144516:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.144518:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c51c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 95 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.144520:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.144525:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c55b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35596 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.144532:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0c554 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144549:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144552:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 94 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144557:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144567:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144575:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771166.144576:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.144581:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.144585:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669600, rc 0) 00010000:00010000:3.0:1790771166.144587:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144589:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144601:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.144602:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144606:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144615:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.144617:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14619:x1877759533825152:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 674us (1011us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.144618:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.144632:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5843 00010000:00010000:2.0:1790771166.144633:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144642:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144687:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144695:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144703:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144709:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.144712:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.144715:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144720:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c53f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.144724:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 5134 00000004:00200000:2.0:1790771166.144728:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.144728:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144735:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.144737:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144743:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144748:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144749:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.144757:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144761:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144765:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144769:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058af600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.144771:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144775:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144780:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.144782:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.144784:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144791:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0c562 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144798:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144801:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144805:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144809:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058af400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.144811:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144815:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144823:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xcdd6ff3 (ffff8bfc310f2900) 00010000:00010000:3.0:1790771166.144823:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144829:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.144833:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144836:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144839:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0c569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144857:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c55b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 118 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144864:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 117 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.144869:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:2.0:1790771166.144871:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.144872:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aec00, rc 0) 00000100:00100000:2.0:1790771166.144900:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14782:x1877759533816960:12345-192.168.204.50@tcp:101:ln.0 Request processed in 423us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.144905:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5845 00010000:00010000:3.0:1790771166.144923:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xbc0ca3a9 (ffff8bfc08974300) 00010000:00010000:3.0:1790771166.144926:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.144930:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144935:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c54d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144962:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c538 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3559d expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144974:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57e00/0xfa0c505d97f0c554 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3559d expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144980:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.144982:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790771166.144984:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144989:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.144993:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57e00, rc 0) 00000100:00100000:1.0:1790771166.145005:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.145025:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14657:x1877759533817088:12345-192.168.204.50@tcp:101:touch.0 Request processed in 839us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.145036:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817216 00000100:00100000:0.0:1790771166.145041:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817216 00000100:00100000:0.0:1790771166.145069:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5846 00000100:00100000:0.0:1790771166.145078:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14660:x1877759533817216:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:3.0:1790771166.145082:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5844 00010000:00010000:0.0:1790771166.145090:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.145100:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c577 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355a4 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145127:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145135:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145141:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.145144:0:8676:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb size: 0 -> 11206656 00002000:00010000:2.0:1790771166.145149:0:8676:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.145152:0:8676:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime: 1790771165 -> 1790771166 00010000:00010000:0.0:1790771166.145155:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.145155:0:8676:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb blocks: 0 -> 1408 00000100:00100000:2.0:1790771166.145166:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539735936:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.145167:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.145168:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539736064:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.145185:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.145188:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0c3f6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [524288->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ff expref: 28 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.145193:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.145220:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b72d87/0xfa0c505d97f0c3f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [524288->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ff expref: 28 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.145229:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00010000:00010000:0.0:1790771166.145235:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145244:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145250:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.145258:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533820544:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 14857us (14930us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.145264:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 958 00000004:00200000:0.0:1790771166.145266:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.145270:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.145279:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145287:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145292:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145297:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145301:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145309:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.145312:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145316:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145322:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.145325:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.145327:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145331:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0c57e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145341:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.145345:0:13782:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb mtime: 1790771165 -> 1790771166 00010000:00010000:0.0:1790771166.145346:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.145350:0:13782:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb atime: 1752421453 -> 1790771161 00002000:00010000:2.0:1790771166.145356:0:13782:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb ctime: 1790771165 -> 1790771166 00010000:00010000:0.0:1790771166.145358:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145364:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.145366:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.145369:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13782:1877759539736192:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.145376:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145389:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfc3607d600) 00010000:00010000:2.0:1790771166.145390:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0c419 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->524287] (req 0->524287) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3560d expref: 30 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145394:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.145398:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145406:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0c585 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.145410:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0c419 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->524287] (req 0->524287) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3560d expref: 30 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.145419:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00010000:00010000:0.0:1790771166.145427:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c577 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 118 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145439:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 117 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.145445:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:2.0:1790771166.145446:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759533820800:12345-192.168.204.50@tcp:101:chown.0 Request processed in 14737us (14824us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.145450:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.145454:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391c00, rc 0) 00000100:00100000:2.0:1790771166.145458:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 959 00000100:00100000:0.0:1790771166.145481:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14660:x1877759533817216:12345-192.168.204.50@tcp:101:chown.0 Request processed in 405us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.145514:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5846 00000100:00100000:1.0:1790771166.147921:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.147950:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827200 00000100:00100000:2.0:1790771166.147956:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827200 00000100:00100000:1.0:1790771166.147963:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.147989:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817728 00000100:00100000:2.0:1790771166.147991:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817728 00000100:00100000:0.0:1790771166.148000:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5847 00000100:00100000:0.0:1790771166.148012:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:13883:x1877759533827200:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.148022:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.148030:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c593 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35692 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148061:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.148062:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5848 00010000:00010000:0.0:1790771166.148073:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.148079:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13263:x1877759533817728:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.148083:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148090:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.148096:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148101:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c5a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355b2 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148103:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148120:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148148:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.148160:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.148161:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148170:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148181:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148185:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148191:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148207:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148216:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148222:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148227:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.148231:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.148232:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.148238:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148246:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148253:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.148255:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.148257:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148262:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0c59a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148263:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148275:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148277:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148285:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148288:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148294:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.148298:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148299:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148309:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.148312:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148314:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148329:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148336:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.148338:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc1ae7f200) 00010000:00010000:3.0:1790771166.148339:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.148344:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.148344:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148347:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148353:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c5af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148356:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0c5a1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148364:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148371:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148375:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148380:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.148382:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c593 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35692 expref: 96 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148383:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148400:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148403:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.148408:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.148412:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0c593 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35692 expref: 96 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148413:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc08974a00) 00010000:00010000:3.0:1790771166.148418:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.148422:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.148426:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00010000:00010000:3.0:1790771166.148428:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c5bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148458:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c5a8 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355b2 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.148460:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:13883:x1877759533827200:12345-192.168.204.50@tcp:101:ls.0 Request processed in 450us (537us total) trans 4294968661 rc 301/301 00000100:00100000:0.0:1790771166.148476:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5847 00010000:00010000:3.0:1790771166.148476:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.148480:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.148517:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c5a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355b2 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.148525:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56200, rc 0) 00000100:00100000:3.0:1790771166.148548:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:13263:x1877759533817728:12345-192.168.204.50@tcp:101:ls.0 Request processed in 476us (586us total) trans 4294969253 rc 301/301 00000100:00100000:3.0:1790771166.148556:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5848 00000100:00100000:1.0:1790771166.148920:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.148953:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825792 00000100:00100000:0.0:1790771166.148958:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825792 00000100:00100000:1.0:1790771166.148981:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.148985:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 966 00000100:00100000:0.0:1790771166.148995:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:14608:x1877759533825792:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.149002:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.149005:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06190e00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539736448:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.149009:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817344 00010000:00010000:0.0:1790771166.149013:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3566f expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.149014:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817344 00010000:00010000:3.0:1790771166.149020:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.149026:0:12031:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size: 0 -> 10485760 00002000:00010000:2.0:1790771166.149031:0:12031:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.149035:0:12031:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb atime: 1752421453 -> 1790771161 00010000:00010000:0.0:1790771166.149036:0:13793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.149040:0:12031:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb ctime: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.149047:0:12031:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks: 0 -> 384 00000100:00100000:1.0:1790771166.149052:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5849 00010000:00010000:0.0:1790771166.149061:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xe:0x0].0x0 since=1s v=(1 4) 00000100:00100000:2.0:1790771166.149062:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539736320:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771166.149067:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14389:x1877759533817344:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.149069:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(2 4) 00010000:00010000:0.0:1790771166.149080:0:13793:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [28672->45055] (req 28672->45055) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 30 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149082:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.149089:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad094963/0xfa0c505d97f0c42e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3561b expref: 30 pid: 12031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149095:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c5d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355ab expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149103:0:13793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.149105:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad094963/0xfa0c505d97f0c42e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3561b expref: 30 pid: 12031 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149133:0:13793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 23 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.149139:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39600, rc 0) 00000100:00100000:0.0:1790771166.149148:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539737856:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.149152:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149165:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149176:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149178:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759533821056:12345-192.168.204.50@tcp:101:chown.0 Request processed in 18214us (18300us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.149194:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05321900 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.149194:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 960 00010000:00010000:1.0:1790771166.149206:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149216:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149223:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.149264:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.149266:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373800/0xfa0c505d97f0c5e7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x74:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149278:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373800/0xfa0c505d97f0c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.149285:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13787:1877759539736576:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.149289:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373800/0xfa0c505d97f0c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.149294:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533826176 00000100:00100000:0.0:1790771166.149299:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533826176 00010000:00010000:3.0:1790771166.149304:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a42aa73/0xfa0c505d97f0c482 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->524287] (req 0->524287) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355f8 expref: 28 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.149308:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x74:0x0]: returning size 8 00010000:00010000:3.0:1790771166.149322:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a42aa73/0xfa0c505d97f0c482 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->524287] (req 0->524287) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355f8 expref: 28 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.149325:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373800/0xfa0c505d97f0c5e7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.149335:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cae600, rc 0) 00000100:00100000:0.0:1790771166.149336:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5850 00010000:00010000:1.0:1790771166.149350:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.149351:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14432:x1877759533826176:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771166.149364:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149365:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.149372:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149375:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c5ee lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35684 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149377:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149389:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.149392:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149397:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149406:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771166.149408:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533820416:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 17737us (17821us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.149412:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149413:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.149413:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.149419:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.149425:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 961 00010000:00010000:1.0:1790771166.149437:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0c5d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149452:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149455:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149468:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149471:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149477:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149513:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.149516:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.149517:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149520:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149528:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149530:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149542:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149549:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xea196397 (ffff8bfb03218a00) 00010000:00010000:1.0:1790771166.149552:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.149556:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149562:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c5e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149581:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149589:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149591:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c5d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ab expref: 120 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149600:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149609:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373800/0xfa0c505d97f0c5e7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x74:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ab expref: 119 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149615:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x74:0x0].0x0 (ffff8bfb03218500) 00010000:00010000:1.0:1790771166.149617:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00200000:0.0:1790771166.149618:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.149619:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373800, rc 0) 00000004:00200000:0.0:1790771166.149623:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.149634:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149641:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149649:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149654:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149658:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.149662:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149685:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149695:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00000100:00100000:1.0:1790771166.149697:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539736832:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.149699:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.149705:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.149718:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0c5f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149729:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149735:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149735:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817600 00000100:00100000:2.0:1790771166.149742:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817600 00010000:00010000:1.0:1790771166.149743:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b93aab5/0xfa0c505d97f0c490 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [524288->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35614 expref: 26 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.149743:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539736704:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.149745:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149763:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.149768:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149769:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827584 00010000:00010000:3.0:1790771166.149770:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000744a2171/0xfa0c505d97f0c489 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35606 expref: 26 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149775:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827584 00010000:00010000:1.0:1790771166.149776:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b93aab5/0xfa0c505d97f0c490 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [524288->18446744073709551615] (req 524288->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35614 expref: 26 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149789:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.149797:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5851 00010000:00010000:3.0:1790771166.149803:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744a2171/0xfa0c505d97f0c489 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35606 expref: 26 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.149809:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372400, rc 0) 00010000:00010000:0.0:1790771166.149811:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfc1ae7f100) 00000100:00100000:2.0:1790771166.149814:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14390:x1877759533817600:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771166.149816:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73400, rc 0) 00010000:00010000:0.0:1790771166.149817:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.149823:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.149828:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.149829:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c5fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.149840:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0c60a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355b9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.149848:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533820928:12345-192.168.204.50@tcp:101:chown.0 Request processed in 17936us (18010us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.149850:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533820672:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 17951us (18051us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.149856:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c5ee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35684 expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.149871:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 963 00010000:00010000:0.0:1790771166.149876:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35684 expref: 123 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.149881:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 962 00010000:00010000:2.0:1790771166.149882:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149894:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:0.0:1790771166.149897:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.149899:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.149900:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81800, rc 0) 00000100:00100000:3.0:1790771166.149911:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5852 00010000:00010000:2.0:1790771166.149912:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.149920:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14389:x1877759533817344:12345-192.168.204.50@tcp:101:ln.0 Request processed in 853us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.149923:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13456:x1877759533827584:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:2.0:1790771166.149927:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.149931:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14432:x1877759533826176:12345-192.168.204.50@tcp:101:rm.0 Request processed in 582us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.149942:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5849 00010000:00010000:2.0:1790771166.149950:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.149953:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5850 00010000:00010000:2.0:1790771166.149962:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.149982:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533826432 00000100:00100000:1.0:1790771166.149987:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533826432 00000100:00100000:0.0:1790771166.149999:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539736960:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.150000:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150010:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.150015:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13456:x1877759533827584:12345-192.168.204.50@tcp:36:ln.0 Request processed in 92us (308us total) trans 0 rc -2/-2 00010000:00010000:0.0:1790771166.150017:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150020:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.150023:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1500 00000100:00100000:3.0:1790771166.150036:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5852 00000100:00100000:1.0:1790771166.150039:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:13888:x1877759533826432:12345-192.168.204.50@tcp:35:ls.0 00000004:00200000:2.0:1790771166.150056:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00000004:00200000:2.0:1790771166.150060:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.150070:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150077:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150084:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150089:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150094:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150103:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150108:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.150111:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150116:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150125:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.150129:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.150134:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150141:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0c611 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150153:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150161:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.150166:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:13888:x1877759533826432:12345-192.168.204.50@tcp:35:ls.0 Request processed in 128us (755us total) trans 4294968662 rc 0/0 00010000:00010000:2.0:1790771166.150174:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.150182:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1500 00010000:00010000:2.0:1790771166.150188:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aea00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.150193:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150201:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150208:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc310f2800) 00010000:00010000:2.0:1790771166.150210:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.150212:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150216:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0c618 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150237:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0c60a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355b9 expref: 121 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150249:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355b9 expref: 120 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150255:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.150257:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.150258:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4600, rc 0) 00000100:00100000:2.0:1790771166.150284:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14390:x1877759533817600:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 476us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.150290:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5851 00000100:00100000:3.0:1790771166.150480:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.150571:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827840 00000100:00100000:2.0:1790771166.150575:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827840 00000100:00100000:2.0:1790771166.150597:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5853 00000100:00100000:2.0:1790771166.150603:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14404:x1877759533827840:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771166.150623:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.150633:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97eff9cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30e31 expref: 122 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150641:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03146e00) 00010000:00010000:2.0:1790771166.150646:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.150653:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150659:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150664:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.150785:0:13769:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb05fffa80 with version 0 00010000:00010000:2.0:1790771166.150795:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150800:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150805:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150808:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.150810:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150814:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150823:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc310f2900) 00010000:00010000:2.0:1790771166.150825:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.150827:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.150831:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c626 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.150866:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14404:x1877759533827840:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 263us (386us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771166.150870:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5853 00000100:00100000:1.0:1790771166.151213:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.151233:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.151249:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533826944 00000100:00100000:2.0:1790771166.151253:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533826944 00000100:00100000:3.0:1790771166.151261:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827456 00000100:00100000:1.0:1790771166.151268:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.151268:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827456 00010000:00010000:2.0:1790771166.151273:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 99 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151287:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 122 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.151300:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827968 00000100:00100000:2.0:1790771166.151305:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827968 00000100:00100000:1.0:1790771166.151315:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.151320:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1605 00010000:00010000:2.0:1790771166.151321:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 120 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.151331:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1606 00000100:00100000:0.0:1790771166.151337:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:2397:x1877759533826944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.151347:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.151347:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2397:x1877759533827456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.151348:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.151357:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 99 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151361:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.151362:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1607 00010000:00010000:3.0:1790771166.151371:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 122 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.151379:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 99 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.151381:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2398:x1877759533827968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.151382:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.151398:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.151402:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 122 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.151406:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 120 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.151408:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f09e09 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34892 expref: 99 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151419:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.151435:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 120 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151437:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c22f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354fc expref: 122 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.151438:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc36078200) 00010000:00010000:0.0:1790771166.151447:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151450:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828224 00000100:00100000:1.0:1790771166.151458:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828224 00010000:00010000:2.0:1790771166.151464:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0a572 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b7f expref: 120 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.151467:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151469:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.151479:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.151481:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.151482:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000100:00100000:1.0:1790771166.151506:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828608 00010000:00010000:3.0:1790771166.151509:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151510:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828608 00010000:00010000:2.0:1790771166.151524:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151527:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.151535:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151536:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5854 00010000:00010000:0.0:1790771166.151538:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.151543:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.151548:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151552:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14732:x1877759533828224:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:3.0:1790771166.151553:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.151563:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:2397:x1877759533826944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 231us (348us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.151566:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.151571:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1605 00010000:00010000:2.0:1790771166.151575:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.151578:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c62d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356a0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.151582:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2397:x1877759533827456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.151597:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1606 00000100:00100000:2.0:1790771166.151603:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2398:x1877759533827968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 226us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.151610:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1607 00010000:00010000:1.0:1790771166.151630:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.151631:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5855 00010000:00010000:2.0:1790771166.151640:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.151644:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.151647:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14774:x1877759533828608:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:0.0:1790771166.151649:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828480 00000100:00100000:0.0:1790771166.151655:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828480 00010000:00010000:2.0:1790771166.151656:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151662:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.151685:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151688:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c63b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356a7 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.151695:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828736 00000100:00100000:0.0:1790771166.151700:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828736 00000100:00100000:0.0:1790771166.151721:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1501 00000004:00200000:1.0:1790771166.151721:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000001:00080000:2.0:1790771166.151721:0:13762:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969247 00000004:00200000:1.0:1790771166.151728:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.151730:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.151736:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13738:x1877759533828480:12345-192.168.204.50@tcp:35:ls.0 00000004:00010000:1.0:1790771166.151742:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151743:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.151748:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce06e744 reply state 00000000aa5dde10 transno 4294969254 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151765:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.151767:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.151777:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c62d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a0 expref: 100 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.151794:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.151796:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:2.0:1790771166.151799:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.151801:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.151804:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a0 expref: 99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.151816:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13738:x1877759533828480:12345-192.168.204.50@tcp:35:ls.0 Request processed in 82us (470us total) trans 4294968663 rc 0/0 00010000:00010000:1.0:1790771166.151819:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771166.151823:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:0.0:1790771166.151826:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1501 00010000:00010000:1.0:1790771166.151828:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35fff000, rc 0) 00000100:00100000:0.0:1790771166.151844:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1502 00000004:00200000:3.0:1790771166.151850:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.151851:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14763:x1877759533821312:12345-192.168.204.50@tcp:36:cp.0 Request processed in 19820us (19979us total) trans 4294969254 rc 0/0 00000100:00100000:0.0:1790771166.151856:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14015:x1877759533828736:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:1.0:1790771166.151863:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14732:x1877759533828224:12345-192.168.204.50@tcp:101:chown.0 Request processed in 311us (547us total) trans 0 rc 0/0 00000004:00010000:3.0:1790771166.151866:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.151867:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5834 00000020:00080000:2.0:1790771166.151874:0:13762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790771166.151886:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5854 00010000:00010000:3.0:1790771166.151894:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c63b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a7 expref: 100 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151907:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a7 expref: 98 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151913:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:3.0:1790771166.151915:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.151917:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72e00, rc 0) 00000100:00100000:3.0:1790771166.151938:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14774:x1877759533828608:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 298us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.151947:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5855 00000001:00080000:0.0:1790771166.151949:0:13790:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969255 00010000:00010000:3.0:1790771166.151967:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151974:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.151982:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.151992:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.151999:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.152002:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14015:x1877759533828736:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 149us (626us total) trans 4294969256 rc 0/0 00000100:00100000:0.0:1790771166.152014:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1502 00000020:00080000:0.0:1790771166.152018:0:13790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.152018:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828864 00000100:00100000:2.0:1790771166.152023:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828864 00000100:00100000:1.0:1790771166.152035:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.152046:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.152053:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828992 00000100:00100000:2.0:1790771166.152056:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828992 00000100:00100000:0.0:1790771166.152065:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5856 00000100:00100000:0.0:1790771166.152075:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14769:x1877759533828864:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771166.152082:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.152086:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.152090:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5857 00010000:00010000:0.0:1790771166.152095:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c650 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356ae expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.152103:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14687:x1877759533828992:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.152113:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.152125:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.152125:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c657 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356b5 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152131:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152148:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152160:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.152177:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.152185:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.152188:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.152190:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.152200:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533817856 00010000:00010000:2.0:1790771166.152201:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.152206:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533817856 00000004:00010000:0.0:1790771166.152208:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.152228:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 851968 00010000:00010000:0.0:1790771166.152233:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c650 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 102 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.152233:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5858 00000004:00200000:2.0:1790771166.152234:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.152247:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14695:x1877759533817856:12345-192.168.204.50@tcp:101:chown.0 00000004:00010000:2.0:1790771166.152248:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152253:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 101 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152262:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.152270:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:2.0:1790771166.152270:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152277:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.152279:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c66c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355c0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.152281:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80c00, rc 0) 00010000:00010000:2.0:1790771166.152294:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c657 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356b5 expref: 102 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.152307:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356b5 expref: 101 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.152314:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14769:x1877759533828864:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 237us (331us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.152317:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.152320:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.152324:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000004:00080000:3.0:1790771166.152327:0:13765:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x18:0x0], index 0: 0 00010000:00010000:2.0:1790771166.152329:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5a00, rc 0) 00000100:00100000:0.0:1790771166.152337:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5856 00010000:00010000:1.0:1790771166.152341:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152350:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.152359:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:14687:x1877759533828992:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 260us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.152367:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5857 00010000:00010000:1.0:1790771166.152369:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152376:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152383:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152415:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152421:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152427:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152432:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c688 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.152435:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00000100:00100000:0.0:1790771166.152441:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533829120 00010000:00010000:3.0:1790771166.152445:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c688 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.152446:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533829120 00000004:00010000:1.0:1790771166.152451:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152455:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c688 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152462:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152472:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.152478:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1503 00000100:00100000:0.0:1790771166.152527:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14563:x1877759533829120:12345-192.168.204.50@tcp:49:mkdir.0 00010000:00010000:1.0:1790771166.152535:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152545:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152545:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152564:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 2/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152566:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.152573:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152579:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152592:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04caee00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.152594:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14563:x1877759533829120:12345-192.168.204.50@tcp:49:mkdir.0 Request processed in 66us (505us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771166.152594:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152596:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.152614:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1503 00010000:00010000:3.0:1790771166.152616:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152624:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.152629:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.152629:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc36078200) 00010000:00010000:3.0:1790771166.152635:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.152638:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152638:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 2/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152655:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c47b lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152659:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c673 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.152664:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037156d9e reply state 00000000af1befd9 transno 4294968664 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152685:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152691:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152697:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152702:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.152706:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152713:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152727:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x18618557 (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.152735:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.152742:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152742:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152760:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0xf7a5b27a (ffff8bfc08974300) 00010000:00010000:1.0:1790771166.152763:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c67a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152763:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.152765:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.152785:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0c46d lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35549 expref: 101 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152799:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339400/0xfa0c505d97f0c66c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 121 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152802:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c688 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35549 expref: 100 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.152818:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x73:0x0].0x0 (ffff8bfc08974f00) 00010000:00010000:3.0:1790771166.152820:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.152822:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00010000:00010000:1.0:1790771166.152824:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 120 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.152831:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:1.0:1790771166.152833:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.152836:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105400, rc 0) 00000100:00100000:3.0:1790771166.152852:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14487:x1877759533814528:12345-192.168.204.50@tcp:101:touch.0 Request processed in 21657us (21720us total) trans 4294968664 rc 0/0 00000100:00100000:3.0:1790771166.152863:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5832 00000100:00100000:1.0:1790771166.152865:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14695:x1877759533817856:12345-192.168.204.50@tcp:101:chown.0 Request processed in 617us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.152877:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5858 00000100:00100000:2.0:1790771166.156456:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.156548:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533829632 00000100:00100000:1.0:1790771166.156554:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533829632 00000100:00100000:1.0:1790771166.156585:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5859 00000100:00100000:1.0:1790771166.156591:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:11970:x1877759533829632:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.156602:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.156611:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c696 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356bc expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156651:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156663:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156686:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156701:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156709:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156717:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.156769:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.156801:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156807:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156811:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156815:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.156817:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156825:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156832:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.156834:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.156836:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156840:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c69d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156847:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156851:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156855:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156858:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.156861:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156867:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156874:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.156876:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.156879:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156886:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c6a4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156915:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c696 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356bc expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156925:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.156927:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.156930:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c696 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356bc expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.156936:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105600, rc 0) 00000100:00100000:1.0:1790771166.156965:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:11970:x1877759533829632:12345-192.168.204.50@tcp:101:ls.0 Request processed in 375us (513us total) trans 4294968665 rc 301/301 00000100:00100000:1.0:1790771166.156970:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5859 00000100:00100000:0.0:1790771166.157225:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.157247:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.157267:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533829760 00000100:00100000:2.0:1790771166.157272:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533829760 00000100:00100000:0.0:1790771166.157281:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.157282:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533830144 00000100:00100000:1.0:1790771166.157288:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533830144 00000100:00100000:2.0:1790771166.157308:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533818112 00000100:00100000:2.0:1790771166.157313:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533818112 00000100:00100000:1.0:1790771166.157329:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5860 00000100:00100000:0.0:1790771166.157330:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.157348:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5861 00000100:00100000:1.0:1790771166.157349:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:12016:x1877759533829760:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.157358:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5862 00010000:00010000:1.0:1790771166.157360:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.157367:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14349:x1877759533830144:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:0.0:1790771166.157371:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.157371:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356c3 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.157373:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14286:x1877759533818112:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771166.157390:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.157398:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 103 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157402:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c6b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355c7 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.157407:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.157421:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157426:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 103 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.157436:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533818624 00010000:00010000:1.0:1790771166.157437:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.157438:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.157441:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533818624 00010000:00010000:1.0:1790771166.157444:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.157445:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157449:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104200, rc 0) 00010000:00010000:3.0:1790771166.157460:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157464:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.157467:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533831296 00000100:00100000:0.0:1790771166.157472:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533831296 00010000:00010000:3.0:1790771166.157473:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 103 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157481:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157510:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 103 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.157516:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:12016:x1877759533829760:12345-192.168.204.50@tcp:101:ls.0 Request processed in 140us (255us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.157519:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 103 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157521:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.157525:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5863 00000100:00100000:1.0:1790771166.157539:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5860 00000100:00100000:0.0:1790771166.157541:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:12123:x1877759533818624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.157544:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157558:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.157562:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5864 00010000:00010000:3.0:1790771166.157563:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 8/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157566:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157571:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c6d5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355ce expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.157577:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14001:x1877759533831296:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.157593:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.157600:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 102 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157605:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c6dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356f4 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157611:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 102 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157617:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157622:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.157626:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539737984:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.157629:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157636:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157640:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157642:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157647:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157681:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157685:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157694:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 102 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157697:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157699:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.157701:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 47456 00000004:00200000:2.0:1790771166.157711:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.157713:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 102 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.157730:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.157736:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533830784 00010000:00010000:0.0:1790771166.157742:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.157742:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738112:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.157743:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533830784 00010000:00010000:2.0:1790771166.157750:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157768:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157773:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.157777:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 967 00010000:00010000:0.0:1790771166.157779:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157787:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 102 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157788:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.157791:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:13210:x1877759533830784:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771166.157796:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157807:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.157811:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.157819:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356df expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157821:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157822:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157826:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 102 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157850:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.157851:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.157856:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738240:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.157859:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 19 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157878:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157881:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.157885:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 26 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157889:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.157894:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 102 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157898:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157898:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157911:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 2 to [0x2c0000401:0x14:0x0].0x0 since=1s v=(14 1) 00010000:00010000:1.0:1790771166.157924:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(16 1) 00010000:00010000:2.0:1790771166.157925:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c6c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157926:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 102 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157927:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157934:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356df expref: 26 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157952:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157953:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.157959:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738368:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.157973:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.157974:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157977:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.157980:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 26 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.157993:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.157993:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 102 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.157998:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.158015:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.158017:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.158024:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158027:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.158027:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 102 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158034:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.158041:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.158046:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539738496:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.158046:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158063:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c6e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.158065:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce5880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738624:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.158068:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xdcc87686 (ffff8bfc310f2900) 00010000:00010000:2.0:1790771166.158075:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.158079:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158081:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.158088:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c6ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158091:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.158093:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 19 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.158106:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35180 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.158114:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.158120:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 19 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158123:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.158128:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c6b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 124 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158129:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158153:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.158157:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539738752:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.158163:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf7a5b27a (ffff8bfc1ae7f100) 00010000:00010000:2.0:1790771166.158164:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 123 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158169:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.158173:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.158177:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00000100:00100000:1.0:1790771166.158181:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.158181:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.158182:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c6f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.158187:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00010000:00010000:0.0:1790771166.158221:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0c6d5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ce expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.158223:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14286:x1877759533818112:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 855us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.158238:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5862 00010000:00010000:0.0:1790771166.158243:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ce expref: 123 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.158251:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:0.0:1790771166.158255:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.158258:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80400, rc 0) 00000100:00100000:0.0:1790771166.158290:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:12123:x1877759533818624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 753us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.158299:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5863 00000100:00100000:2.0:1790771166.162602:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790771166.162616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539738880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790771166.162650:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.162699:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539738880 00000100:00100000:0.0:1790771166.162704:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539738880 00000100:00100000:0.0:1790771166.162735:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1790771166.162741:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1877759539738880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1790771166.162762:0:6498:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446121472 avail 1299881984 00000100:00100000:0.0:1790771166.162798:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3625:x1877759539738880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.162805:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1790771166.162834:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539738880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790771166.182859:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.182888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.182910:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.182912:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533829888 00000100:00100000:3.0:1790771166.182921:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533829888 00000100:00100000:1.0:1790771166.182932:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533832320 00000100:00100000:0.0:1790771166.182937:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.182939:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533832320 00000100:00100000:2.0:1790771166.182962:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533832448 00000100:00100000:3.0:1790771166.182968:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533818880 00000100:00100000:2.0:1790771166.182969:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533832448 00000100:00100000:0.0:1790771166.182972:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.182975:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533818880 00000100:00100000:1.0:1790771166.182985:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1504 00000100:00100000:1.0:1790771166.183000:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:13883:x1877759533832320:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.183015:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1505 00000100:00100000:3.0:1790771166.183020:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533819008 00000100:00100000:3.0:1790771166.183023:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533819008 00000100:00100000:2.0:1790771166.183028:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08478850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11865:x1877759533832448:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.183058:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5865 00000100:00100000:3.0:1790771166.183068:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14805:x1877759533829888:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771166.183080:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.183098:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c70d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356ca expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.183130:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.183148:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.183153:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183167:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.183168:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183183:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183203:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13883:x1877759533832320:12345-192.168.204.50@tcp:35:ls.0 Request processed in 207us (311us total) trans 4294968666 rc 0/0 00000100:00100000:2.0:1790771166.183209:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08478850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:11865:x1877759533832448:12345-192.168.204.50@tcp:35:ls.0 Request processed in 179us (291us total) trans 4294969257 rc 0/0 00000100:00100000:0.0:1790771166.183213:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:3.0:1790771166.183219:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.183221:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1504 00000004:00200000:3.0:1790771166.183226:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.183231:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1505 00000004:00010000:3.0:1790771166.183243:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183266:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0c70d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 106 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183274:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539737088:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.183284:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 105 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.183290:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833088 00000100:00100000:0.0:1790771166.183297:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.183297:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833088 00010000:00010000:3.0:1790771166.183298:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.183304:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.183307:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183308:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72000, rc 0) 00010000:00010000:2.0:1790771166.183320:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183327:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00000100:00100000:0.0:1790771166.183328:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834240 00000100:00100000:0.0:1790771166.183335:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834240 00000100:00100000:3.0:1790771166.183339:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14805:x1877759533829888:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 272us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.183348:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833600 00000100:00100000:3.0:1790771166.183348:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5865 00000100:00100000:2.0:1790771166.183353:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833600 00000100:00100000:1.0:1790771166.183362:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14077:x1877759533823616:12345-192.168.204.50@tcp:101:cat.0 Request processed in 40245us (40539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.183366:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821184 00000100:00100000:1.0:1790771166.183371:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 964 00000100:00100000:3.0:1790771166.183372:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821184 00010000:00010000:2.0:1790771166.183373:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 100 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183377:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1506 00000100:00100000:0.0:1790771166.183393:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:13693:x1877759533834240:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:3.0:1790771166.183406:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834112 00000100:00100000:2.0:1790771166.183408:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833344 00000100:00100000:3.0:1790771166.183410:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834112 00000100:00100000:2.0:1790771166.183414:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833344 00002000:00010000:1.0:1790771166.183421:0:8406:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime: 1752421453 -> 1790771165 00010000:00010000:2.0:1790771166.183434:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 106 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.183436:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.183438:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539737728:192.168.204.50@tcp:106: 00000004:00200000:0.0:1790771166.183444:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.183445:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5866 00000100:00100000:3.0:1790771166.183464:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14527:x1877759533818880:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:1.0:1790771166.183470:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c546 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35661 expref: 27 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.183475:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1608 00010000:00010000:3.0:1790771166.183478:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.183514:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13693:x1877759533834240:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.183519:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533833088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.183530:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1506 00010000:00010000:1.0:1790771166.183530:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c546 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35661 expref: 27 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183537:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.183538:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0c71b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355d5 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183544:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00002000:00010000:2.0:1790771166.183547:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 24 -> 8216 00010000:00010000:2.0:1790771166.183558:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183568:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183572:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533825280:12345-192.168.204.50@tcp:101:cp.0 Request processed in 39310us (39400us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771166.183584:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183585:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.183591:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 965 00010000:00010000:2.0:1790771166.183597:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a46094/0xfa0c505d97f0a595 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b24 expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183603:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183611:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(8 1) 00010000:00010000:3.0:1790771166.183612:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183617:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(8 1) 00000100:00100000:1.0:1790771166.183624:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1609 00010000:00010000:2.0:1790771166.183626:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b39 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183629:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183637:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:2399:x1877759533833600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.183645:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b39 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183651:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183653:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.183662:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 100 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183663:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183693:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000093aa0343/0xfa0c505d97f0a5b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b39 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183698:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 100 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183719:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:2.0:1790771166.183719:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb61880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539739008:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.183727:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183728:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834496 00000100:00100000:0.0:1790771166.183734:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834496 00010000:00010000:1.0:1790771166.183741:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183747:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.183749:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183757:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183765:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.183767:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5867 00000100:00100000:1.0:1790771166.183779:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:2399:x1877759533833600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 146us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.183781:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14718:x1877759533819008:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:1.0:1790771166.183793:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1609 00010000:00010000:0.0:1790771166.183795:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.183796:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fff540 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.183808:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c737 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e355dc expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183815:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1610 00000100:00100000:1.0:1790771166.183827:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2399:x1877759533833344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.183836:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.183843:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 105 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.183847:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.183858:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5868 00010000:00010000:1.0:1790771166.183861:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 105 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.183863:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.183875:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14519:x1877759533821184:12345-192.168.204.50@tcp:101:chmod.0 00000004:00200000:3.0:1790771166.183877:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x85:0x0]: returning size 38336 00000004:00200000:3.0:1790771166.183886:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.183892:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:2.0:1790771166.183895:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.183896:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183897:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.183900:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.183911:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0c745 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35622 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183920:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.183928:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183929:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183942:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183951:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.183953:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.183963:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.183963:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.183964:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.183968:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.183989:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2399:x1877759533833344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.183997:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1610 00010000:00010000:0.0:1790771166.184015:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184023:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184028:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184045:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c386 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ea expref: 104 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.184046:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 14680064 00000004:00200000:0.0:1790771166.184053:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.184059:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184061:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.184065:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184085:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539737216:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.184087:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184089:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184090:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04caee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.184098:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184099:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0a962 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c58 expref: 99 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184111:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184116:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184135:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539737472:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.184138:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184142:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184155:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184158:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184159:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184160:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184168:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184181:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.184188:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184192:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184193:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.184195:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184202:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.184209:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184220:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184225:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184226:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184226:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0c722 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184246:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184265:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184266:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184270:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.184280:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.184282:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184285:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184289:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184303:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.184304:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.184306:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184307:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.184309:0:13761:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968667 00010000:00010000:2.0:1790771166.184309:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184331:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80e00/0xfa0c505d97f0c73e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184332:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184333:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.184334:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001030d39d reply state 00000000d291c1d8 transno 4294968668 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184360:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184363:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc08974a00) 00010000:00010000:2.0:1790771166.184364:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.184366:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184367:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771166.184369:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.184371:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.184374:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184376:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.184377:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184381:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.184389:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184395:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0c729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184401:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184411:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184413:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14504:x1877759533824384:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 40752us (40973us total) trans 4294968668 rc 0/0 00010000:00010000:2.0:1790771166.184422:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c753 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184434:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.184434:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5840 00010000:00010000:3.0:1790771166.184435:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0c71b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355d5 expref: 130 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184442:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.184443:0:13761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.184444:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184456:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355d5 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184462:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184463:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5869 00010000:00010000:2.0:1790771166.184464:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184478:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14688:x1877759533834112:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.184508:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771166.184512:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184516:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.184517:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x61bf1dfb (ffff8bfc1ae7f100) 00010000:00010000:3.0:1790771166.184521:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00010000:00010000:0.0:1790771166.184525:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.184530:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.184531:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184536:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184540:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0c74c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184544:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.184547:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.184553:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14527:x1877759533818880:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 1092us (1614us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.184558:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc310f2900) 00010000:00010000:2.0:1790771166.184565:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.184566:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 130 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184568:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0c737 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355dc expref: 130 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184570:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.184571:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5866 00000100:00100000:3.0:1790771166.184593:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5870 00010000:00010000:1.0:1790771166.184594:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184594:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184601:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355dc expref: 128 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.184608:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14664:x1877759533834496:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.184622:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:0.0:1790771166.184625:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.184627:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ec00, rc 0) 00010000:00010000:1.0:1790771166.184632:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 128 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184635:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.184637:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0c745 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35622 expref: 128 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184653:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0a970 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c5f expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.184656:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14718:x1877759533819008:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 873us (1683us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.184656:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184656:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.184680:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.184685:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184689:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00000100:00100000:0.0:1790771166.184695:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5867 00010000:00010000:3.0:1790771166.184698:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.184704:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539739136:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.184709:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0c745 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35622 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184712:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184726:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00010000:00010000:3.0:1790771166.184727:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184738:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 125 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.184744:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 5/0,1 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.184746:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629600 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.184759:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14519:x1877759533821184:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 889us (1607us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.184766:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5868 00010000:00010000:3.0:1790771166.184770:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 125 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.184772:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539737856:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.184787:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 124 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.184797:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539739264:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.184802:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [28672->45055] (req 28672->45055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 23 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.184814:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fa00, rc 0) 00000100:00100000:1.0:1790771166.184821:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.184829:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4000 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539737344:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.184841:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:14608:x1877759533825792:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 35846us (35921us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.184845:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.184847:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533830528 00000100:00100000:0.0:1790771166.184853:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 966 00000100:00100000:2.0:1790771166.184854:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533830528 00010000:00010000:3.0:1790771166.184865:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 126 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.184875:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94e680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539739392:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.184883:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 968 00000100:00100000:0.0:1790771166.184894:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533830528:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.184900:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.184904:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.184908:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce4700 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539737600:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.184912:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e355cb70/0xfa0c505d97f0c776 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356d8 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.184934:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.184948:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539739520:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.184978:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.185334:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.185370:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833472 00000100:00100000:0.0:1790771166.185371:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.185376:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833472 00010000:00010000:2.0:1790771166.185391:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 125 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.185411:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834624 00000100:00100000:1.0:1790771166.185417:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834624 00000100:00100000:2.0:1790771166.185421:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1611 00000100:00100000:2.0:1790771166.185429:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2396:x1877759533833472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.185437:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.185441:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 125 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.185447:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xe:0x0] (24576->47793) req@ffff8bfb0552fb80 x1877759533834624/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.185452:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 125 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.185468:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552fb80 with x1877759533834624 ext(24576->47793) 00010000:00010000:1.0:1790771166.185476:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.185477:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0c3da lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35581 expref: 125 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.185521:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.185526:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.185528:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.185546:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb0552fb80 00010000:00010000:2.0:1790771166.185547:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.185553:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.185569:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:1.0:1790771166.185582:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533834624:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:2.0:1790771166.185582:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2396:x1877759533833472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.185596:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1611 00000100:00100000:0.0:1790771166.185930:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.185954:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833216 00000100:00100000:3.0:1790771166.185958:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833216 00010000:00010000:3.0:1790771166.185973:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.185994:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1612 00000100:00100000:3.0:1790771166.186002:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533833216:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.186009:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.186017:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.186029:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.186040:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d3267e7/0xfa0c505d97f07adf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33c9f expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.186048:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(4 8) 00010000:00010000:3.0:1790771166.186051:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(4 8) 00010000:00010000:3.0:1790771166.186055:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.186060:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.186077:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.186084:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539739648:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.186129:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35600 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.194940:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.194962:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.194980:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.195000:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833728 00000100:00100000:2.0:1790771166.195006:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833728 00000100:00100000:1.0:1790771166.195024:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834880 00000100:00100000:3.0:1790771166.195025:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835008 00010000:00010000:2.0:1790771166.195026:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 127 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.195032:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834880 00000100:00100000:3.0:1790771166.195033:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835008 00000100:00100000:2.0:1790771166.195064:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1613 00000100:00100000:2.0:1790771166.195075:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759533833728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.195081:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1507 00000100:00100000:1.0:1790771166.195082:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5871 00010000:00010000:2.0:1790771166.195085:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.195092:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 128 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.195100:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14008:x1877759533835008:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.195102:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14540:x1877759533834880:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771166.195111:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 128 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.195124:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0c21a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354ee expref: 128 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.195134:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.195137:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.195144:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.195148:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.195150:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.195171:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.195180:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 124 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.195182:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.195187:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 5/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.195201:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.195213:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.195213:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 124 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.195214:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759533833728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.195227:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14008:x1877759533835008:12345-192.168.204.50@tcp:35:ls.0 Request processed in 132us (241us total) trans 4294969258 rc 0/0 00000100:00100000:2.0:1790771166.195237:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1613 00000100:00100000:3.0:1790771166.195251:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1507 00010000:00010000:1.0:1790771166.195260:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 124 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.195271:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539739776:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.195316:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 126 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.195325:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 126 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.195333:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539739904:192.168.204.50@tcp:104: 00000004:00010000:0.0:1790771166.195342:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070718c96 reply state 0000000089ad17ed transno 4294969259 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.195357:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.195360:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08545c00 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.195369:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.195372:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.195375:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.195406:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14662:x1877759533825024:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 51675us (51840us total) trans 4294969259 rc 0/0 00000100:00100000:0.0:1790771166.195412:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5842 00000100:00100000:0.0:1790771166.197344:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.197387:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836672 00000100:00100000:1.0:1790771166.197392:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836672 00000100:00100000:1.0:1790771166.197422:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5872 00000100:00100000:1.0:1790771166.197428:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14432:x1877759533836672:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771166.197437:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.197446:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c784 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35717 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.197513:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.197559:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c784 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35717 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.197568:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:1.0:1790771166.197570:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.197573:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c784 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35717 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.197580:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105000, rc 0) 00000100:00100000:1.0:1790771166.197607:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14432:x1877759533836672:12345-192.168.204.50@tcp:101:rm.0 Request processed in 180us (265us total) trans 4294969260 rc 301/301 00000100:00100000:1.0:1790771166.197613:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5872 00000100:00100000:3.0:1790771166.208897:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.208923:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.208945:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.208957:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835136 00000100:00100000:0.0:1790771166.208964:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835136 00000100:00100000:2.0:1790771166.208965:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533826816 00000100:00100000:3.0:1790771166.208970:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.208973:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533826816 00000100:00100000:1.0:1790771166.208981:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533827328 00000100:00100000:1.0:1790771166.208987:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533827328 00000100:00100000:3.0:1790771166.209002:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:0.0:1790771166.209003:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (503808->507903) req@ffff8bfc3f94ed80 x1877759533835136/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.209009:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 129 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.209014:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835392 00000100:00100000:2.0:1790771166.209020:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835392 00002000:00100000:0.0:1790771166.209026:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f94ed80 with x1877759533835136 ext(503808->507903) 00000100:00100000:3.0:1790771166.209032:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771166.209033:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f94ed80 00010000:00010000:2.0:1790771166.209040:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.209056:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 778 00000100:00100000:0.0:1790771166.209063:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 399 00000100:00100000:1.0:1790771166.209069:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759533826816:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.209076:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533835136:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.209080:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.209081:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1614 00000100:00100000:3.0:1790771166.209091:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1615 00000100:00100000:2.0:1790771166.209097:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759533827328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.209101:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0c420 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354e7 expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209108:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.209109:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2396:x1877759533835392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.209118:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 129 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209126:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.209129:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:2.0:1790771166.209131:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 128 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209136:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209137:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.209157:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0c228 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354f5 expref: 128 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209159:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209175:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:1.0:1790771166.209176:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759533826816:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (248us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.209183:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.209190:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 778 00010000:00010000:3.0:1790771166.209191:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0c148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354a8 expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209198:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209210:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.209211:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533835136:12345-192.168.204.50@tcp:3:cat.0 Request processed in 138us (314us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.209216:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.209227:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209227:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.209228:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 399 00000100:00100000:1.0:1790771166.209233:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836160 00002000:00100000:0.0:1790771166.209240:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (503808->507903) req@ffff8bfc3f94ed80 x1877759533835136/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771166.209240:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836160 00010000:00010000:2.0:1790771166.209250:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209251:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.209266:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1508 00010000:00010000:2.0:1790771166.209274:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209274:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.209281:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14007:x1877759533836160:12345-192.168.204.50@tcp:35:ls.0 00002000:00100000:0.0:1790771166.209301:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f94ed80 with x1877759533835136 ext(503808->507903) 00002000:00010000:0.0:1790771166.209305:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f94ed80 00010000:00010000:2.0:1790771166.209316:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.209323:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.209329:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209337:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.209343:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759533827328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 249us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.209354:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1614 00000100:00100000:3.0:1790771166.209354:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2396:x1877759533835392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 249us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.209365:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1615 00000100:00100000:2.0:1790771166.209389:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836032 00000100:00100000:2.0:1790771166.209393:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836032 00010000:00010000:3.0:1790771166.209413:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209419:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.209429:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5873 00010000:00010000:1.0:1790771166.209433:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209436:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.209441:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14844:x1877759533836032:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771166.209446:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209458:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.209460:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209461:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209469:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c799 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35764 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209470:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.209477:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209532:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209544:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.209545:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209551:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.209555:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209564:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.209568:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14007:x1877759533836160:12345-192.168.204.50@tcp:35:ls.0 Request processed in 288us (537us total) trans 4294969261 rc 0/0 00010000:00010000:2.0:1790771166.209573:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209574:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.209580:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1508 00010000:00010000:1.0:1790771166.209596:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209599:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209604:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209610:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209611:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209629:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209634:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209635:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209641:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209647:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209656:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209694:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209696:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209706:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104e00/0xfa0c505d97f0c24b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209709:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209720:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209728:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209734:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.209737:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.209741:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.209750:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14369:x1877759533811968:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 128008us (128298us total) trans 0 rc -61/-61 00000004:00200000:2.0:1790771166.209753:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000004:00010000:0.0:1790771166.209755:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.209759:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.209760:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5808 00000004:00010000:2.0:1790771166.209774:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209784:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c6dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209785:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209799:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209813:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 128 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209818:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209820:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209832:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.209840:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.209842:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209844:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339a00, rc 0) 00010000:00010000:2.0:1790771166.209850:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209856:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79000 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:3.0:1790771166.209858:0:12128:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x25:0x0], index 0: 0 00000004:00200000:1.0:1790771166.209859:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.209859:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.209870:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14001:x1877759533831296:12345-192.168.204.50@tcp:101:ls.0 Request processed in 52296us (52467us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.209872:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.209875:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.209892:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5864 00010000:00010000:2.0:1790771166.209894:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000004:00010000:1.0:1790771166.209895:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209899:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.209905:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209911:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209922:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0c324 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3557a expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209922:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209924:0:13773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209946:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.209947:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209951:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3557a expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.209962:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c7b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.209969:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209977:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000004:00200000:0.0:1790771166.209982:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.209985:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00200000:0.0:1790771166.209987:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.209988:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.209990:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00030200, rc 0) 00010000:00010000:2.0:1790771166.209990:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.209998:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.209999:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210002:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.210018:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.210019:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14004:x1877759533816064:12345-192.168.204.50@tcp:101:ls.0 Request processed in 83010us (83133us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.210033:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c4e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35645 expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.210037:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5818 00010000:00010000:2.0:1790771166.210038:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc310f2900) 00010000:00010000:2.0:1790771166.210046:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.210047:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.210050:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.210058:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35645 expref: 127 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.210069:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210072:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.210076:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.210083:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.210088:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596400, rc 0) 00010000:00010000:3.0:1790771166.210093:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210100:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.210104:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.210110:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c799 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 128 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210113:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.210118:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14003:x1877759533823360:12345-192.168.204.50@tcp:101:ls.0 Request processed in 66877us (67398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.210135:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5838 00010000:00010000:3.0:1790771166.210139:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.210140:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210145:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.210151:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.210153:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:2.0:1790771166.210159:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.210163:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79e00, rc 0) 00010000:00010000:3.0:1790771166.210166:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c404 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.210183:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003e531318 reply state 000000001cb17aee transno 4294969262 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210195:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.210196:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14844:x1877759533836032:12345-192.168.204.50@tcp:101:ln.0 Request processed in 759us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.210212:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5873 00010000:00010000:3.0:1790771166.210213:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc08974a00) 00010000:00010000:3.0:1790771166.210217:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.210292:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.210312:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c3e8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354b6 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210323:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354b6 expref: 125 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.210328:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974400) 00010000:00010000:3.0:1790771166.210330:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.210332:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596c00, rc 0) 00000100:00100000:3.0:1790771166.210392:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14096:x1877759533809280:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 80021us (80102us total) trans 4294969262 rc 0/0 00000100:00100000:3.0:1790771166.210398:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5828 00000100:00100000:1.0:1790771166.220176:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.220235:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533832832 00000100:00100000:2.0:1790771166.220243:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533832832 00000100:00100000:2.0:1790771166.220287:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5874 00000100:00100000:2.0:1790771166.220298:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13887:x1877759533832832:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.220317:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.220331:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35725 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220373:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220382:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220389:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220397:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220402:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220406:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.220463:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.220528:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220537:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220549:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220556:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.220559:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220567:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220578:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.220581:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.220585:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220590:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c7ca lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220598:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220602:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220606:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220610:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.220612:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220618:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220623:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc310f2900) 00010000:00010000:2.0:1790771166.220625:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.220627:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220630:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c7d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220661:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7c3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35725 expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220688:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.220691:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.220695:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35725 expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.220703:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79400, rc 0) 00000100:00100000:2.0:1790771166.220738:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13887:x1877759533832832:12345-192.168.204.50@tcp:101:ls.0 Request processed in 442us (563us total) trans 4294968669 rc 301/301 00000100:00100000:2.0:1790771166.220745:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5874 00000100:00100000:0.0:1790771166.225932:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.225955:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.225988:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836544 00000100:00100000:3.0:1790771166.225994:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836544 00000100:00100000:0.0:1790771166.226010:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.226014:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836800 00000100:00100000:1.0:1790771166.226021:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836800 00000100:00100000:3.0:1790771166.226037:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5875 00000100:00100000:0.0:1790771166.226039:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.226051:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13742:x1877759533836544:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.226057:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837056 00000100:00100000:2.0:1790771166.226064:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837056 00000100:00100000:0.0:1790771166.226067:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837184 00000100:00100000:1.0:1790771166.226067:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 969 00000100:00100000:0.0:1790771166.226074:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837184 00000100:00100000:1.0:1790771166.226080:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+20:14763:x1877759533836800:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.226090:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.226102:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35779 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226102:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.226111:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1509 00000100:00100000:0.0:1790771166.226116:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 779 00010000:00010000:3.0:1790771166.226117:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35772 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.226127:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13666:x1877759533837056:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.226133:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533837184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.226133:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226147:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 127 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226151:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.226153:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c:0x0].0x0 since=1s v=(5 1) 00010000:00010000:1.0:1790771166.226164:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(6 1) 00010000:00010000:0.0:1790771166.226166:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c634 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a0 expref: 107 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226174:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 127 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.226176:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 21 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226186:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.226193:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.226199:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc08974800) 00010000:00010000:3.0:1790771166.226205:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.226209:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596800, rc 0) 00000100:00100000:0.0:1790771166.226222:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:2396:x1877759533837184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.226231:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 779 00010000:00010000:1.0:1790771166.226232:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.226245:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:13666:x1877759533837056:12345-192.168.204.50@tcp:35:ls.0 Request processed in 120us (232us total) trans 4294968670 rc 0/0 00010000:00010000:1.0:1790771166.226246:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 24 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.226253:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13742:x1877759533836544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 204us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.226268:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1509 00000100:00100000:3.0:1790771166.226273:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5875 00000100:00100000:1.0:1790771166.226278:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04972d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539740032:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.226325:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce7800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539737984:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.226340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.226358:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10429840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.226382:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837440 00000100:00100000:1.0:1790771166.226387:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837440 00010000:00010000:1.0:1790771166.226407:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 106 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.226411:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.226418:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.226440:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837696 00000100:00100000:3.0:1790771166.226445:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837696 00000100:00100000:1.0:1790771166.226447:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1616 00000100:00100000:1.0:1790771166.226457:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533837440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.226466:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.226471:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 107 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226515:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.226519:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 107 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.226535:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5876 00010000:00010000:1.0:1790771166.226536:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c187 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354c4 expref: 107 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.226553:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:2.0:1790771166.226554:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14774:x1877759533837696:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771166.226560:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226569:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.226570:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.226574:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738240:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.226585:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1790771166.226600:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837824 00000100:00100000:3.0:1790771166.226606:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837824 00000100:00100000:1.0:1790771166.226607:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:2396:x1877759533837440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 147us (264us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.226608:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0c642 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356a7 expref: 106 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226623:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 107 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.226629:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1616 00010000:00010000:2.0:1790771166.226644:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f07043 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e338e7 expref: 106 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.226657:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837952 00010000:00010000:2.0:1790771166.226661:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00000100:00100000:1.0:1790771166.226679:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837952 00000100:00100000:0.0:1790771166.226680:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.226680:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1617 00010000:00010000:2.0:1790771166.226682:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.226697:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2396:x1877759533837824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.226703:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 105 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.226706:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226726:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.226730:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.226737:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 105 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.226743:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 5/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.226748:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838208 00000100:00100000:1.0:1790771166.226753:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838208 00010000:00010000:3.0:1790771166.226761:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.226766:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 106 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226770:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 106 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.226773:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 106 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226792:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838464 00010000:00010000:2.0:1790771166.226797:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 106 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.226799:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838464 00010000:00010000:3.0:1790771166.226804:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 106 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.226817:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539740160:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.226818:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1618 00010000:00010000:3.0:1790771166.226824:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0bcc5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35390 expref: 107 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.226836:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:2396:x1877759533837952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.226836:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.226837:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5877 00010000:00010000:3.0:1790771166.226846:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.226853:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.226854:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14487:x1877759533838464:12345-192.168.204.50@tcp:36:touch.0 00010000:00010000:3.0:1790771166.226856:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.226864:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 106 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.226874:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226881:0:13774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.226882:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 106 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.226885:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:2396:x1877759533837824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 190us (400us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.226887:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 99 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226897:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0c688 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35549 expref: 106 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.226906:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1617 00000100:00100000:2.0:1790771166.226924:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539740288:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.226927:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0bcb0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35382 expref: 104 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226929:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x73:0x0].0x0 (ffff8bfc08974f00) 00000100:00100000:3.0:1790771166.226933:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1619 00010000:00010000:0.0:1790771166.226942:0:13774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.226948:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:2396:x1877759533838208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.226949:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.226955:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226959:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.226961:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.226963:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05ffff00 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.226967:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 103 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226978:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 103 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.226980:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x73:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.226994:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:2396:x1877759533837952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 162us (424us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.226995:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.226995:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.227004:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227009:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.227013:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1618 00010000:00010000:0.0:1790771166.227020:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.227022:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.227048:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:2396:x1877759533838208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.227054:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1619 00000100:00100000:1.0:1790771166.227060:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539738496:192.168.204.50@tcp:104: 00000004:00010000:0.0:1790771166.227083:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b26b1336 reply state 000000006feabe40 transno 4294968671 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227083:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.227084:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838080 00000100:00100000:3.0:1790771166.227090:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838080 00010000:00010000:0.0:1790771166.227097:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227104:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x73:0x0].0x0 (ffff8bfc1ae7f100) 00010000:00010000:0.0:1790771166.227107:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.227109:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.227126:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 970 00000100:00100000:3.0:1790771166.227135:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533838080:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771166.227142:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.227148:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.227156:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012b48e51/0xfa0c505d97f0c7fb lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35787 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.227157:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:14487:x1877759533838464:12345-192.168.204.50@tcp:36:touch.0 Request processed in 307us (387us total) trans 4294968671 rc 0/0 00000100:00100000:0.0:1790771166.227173:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5877 00000100:00100000:0.0:1790771166.227191:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533834368 00000100:00100000:0.0:1790771166.227194:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533834368 00010000:00010000:2.0:1790771166.227206:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0bca9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35389 expref: 103 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.227213:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539740416:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.227226:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738368:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.227234:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5878 00000100:00100000:0.0:1790771166.227243:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:14199:x1877759533834368:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771166.227252:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.227255:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.227260:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.227265:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c802 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35741 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227266:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838720 00000100:00100000:2.0:1790771166.227273:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838720 00010000:00010000:0.0:1790771166.227312:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227312:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838976 00000100:00100000:2.0:1790771166.227318:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838976 00010000:00010000:0.0:1790771166.227323:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227331:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227345:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.227349:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533838848 00010000:00010000:0.0:1790771166.227351:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227355:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1510 00000100:00100000:3.0:1790771166.227356:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533838848 00010000:00010000:0.0:1790771166.227366:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227372:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:11970:x1877759533838720:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.227381:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1790771166.227386:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x14:0x0] (10682368->14614527) req@ffff8bfb04971f80 x1877759533838848/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.227403:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c817 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227410:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227416:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.227423:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1511 00000004:00010000:0.0:1790771166.227430:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c817 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.227436:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08478c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:12016:x1877759533838976:12345-192.168.204.50@tcp:37:ls.0 00002000:00100000:3.0:1790771166.227455:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04971f80 with x1877759533838848 ext(10682368->14614527) 00010000:00010000:0.0:1790771166.227456:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.227465:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 27 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227466:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227474:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:11970:x1877759533838720:12345-192.168.204.50@tcp:35:ls.0 Request processed in 106us (469us total) trans 4294968672 rc 0/0 00010000:00010000:0.0:1790771166.227512:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.227512:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 27 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227519:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1510 00010000:00010000:0.0:1790771166.227532:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0400 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:3.0:1790771166.227533:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb04971f80 00010000:00010000:0.0:1790771166.227537:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227543:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227552:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.227554:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.227557:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.227559:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 93 00000100:00100000:2.0:1790771166.227563:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ce5880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539738624:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.227575:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c809 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.227575:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533838848:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:0.0:1790771166.227592:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227597:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227600:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227602:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227616:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.227618:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227623:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227629:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x84832a57 (ffff8bfc1ae7f200) 00010000:00010000:0.0:1790771166.227631:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.227633:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227637:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0c810 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227659:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c802 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35741 expref: 106 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.227662:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533839232 00000100:00100000:2.0:1790771166.227679:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533839232 00010000:00010000:0.0:1790771166.227686:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668a00/0xfa0c505d97f0c817 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35741 expref: 106 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.227692:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfc3607a300) 00010000:00010000:0.0:1790771166.227694:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.227696:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668a00, rc 0) 00010000:00010000:2.0:1790771166.227701:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 106 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.227720:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14199:x1877759533834368:12345-192.168.204.50@tcp:101:cat.0 Request processed in 478us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.227731:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1620 00000100:00100000:0.0:1790771166.227732:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5878 00000100:00100000:2.0:1790771166.227744:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:2396:x1877759533839232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.227752:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.227756:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 105 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227766:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 105 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227777:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0bca2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35374 expref: 105 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227788:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.227791:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227798:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227803:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227817:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.227842:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:2396:x1877759533839232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.227847:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1620 00010000:00010000:2.0:1790771166.227894:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227900:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227915:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227924:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.227933:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.228191:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.228193:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228200:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228209:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228213:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.228219:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.228219:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228229:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.228230:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539738752:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.228239:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533839488 00000100:00100000:0.0:1790771166.228244:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533839488 00010000:00010000:2.0:1790771166.228248:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.228253:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.228257:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.228261:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [8388608->12582911] (req 8388608->12582911) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356df expref: 27 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.228270:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x14:0x0] (9306112->10682367) req@ffff8bfb03c6ea00 x1877759533839488/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.228270:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0c6c0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.228301:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6ea00 with x1877759533839488 ext(9306112->10682367) 00000004:00010000:2.0:1790771166.228303:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000733c2932 reply state 000000008fc26b60 transno 4294968673 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.228306:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339400, rc 0) 00010000:00010000:0.0:1790771166.228311:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 22 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228324:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.228329:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 22 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228339:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc310f2900) 00002000:00010000:0.0:1790771166.228340:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb03c6ea00 00010000:00010000:2.0:1790771166.228344:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.228347:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:13210:x1877759533830784:12345-192.168.204.50@tcp:101:cat.0 Request processed in 70554us (71019us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.228348:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.228357:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 967 00000100:00100000:0.0:1790771166.228366:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 94 00000100:00100000:0.0:1790771166.228376:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2396:x1877759533839488:12345-192.168.204.50@tcp:4:dd.0 00000100:00100000:2.0:1790771166.228392:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14349:x1877759533830144:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 71032us (71142us total) trans 4294968673 rc 0/0 00000100:00100000:2.0:1790771166.228399:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5861 00000100:00100000:1.0:1790771166.228406:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.228417:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821440 00000100:00100000:2.0:1790771166.228421:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821440 00000100:00100000:2.0:1790771166.228452:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5879 00000100:00100000:2.0:1790771166.228459:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14800:x1877759533821440:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.228470:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.228480:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0c825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35629 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228537:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.228540:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533839360 00000100:00100000:1.0:1790771166.228546:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533839360 00010000:00010000:2.0:1790771166.228552:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228564:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.228571:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1512 00000100:00100000:1.0:1790771166.228579:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13459:x1877759533839360:12345-192.168.204.50@tcp:35:dd.0 00000004:00200000:2.0:1790771166.228593:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.228597:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.228609:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228625:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0c825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 127 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228637:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 126 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.228646:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.228648:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.228652:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00000100:00100000:2.0:1790771166.228699:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14800:x1877759533821440:12345-192.168.204.50@tcp:101:ls.0 Request processed in 240us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.228707:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5879 00000100:00100000:1.0:1790771166.228729:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13459:x1877759533839360:12345-192.168.204.50@tcp:35:dd.0 Request processed in 149us (537us total) trans 4294969263 rc 0/0 00000100:00100000:1.0:1790771166.228736:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1512 00000100:00100000:1.0:1790771166.237950:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.238017:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533828096 00000100:00100000:0.0:1790771166.238023:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533828096 00000100:00100000:0.0:1790771166.238058:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5880 00000100:00100000:0.0:1790771166.238064:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14559:x1877759533828096:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.238076:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.238085:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0c833 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3568b expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238151:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0c83a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238161:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238170:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0c83a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.238171:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.238181:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x61:0x0]: returning size 0 00000100:00100000:2.0:1790771166.238210:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533824128 00000100:00100000:2.0:1790771166.238216:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533824128 00000100:00100000:3.0:1790771166.238217:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.238246:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0c833 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3568b expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.238252:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533839616 00000100:00100000:3.0:1790771166.238257:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533839616 00000100:00100000:2.0:1790771166.238259:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5881 00010000:00010000:0.0:1790771166.238269:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0c83a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3568b expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.238275:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14674:x1877759533824128:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.238287:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00000100:00100000:3.0:1790771166.238291:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5882 00010000:00010000:2.0:1790771166.238293:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.238294:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.238300:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996a00, rc 0) 00000100:00100000:3.0:1790771166.238303:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:12123:x1877759533839616:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.238309:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c848 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35653 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238315:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.238330:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c84f lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3578e expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.238340:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14559:x1877759533828096:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 273us (390us total) trans 4294969264 rc 0/0 00000100:00100000:0.0:1790771166.238346:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5880 00010000:00010000:2.0:1790771166.238354:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238363:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238367:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238371:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238380:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238389:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238390:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.238401:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.238409:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238417:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.238427:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.238431:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.238439:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238446:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238451:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238455:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0c84f lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 107 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238458:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.238468:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825408 00010000:00010000:2.0:1790771166.238475:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.238476:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825408 00010000:00010000:2.0:1790771166.238507:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238514:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238523:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.238526:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.238528:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5883 00010000:00010000:2.0:1790771166.238532:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238541:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0c856 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238554:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238562:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238570:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238574:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 106 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238578:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.238586:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238587:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.238595:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1790771166.238598:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.238600:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104400, rc 0) 00000100:00100000:0.0:1790771166.238601:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.238615:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc310f2800) 00010000:00010000:2.0:1790771166.238617:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.238620:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238626:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0c864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.238643:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14132:x1877759533825408:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771166.238652:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.238657:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c848 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35653 expref: 130 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238661:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c86b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35668 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238684:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.238689:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.238695:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0c848 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35653 expref: 131 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238702:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.238703:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:12123:x1877759533839616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 337us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.238707:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4200, rc 0) 00010000:00010000:0.0:1790771166.238718:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238726:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.238734:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14674:x1877759533824128:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 466us (567us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.238741:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5881 00000100:00100000:2.0:1790771166.238753:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841920 00000100:00100000:2.0:1790771166.238756:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841920 00000100:00100000:3.0:1790771166.238771:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5882 00000100:00100000:2.0:1790771166.238783:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5884 00000100:00100000:2.0:1790771166.238792:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14008:x1877759533841920:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.238798:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0c86b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238801:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.238813:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 129 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.238814:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0c879 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357b8 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.238834:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:1.0:1790771166.238835:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.238841:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.238845:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35fff000, rc 0) 00000004:00200000:2.0:1790771166.238868:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.238870:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14132:x1877759533825408:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 334us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.238877:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5883 00000100:00100000:1.0:1790771166.238897:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.238925:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0c879 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b8 expref: 130 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.238926:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533844864 00000100:00100000:0.0:1790771166.238930:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.238933:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533844864 00010000:00010000:2.0:1790771166.238946:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:2.0:1790771166.238950:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771166.238954:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533839744 00010000:00010000:2.0:1790771166.238957:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0c879 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b8 expref: 131 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.238958:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533839744 00010000:00010000:2.0:1790771166.238969:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00000100:00100000:1.0:1790771166.238988:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 780 00000100:00100000:2.0:1790771166.238993:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14008:x1877759533841920:12345-192.168.204.50@tcp:101:ls.0 Request processed in 203us (396us total) trans 4294969265 rc 301/301 00000100:00100000:2.0:1790771166.238999:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5884 00000100:00100000:2.0:1790771166.239026:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840000 00000100:00100000:1.0:1790771166.239031:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2396:x1877759533839744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.239031:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840000 00010000:00010000:1.0:1790771166.239043:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.239056:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0c6ff lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355ce expref: 129 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239068:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00000100:00100000:2.0:1790771166.239069:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1513 00010000:00010000:1.0:1790771166.239075:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.239085:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12239:x1877759533840000:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.239099:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759533839744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.239107:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 780 00000100:00100000:0.0:1790771166.239161:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.239174:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2398:x1877759533834624:12345-192.168.204.50@tcp:4:cat.0 Request processed in 53598us (53803us total) trans 4294967603 rc 0/0 00000100:00100000:1.0:1790771166.239180:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 92 00000100:00100000:2.0:1790771166.239188:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:12239:x1877759533840000:12345-192.168.204.50@tcp:35:ls.0 Request processed in 106us (355us total) trans 4294969266 rc 0/0 00000100:00100000:0.0:1790771166.239189:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840128 00002000:00100000:1.0:1790771166.239189:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0xe:0x0] (24576->47793) req@ffff8bfb0552fb80 x1877759533834624/t4294967603(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.239195:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840128 00002000:00100000:1.0:1790771166.239208:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552fb80 with x1877759533834624 ext(24576->47793) 00000100:00100000:2.0:1790771166.239212:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1513 00000100:00100000:0.0:1790771166.239220:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1514 00010000:00010000:1.0:1790771166.239220:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239231:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13693:x1877759533840128:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:1.0:1790771166.239236:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.239243:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb0552fb80 00000004:00200000:0.0:1790771166.239264:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.239268:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.239287:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5885 00000100:00100000:1.0:1790771166.239296:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14113:x1877759533844864:12345-192.168.204.50@tcp:101:file_concat.sh.0 00000100:00100000:0.0:1790771166.239307:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13693:x1877759533840128:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 74us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.239307:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.239317:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1514 00010000:00010000:1.0:1790771166.239319:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c887 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357e2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239357:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.239382:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.239392:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840384 00010000:00010000:1.0:1790771166.239393:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239397:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.239399:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840384 00010000:00010000:1.0:1790771166.239409:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.239430:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533822080 00000100:00100000:2.0:1790771166.239434:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533822080 00000100:00100000:1.0:1790771166.239439:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5886 00000100:00100000:0.0:1790771166.239441:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.239452:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14827:x1877759533840384:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.239461:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.239467:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533821952 00000100:00100000:2.0:1790771166.239470:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533821952 00010000:00010000:1.0:1790771166.239471:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c895 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3579c expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239509:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c89c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239518:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c89c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239524:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5887 00010000:00010000:1.0:1790771166.239527:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c89c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239536:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14798:x1877759533822080:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.239544:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.239545:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539739008:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.239554:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0c8a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3563e expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.239564:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.239584:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239591:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c895 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3579c expref: 108 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.239595:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.239597:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085be850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533833088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 56108us (56488us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.239617:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1608 00010000:00010000:0.0:1790771166.239620:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239627:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373000/0xfa0c505d97f0c89c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3579c expref: 107 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239635:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.239637:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00200000:0.0:1790771166.239641:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.239642:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373000, rc 0) 00000004:00200000:0.0:1790771166.239646:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.239655:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.239690:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0c8a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 131 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.239697:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14827:x1877759533840384:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 243us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.239702:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5888 00010000:00010000:0.0:1790771166.239708:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.239719:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5886 00000100:00100000:2.0:1790771166.239719:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14794:x1877759533821952:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.239720:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.239729:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.239732:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85800, rc 0) 00010000:00010000:2.0:1790771166.239734:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.239746:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0c8b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35637 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239757:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14798:x1877759533822080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 224us (361us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.239757:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239773:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5887 00010000:00010000:1.0:1790771166.239775:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.239776:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.239796:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.239797:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239820:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.239821:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.239839:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.239842:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.239844:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840640 00000100:00100000:1.0:1790771166.239849:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840640 00000004:00010000:2.0:1790771166.239853:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.239865:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:1.0:1790771166.239868:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (2272->18446744073709551615) 00010000:00010000:2.0:1790771166.239874:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0c8b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.239876:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3e8f4700 with x1877759533840640 ext(2272->18446744073709551615) 00002000:00010000:1.0:1790771166.239892:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3e8f4700. 00010000:00010000:2.0:1790771166.239892:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 130 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.239904:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.239908:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.239912:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72000, rc 0) 00000100:00100000:1.0:1790771166.239925:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 400 00000100:00100000:1.0:1790771166.239936:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533840640:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:2.0:1790771166.239947:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14794:x1877759533821952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 231us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.239948:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.239961:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5888 00000100:00100000:3.0:1790771166.239974:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533845760 00000100:00100000:3.0:1790771166.239979:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533845760 00000100:00100000:2.0:1790771166.240029:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.240057:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533825920 00000100:00100000:0.0:1790771166.240062:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533825920 00000100:00100000:0.0:1790771166.240097:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5889 00000100:00100000:2.0:1790771166.240098:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.240107:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5890 00000100:00100000:0.0:1790771166.240112:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14555:x1877759533825920:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771166.240121:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.240130:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0c8c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35676 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240142:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.240154:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240157:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533826048 00010000:00010000:0.0:1790771166.240162:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240164:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533826048 00010000:00010000:0.0:1790771166.240173:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.240175:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13890:x1877759533845760:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.240192:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240199:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240200:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.240205:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5891 00010000:00010000:3.0:1790771166.240215:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c8db lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357e9 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240217:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240222:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14602:x1877759533826048:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.240241:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.240256:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0c8e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3567d expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240267:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240276:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240277:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.240283:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240299:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.240306:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240307:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 133 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240314:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240333:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.240334:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240334:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240356:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.240363:0:13765:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.240374:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240375:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 133 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.240396:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 133 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.240406:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539740544:192.168.204.50@tcp:104: 00000004:00200000:3.0:1790771166.240408:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.240424:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.240451:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240458:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.240460:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b300 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.240467:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240471:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.240475:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240479:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240505:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771166.240508:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.240511:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240516:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0c8e9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240529:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240534:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240539:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240544:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.240546:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240567:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.240607:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240616:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc08974700) 00010000:00010000:3.0:1790771166.240618:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.240621:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240626:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0c8fe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.240641:0:13793:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x1f:0x0] updating lvb atime: 0 -> 1790771159 00000100:00100000:2.0:1790771166.240647:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.240657:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539739520:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771166.240680:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841024 00000100:00100000:3.0:1790771166.240685:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841024 00000100:00100000:2.0:1790771166.240689:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841664 00000100:00100000:2.0:1790771166.240696:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841664 00010000:00010000:0.0:1790771166.240698:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e355cb70/0xfa0c505d97f0c776 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356d8 expref: 24 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240701:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 134 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.240722:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa:0x0] (45056->49151) req@ffff8bfb03ce4000 x1877759533841664/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.240728:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e355cb70/0xfa0c505d97f0c776 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356d8 expref: 25 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.240735:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841280 00002000:00100000:2.0:1790771166.240739:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ce4000 with x1877759533841664 ext(45056->49151) 00000100:00100000:3.0:1790771166.240741:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841280 00002000:00010000:2.0:1790771166.240747:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03ce4000 00010000:00010000:0.0:1790771166.240760:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ee00, rc 0) 00010000:00010000:3.0:1790771166.240760:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 135 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240773:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 401 00000100:00100000:2.0:1790771166.240783:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533841664:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771166.240787:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841536 00000100:00100000:0.0:1790771166.240792:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533830528:12345-192.168.204.50@tcp:101:ln.0 Request processed in 55898us (55971us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.240792:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841536 00000100:00100000:0.0:1790771166.240802:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 968 00010000:00010000:3.0:1790771166.240809:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.240827:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1621 00000100:00100000:3.0:1790771166.240834:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:2396:x1877759533841024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.240842:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.240847:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 135 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240857:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 135 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240867:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:3.0:1790771166.240871:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.240877:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240880:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533841664:12345-192.168.204.50@tcp:3:cat.0 Request processed in 98us (236us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1790771166.240887:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240893:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 401 00002000:00100000:2.0:1790771166.240905:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0xa:0x0] (45056->49151) req@ffff8bfb03ce4000 x1877759533841664/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771166.240906:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1790771166.240917:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ce4000 with x1877759533841664 ext(45056->49151) 00002000:00010000:2.0:1790771166.240923:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03ce4000 00000100:00100000:3.0:1790771166.240931:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:2396:x1877759533841024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 96us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.240938:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1621 00000100:00100000:3.0:1790771166.240958:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1622 00000100:00100000:3.0:1790771166.240966:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533841280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.240972:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.240976:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 134 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.240995:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1623 00000100:00100000:0.0:1790771166.241000:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.241006:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533841536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.241016:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.241021:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.241030:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.241046:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00000100:00100000:0.0:1790771166.241054:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.241055:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.241065:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.241074:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.241079:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 134 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241090:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.241103:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533841536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.241110:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1623 00000100:00100000:0.0:1790771166.241115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.241129:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842176 00000100:00100000:2.0:1790771166.241133:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842176 00000100:00100000:0.0:1790771166.241144:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.241150:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 135 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.241150:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:3.0:1790771166.241158:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241168:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.241176:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.241185:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842304 00010000:00010000:3.0:1790771166.241185:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.241192:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842304 00000100:00100000:0.0:1790771166.241198:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.241211:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.241217:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241224:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.241237:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:2396:x1877759533841280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 270us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.241245:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1622 00000100:00100000:2.0:1790771166.241253:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1624 00000100:00100000:0.0:1790771166.241260:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.241270:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1625 00000100:00100000:2.0:1790771166.241271:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533842176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.241280:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533842304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.241284:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.241290:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.241294:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 134 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.241299:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241318:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.241322:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 134 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241336:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840768 00010000:00010000:3.0:1790771166.241338:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241340:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840768 00010000:00010000:2.0:1790771166.241361:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:0.0:1790771166.241362:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842688 00000100:00100000:0.0:1790771166.241367:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842688 00010000:00010000:2.0:1790771166.241368:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.241376:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241379:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533843200 00010000:00010000:2.0:1790771166.241382:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241383:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533843200 00010000:00010000:2.0:1790771166.241391:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241395:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533843456 00010000:00010000:3.0:1790771166.241397:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:0.0:1790771166.241398:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533843456 00010000:00010000:3.0:1790771166.241403:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.241413:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.241414:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533843968 00000100:00100000:0.0:1790771166.241418:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533843968 00010000:00010000:2.0:1790771166.241418:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.241433:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759533842304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.241440:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1625 00000100:00100000:0.0:1790771166.241446:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1515 00000100:00100000:2.0:1790771166.241451:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533842176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.241463:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1624 00000100:00100000:0.0:1790771166.241464:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14184:x1877759533840768:12345-192.168.204.50@tcp:49:cp.0 00000100:00100000:3.0:1790771166.241465:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842048 00000100:00100000:3.0:1790771166.241472:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842048 00000100:00100000:2.0:1790771166.241524:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1516 00000100:00100000:3.0:1790771166.241531:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 971 00000100:00100000:0.0:1790771166.241540:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14184:x1877759533840768:12345-192.168.204.50@tcp:49:cp.0 Request processed in 80us (1673us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771166.241540:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14432:x1877759533842688:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:3.0:1790771166.241545:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533842048:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:0.0:1790771166.241559:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1515 00010000:00010000:3.0:1790771166.241560:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.241570:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bac9951/0xfa0c505d97f0c90c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357bf expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.241579:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1517 00000100:00100000:0.0:1790771166.241587:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14005:x1877759533843200:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.241604:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05d60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539740672:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771166.241640:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.241684:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539739648:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.241695:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14005:x1877759533843200:12345-192.168.204.50@tcp:35:ls.0 Request processed in 108us (474us total) trans 4294969267 rc 0/0 00010000:00010000:3.0:1790771166.241698:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.241703:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1517 00000100:00100000:3.0:1790771166.241726:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533833216:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 55722us (55792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.241727:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1518 00000100:00100000:3.0:1790771166.241743:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1612 00000100:00100000:0.0:1790771166.241744:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14699:x1877759533843456:12345-192.168.204.50@tcp:35:5.0 00010000:00010000:3.0:1790771166.241822:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c8db lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e9 expref: 109 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.241830:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:3.0:1790771166.241833:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.241836:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0c8db lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e9 expref: 109 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.241845:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105a00, rc 0) 00000100:00100000:3.0:1790771166.241861:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13890:x1877759533845760:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1745us (1920us total) trans 4294968674 rc 301/301 00000100:00100000:3.0:1790771166.241867:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5890 00000001:00080000:0.0:1790771166.241868:0:13780:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968675 00000100:00100000:3.0:1790771166.241883:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842432 00000100:00100000:3.0:1790771166.241887:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842432 00000100:00100000:3.0:1790771166.241906:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842944 00000100:00100000:3.0:1790771166.241908:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842944 00000100:00100000:3.0:1790771166.241927:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5892 00000100:00100000:0.0:1790771166.241939:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14699:x1877759533843456:12345-192.168.204.50@tcp:35:5.0 Request processed in 197us (676us total) trans 4294968676 rc 0/0 00000100:00100000:3.0:1790771166.241939:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14650:x1877759533842432:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:0.0:1790771166.241950:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1518 00000020:00080000:0.0:1790771166.241953:0:13780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790771166.241967:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1519 00000100:00100000:0.0:1790771166.241974:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14001:x1877759533843968:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771166.242008:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14650:x1877759533842432:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 74us (893us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771166.242013:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5892 00000100:00100000:3.0:1790771166.242028:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5893 00000100:00100000:3.0:1790771166.242033:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14007:x1877759533842944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.242040:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.242047:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c913 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357c6 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242069:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242077:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242083:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.242099:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.242102:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.242110:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242121:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c913 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357c6 expref: 137 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242132:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357c6 expref: 136 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242137:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.242140:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.242142:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0c00, rc 0) 00000100:00100000:3.0:1790771166.242156:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14007:x1877759533842944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 124us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.242162:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5893 00010000:00010000:3.0:1790771166.242207:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0c507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3558f expref: 133 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.242221:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05797480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539739264:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.242233:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0c355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355e3 expref: 135 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.242241:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94e680 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539739392:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.242254:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242261:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242266:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242324:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242330:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242334:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242338:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.242341:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242345:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242351:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfb0321a900) 00010000:00010000:3.0:1790771166.242352:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.242355:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.242358:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c76f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x94:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.242390:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14664:x1877759533834496:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 57787us (58812us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771166.242398:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5870 00000100:00100000:2.0:1790771166.242451:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533842816 00000100:00100000:2.0:1790771166.242455:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533842816 00002000:00100000:2.0:1790771166.242472:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (507904->511999) req@ffff8bfc2d2bdf80 x1877759533842816/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.242479:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d2bdf80 with x1877759533842816 ext(507904->511999) 00002000:00010000:2.0:1790771166.242483:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d2bdf80 00000100:00100000:2.0:1790771166.242538:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 402 00000100:00100000:2.0:1790771166.242548:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533842816:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771166.242625:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533842816:12345-192.168.204.50@tcp:3:cat.0 Request processed in 79us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.242631:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 402 00002000:00100000:2.0:1790771166.242637:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (507904->511999) req@ffff8bfc2d2bdf80 x1877759533842816/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.242646:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d2bdf80 with x1877759533842816 ext(507904->511999) 00002000:00010000:2.0:1790771166.242651:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d2bdf80 00010000:00010000:2.0:1790771166.242719:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0c570 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35596 expref: 132 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.242730:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539739136:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.242743:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242748:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242753:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242806:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242812:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242817:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242820:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.242823:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242828:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242835:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:2.0:1790771166.242838:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.242840:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242844:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105600/0xfa0c505d97f0c768 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.242877:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14688:x1877759533834112:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 58403us (59671us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771166.242883:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5869 00010000:00010000:2.0:1790771166.242937:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.242938:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.242952:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.242962:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.242969:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 5844 00000100:00100000:1.0:1790771166.242974:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533844352 00000100:00100000:1.0:1790771166.242979:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533844352 00000100:00100000:0.0:1790771166.242989:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.243011:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243019:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5894 00010000:00010000:2.0:1790771166.243021:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243028:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243032:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14445:x1877759533844352:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:2.0:1790771166.243045:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.243048:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.243057:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.243062:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243071:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243084:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.243087:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.243090:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c88e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243111:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243112:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14445:x1877759533844352:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 83us (173us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.243126:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.243129:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243131:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5894 00010000:00010000:2.0:1790771166.243139:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243144:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.243148:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243155:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243159:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533843840 00000100:00100000:1.0:1790771166.243163:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533843840 00010000:00010000:2.0:1790771166.243167:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfb03218200) 00010000:00010000:2.0:1790771166.243171:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.243175:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243184:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0c8b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243192:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533844608 00000100:00100000:1.0:1790771166.243195:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533844608 00000100:00100000:1.0:1790771166.243220:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 972 00010000:00010000:2.0:1790771166.243227:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0c887 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243232:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533843840:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1790771166.243243:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.243253:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005462c3f5/0xfa0c505d97f0c92f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357d4 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243257:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 137 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243273:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:2.0:1790771166.243275:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.243278:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03600, rc 0) 00000100:00100000:1.0:1790771166.243291:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04970000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539740800:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.243306:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14113:x1877759533844864:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 4009us (4409us total) trans 4294969268 rc 0/0 00000100:00100000:2.0:1790771166.243316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5885 00000100:00100000:1.0:1790771166.243337:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.243361:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 973 00000100:00100000:1.0:1790771166.243371:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:14096:x1877759533844608:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.243377:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.243390:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e24590/0xfa0c505d97f0c936 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357db expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.243403:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790771166.243413:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=166s v=(0 0) 00010000:00010000:1.0:1790771166.243418:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771166.243425:0:8406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e24590/0xfa0c505d97f0c936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4096->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357db expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243440:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094e24590/0xfa0c505d97f0c936 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4096->32767) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357db expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243449:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3e00, rc 0) 00000100:00100000:1.0:1790771166.243478:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:14096:x1877759533844608:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 106us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.243482:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.243518:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 973 00000100:00100000:2.0:1790771166.243529:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533844096 00000100:00100000:2.0:1790771166.243536:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533844096 00000100:00100000:2.0:1790771166.243571:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533844480 00000100:00100000:2.0:1790771166.243576:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533844480 00000100:00100000:1.0:1790771166.243596:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 781 00000100:00100000:1.0:1790771166.243608:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533844096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.243615:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.243618:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 782 00010000:00010000:1.0:1790771166.243631:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0c32b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3557a expref: 138 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.243631:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759533844480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.243648:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.243653:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.243659:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.243682:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c4eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35645 expref: 137 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.243699:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.243703:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.243706:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2396:x1877759533844096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 99us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.243717:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 781 00000100:00100000:2.0:1790771166.243729:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759533844480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.243737:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 782 00000100:00100000:3.0:1790771166.243781:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08478c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:12016:x1877759533838976:12345-192.168.204.50@tcp:37:ls.0 Request processed in 16348us (16700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.243789:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1511 00010000:00010000:1.0:1790771166.243806:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0c3d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3556c expref: 131 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243820:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee1500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539739776:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.243841:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0be00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353c1 expref: 134 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.243851:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539739904:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.243868:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243875:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243882:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243944:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243950:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243955:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243959:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.243962:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243967:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243974:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.243976:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.243978:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243984:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.243988:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.244009:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.244013:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0c77d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.244028:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.244037:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.244053:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14540:x1877759533834880:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 48960us (49089us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.244060:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5871 00002000:00010000:0.0:1790771166.244081:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4223368 -> 2272 00002000:00010000:0.0:1790771166.244085:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771166 -> 1790771165 00002000:00010000:0.0:1790771166.244087:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771166.244089:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771165 00002000:00010000:0.0:1790771166.244092:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8216 -> 8 00010000:00010000:2.0:1790771166.244114:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0c8e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 131 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.244128:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533840640:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 4192us (4308us total) trans 4294967608 rc 0/0 00010000:00010000:2.0:1790771166.244129:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 130 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.244143:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:0.0:1790771166.244144:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 400 00010000:00010000:2.0:1790771166.244149:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00002000:00010000:0.0:1790771166.244151:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/30 (2272->18446744073709551615) 00010000:00010000:2.0:1790771166.244154:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73200, rc 0) 00002000:00100000:0.0:1790771166.244155:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3e8f4700 with x1877759533840640 ext(2272->18446744073709551615) 00002000:00010000:0.0:1790771166.244161:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3e8f4700. 00000100:00100000:2.0:1790771166.244197:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14602:x1877759533826048:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 3978us (4052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.244206:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5891 00000100:00100000:3.0:1790771166.248910:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.248929:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.248951:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533845120 00000100:00100000:3.0:1790771166.248951:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.248957:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533845120 00000100:00100000:1.0:1790771166.248994:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533845376 00000100:00100000:0.0:1790771166.248996:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533845504 00000100:00100000:1.0:1790771166.249002:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533845376 00000100:00100000:0.0:1790771166.249003:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533845504 00000100:00100000:2.0:1790771166.249003:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1520 00000100:00100000:2.0:1790771166.249017:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13673:x1877759533845120:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.249041:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1521 00000100:00100000:0.0:1790771166.249052:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1522 00000100:00100000:1.0:1790771166.249053:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13887:x1877759533845376:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.249068:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08478450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13742:x1877759533845504:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771166.249119:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.249136:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13673:x1877759533845120:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (224us total) trans 4294968677 rc 0/0 00000100:00100000:2.0:1790771166.249142:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1520 00000100:00100000:1.0:1790771166.249162:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05d60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:13887:x1877759533845376:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (230us total) trans 4294968678 rc 0/0 00000100:00100000:2.0:1790771166.249168:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533845888 00000100:00100000:1.0:1790771166.249171:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1521 00000100:00100000:2.0:1790771166.249175:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533845888 00000100:00100000:1.0:1790771166.249209:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04972d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539740032:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.249214:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5895 00000100:00100000:2.0:1790771166.249227:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:14487:x1877759533845888:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:1.0:1790771166.249235:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.249238:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.249249:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104e00, rc 0) 00010000:00010000:2.0:1790771166.249252:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f0c93d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x73:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357f0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.249270:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:14763:x1877759533836800:12345-192.168.204.50@tcp:101:cp.0 Request processed in 23193us (23313us total) trans 0 rc 0/0 00002000:00010000:3.0:1790771166.249273:0:13787:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size: 131072 -> 2949120 00000100:00100000:1.0:1790771166.249279:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 969 00002000:00010000:3.0:1790771166.249279:0:13787:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime: 1790771165 -> 1790771166 00002000:00010000:3.0:1790771166.249284:0:13787:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime: 1790771165 -> 1790771166 00010000:00010000:2.0:1790771166.249292:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f0c93d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x73:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f0 expref: 108 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.249296:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539740416:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.249316:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03200/0xfa0c505d97f0c93d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x73:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f0 expref: 108 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.249323:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012b48e51/0xfa0c505d97f0c7fb lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35787 expref: 27 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.249331:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539740160:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.249341:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x73:0x0].0x0 (ffff8bfc1ae7f100) 00010000:00010000:2.0:1790771166.249345:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771166.249348:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03200, rc 0) 00010000:00010000:3.0:1790771166.249350:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012b48e51/0xfa0c505d97f0c7fb lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35787 expref: 27 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.249352:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539740288:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.249368:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00010000:00010000:1.0:1790771166.249377:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.249377:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14487:x1877759533845888:12345-192.168.204.50@tcp:101:touch.0 Request processed in 151us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.249390:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5895 00000100:00100000:3.0:1790771166.249396:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533838080:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 22261us (22735us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.249403:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 970 00000100:00100000:0.0:1790771166.296176:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533839488:12345-192.168.204.50@tcp:4:dd.0 Request processed in 67793us (67950us total) trans 4294967609 rc 0/0 00000100:00100000:0.0:1790771166.296187:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 94 00002000:00100000:0.0:1790771166.296198:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x14:0x0] (9306112->10682367) req@ffff8bfb03c6ea00 x1877759533839488/t4294967609(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.296207:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6ea00 with x1877759533839488 ext(9306112->10682367) 00010000:00010000:0.0:1790771166.296217:0:8413:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 27 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.296230:0:8413:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 27 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.296236:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb03c6ea00 00000100:00100000:2.0:1790771166.310929:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.310985:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.311015:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846272 00000100:00100000:0.0:1790771166.311025:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846272 00000100:00100000:1.0:1790771166.311044:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846400 00000100:00100000:1.0:1790771166.311051:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846400 00010000:00010000:1.0:1790771166.311081:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.311085:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5896 00000100:00100000:0.0:1790771166.311100:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14199:x1877759533846272:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:2.0:1790771166.311108:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.311121:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.311125:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846656 00000100:00100000:1.0:1790771166.311129:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846656 00010000:00010000:0.0:1790771166.311141:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0c944 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357fe expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.311147:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 104 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.311160:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1626 00000100:00100000:2.0:1790771166.311171:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.311177:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533846400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.311184:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846528 00000100:00100000:1.0:1790771166.311187:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846528 00010000:00010000:3.0:1790771166.311196:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.311199:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0c94b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.311207:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1627 00010000:00010000:1.0:1790771166.311208:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311217:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0c94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.311226:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2396:x1877759533846656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.311231:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0c94b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.311235:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1628 00010000:00010000:2.0:1790771166.311240:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.311250:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:2396:x1877759533846528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.311252:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 104 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.311252:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.311259:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.311268:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.311280:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.311288:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 104 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.311290:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.311296:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311332:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0c944 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357fe expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.311334:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.311338:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6b75430/0xfa0c505d97f0856d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34011 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311360:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1400/0xfa0c505d97f0c94b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357fe expref: 131 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311368:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:3.0:1790771166.311368:0:13797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(6 1) 00010000:00010000:2.0:1790771166.311373:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f021d7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31caf expref: 104 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311377:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1790771166.311377:0:13797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(6 1) 00010000:00010000:1.0:1790771166.311381:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0c65e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ae expref: 108 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311383:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1400, rc 0) 00010000:00010000:3.0:1790771166.311392:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.311400:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:2.0:1790771166.311408:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.311414:0:13797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.311417:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.311422:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14199:x1877759533846272:12345-192.168.204.50@tcp:101:cat.0 Request processed in 323us (496us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.311437:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.311449:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5896 00010000:00010000:1.0:1790771166.311452:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:1.0:1790771166.311457:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.311467:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.311474:0:13797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.311513:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+107:2396:x1877759533846528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 239us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.311514:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:13797:1877759539740928:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771166.311530:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1628 00000100:00100000:2.0:1790771166.311531:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:2396:x1877759533846656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 309us (419us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.311541:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.311546:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1627 00010000:00010000:0.0:1790771166.311551:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.311582:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.311589:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.311612:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846784 00000100:00100000:1.0:1790771166.311616:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846784 00000100:00100000:2.0:1790771166.311637:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.311648:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 783 00000100:00100000:1.0:1790771166.311657:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2396:x1877759533846784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.311682:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846912 00010000:00010000:1.0:1790771166.311683:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.311689:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846912 00000004:00010000:0.0:1790771166.311690:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e45eeb72 reply state 00000000708611fc transno 4294968679 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311704:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.311704:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0c83a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3568b expref: 131 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311722:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:0.0:1790771166.311726:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.311729:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.311733:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00000100:00100000:2.0:1790771166.311734:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 403 00000004:00200000:0.0:1790771166.311736:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.311742:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.311746:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533846912:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771166.311768:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04972d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2396:x1877759533846784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 111us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.311775:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 783 00000100:00100000:0.0:1790771166.311784:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:14774:x1877759533837696:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 85238us (85372us total) trans 4294968679 rc 0/0 00000100:00100000:0.0:1790771166.311791:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5876 00000100:00100000:1.0:1790771166.311819:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.311840:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533830400 00000100:00100000:0.0:1790771166.311844:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533830400 00002000:00010000:2.0:1790771166.311847:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790771166.311853:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:1.0:1790771166.311854:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.311859:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.311862:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.311863:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1790771166.311875:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533830912 00000100:00100000:0.0:1790771166.311878:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533830912 00000100:00100000:2.0:1790771166.311889:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06a12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533846912:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 146us (253us total) trans 4294967610 rc 0/0 00000100:00100000:2.0:1790771166.311896:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 403 00000100:00100000:0.0:1790771166.311907:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5897 00000100:00100000:1.0:1790771166.311916:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.311919:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14331:x1877759533830400:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771166.311927:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.311941:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0c952 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356d1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.311961:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.311965:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0c959 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311974:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.311982:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0c959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.311987:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533831168 00000100:00100000:3.0:1790771166.311994:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533831168 00000100:00100000:1.0:1790771166.312007:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5898 00000100:00100000:1.0:1790771166.312017:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14799:x1877759533830912:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.312026:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.312038:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0c960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356e6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.312045:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0c952 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356d1 expref: 134 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.312060:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1000/0xfa0c505d97f0c959 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356d1 expref: 134 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.312066:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771166.312068:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.312071:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1000, rc 0) 00010000:00010000:1.0:1790771166.312076:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.312077:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5899 00010000:00010000:1.0:1790771166.312089:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.312098:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14331:x1877759533830400:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 183us (279us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.312098:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.312113:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5897 00000004:00200000:1.0:1790771166.312128:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.312132:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.312137:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14660:x1877759533831168:12345-192.168.204.50@tcp:101:chown.0 00000004:00010000:1.0:1790771166.312144:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.312147:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.312160:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356ed expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.312166:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0c960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.312184:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.312186:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 134 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.312210:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.312212:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 134 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.312214:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.312218:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00010000:00010000:3.0:1790771166.312225:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.312228:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.312231:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60000, rc 0) 00000100:00100000:1.0:1790771166.312247:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14799:x1877759533830912:12345-192.168.204.50@tcp:101:ls.0 Request processed in 231us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.312253:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5898 00000100:00100000:3.0:1790771166.312290:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14660:x1877759533831168:12345-192.168.204.50@tcp:101:chown.0 Request processed in 203us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.312297:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5899 00000100:00100000:3.0:1790771166.312324:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533847680 00000100:00100000:3.0:1790771166.312327:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533847680 00000100:00100000:3.0:1790771166.312356:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1523 00000100:00100000:3.0:1790771166.312365:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14008:x1877759533847680:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.312600:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14008:x1877759533847680:12345-192.168.204.50@tcp:35:ls.0 Request processed in 237us (687us total) trans 4294969269 rc 0/0 00000100:00100000:3.0:1790771166.312607:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1523 00000100:00100000:0.0:1790771166.313131:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14001:x1877759533843968:12345-192.168.204.50@tcp:37:ls.0 Request processed in 71156us (71817us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.313137:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1519 00000100:00100000:2.0:1790771166.313335:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14432:x1877759533842688:12345-192.168.204.50@tcp:37:rm.0 Request processed in 71803us (72192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.313342:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1516 00000100:00100000:1.0:1790771166.325732:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.325762:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.325787:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533848576 00000100:00100000:0.0:1790771166.325794:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533848576 00000100:00100000:0.0:1790771166.325838:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1524 00000100:00100000:0.0:1790771166.325847:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:12240:x1877759533848576:12345-192.168.204.50@tcp:35:ls.0 00002000:00010000:1.0:1790771166.325854:0:8408:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime: 1790771165 -> 1790771166 00002000:00010000:1.0:1790771166.325859:0:8408:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks: 8 -> 8216 00000100:00100000:1.0:1790771166.325873:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04970000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539740800:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.325886:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533831680 00000100:00100000:2.0:1790771166.325892:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533831680 00010000:00010000:1.0:1790771166.325900:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005462c3f5/0xfa0c505d97f0c92f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357d4 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.325920:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005462c3f5/0xfa0c505d97f0c92f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357d4 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.325931:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373600, rc 0) 00000100:00100000:2.0:1790771166.325936:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5900 00000100:00100000:2.0:1790771166.325949:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14765:x1877759533831680:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:2.0:1790771166.325962:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.325963:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533843840:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 82736us (82920us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771166.325971:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 972 00010000:00010000:2.0:1790771166.325976:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35709 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.325995:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:12240:x1877759533848576:12345-192.168.204.50@tcp:35:ls.0 Request processed in 148us (267us total) trans 4294969270 rc 0/0 00010000:00010000:2.0:1790771166.326002:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 134 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.326006:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1524 00000100:00100000:1.0:1790771166.326015:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.326023:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 134 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326032:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.326036:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.326038:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533847936 00010000:00010000:2.0:1790771166.326040:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03c00, rc 0) 00000100:00100000:1.0:1790771166.326043:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533847936 00010000:00010000:1.0:1790771166.326065:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.326076:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14765:x1877759533831680:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.326085:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5900 00000100:00100000:1.0:1790771166.326091:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1629 00000100:00100000:1.0:1790771166.326101:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533847936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.326111:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1790771166.326119:0:9499:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 26344 -> 47794 00002000:00010000:1.0:1790771166.326121:0:9499:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771164 -> 1790771165 00002000:00010000:1.0:1790771166.326123:0:9499:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771164 -> 1790771165 00010000:00010000:1.0:1790771166.326127:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326136:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326149:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b86731c/0xfa0c505d97f0a2af lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a52 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326160:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1790771166.326163:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(2 4) 00010000:00010000:1.0:1790771166.326170:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 22 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326178:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 22 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326205:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 22 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.326216:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539741056:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771166.326259:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.326317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.326367:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.326390:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533849216 00000100:00100000:2.0:1790771166.326396:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533849216 00000100:00100000:1.0:1790771166.326411:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.326437:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533849344 00000100:00100000:2.0:1790771166.326440:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533849344 00000100:00100000:1.0:1790771166.326452:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5901 00000100:00100000:1.0:1790771166.326462:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14583:x1877759533849216:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:2.0:1790771166.326472:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5902 00000100:00100000:2.0:1790771166.326481:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14327:x1877759533849344:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771166.326526:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.326532:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.326542:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0c301 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35550 expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326552:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0c61f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355b9 expref: 135 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326556:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:1.0:1790771166.326563:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.326577:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.326583:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.326590:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326601:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 132 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326602:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326622:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326627:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 132 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326638:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326654:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 132 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326680:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 132 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.326684:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 132 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.326704:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 132 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.326711:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539741184:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.326718:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539741312:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.326733:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08478450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13742:x1877759533845504:12345-192.168.204.50@tcp:37:ls.0 Request processed in 77669us (77779us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.326741:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1522 00000100:00100000:1.0:1790771166.326766:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.326766:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffa80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.326786:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533848960 00000100:00100000:0.0:1790771166.326790:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533848960 00000100:00100000:0.0:1790771166.326818:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1525 00000100:00100000:0.0:1790771166.326825:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:13890:x1877759533848960:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.326875:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.326926:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.326938:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:13890:x1877759533848960:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (628us total) trans 4294968680 rc 0/0 00000100:00100000:2.0:1790771166.326945:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533849728 00000100:00100000:0.0:1790771166.326946:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1525 00000100:00100000:1.0:1790771166.326950:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533849856 00000100:00100000:2.0:1790771166.326954:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533849728 00000100:00100000:1.0:1790771166.326955:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533849856 00000100:00100000:2.0:1790771166.326996:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1526 00000100:00100000:1.0:1790771166.327002:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5903 00000100:00100000:2.0:1790771166.327008:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13998:x1877759533849728:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.327014:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14876:x1877759533849856:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1790771166.327030:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.327043:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c98a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3581a expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.327073:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539740544:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.327079:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.327092:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.327092:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.327114:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.327122:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13998:x1877759533849728:12345-192.168.204.50@tcp:35:ls.0 Request processed in 116us (244us total) trans 4294969271 rc 0/0 00000100:00100000:2.0:1790771166.327130:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1526 00000100:00100000:3.0:1790771166.327135:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05d60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539740672:192.168.204.50@tcp:106: 00000004:00200000:1.0:1790771166.327141:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.327145:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.327158:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.327175:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597800/0xfa0c505d97f0c98a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3581a expref: 105 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.327184:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.327189:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3581a expref: 104 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.327196:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.327198:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.327201:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596400, rc 0) 00000100:00100000:2.0:1790771166.327213:0:13792:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533850496 00000100:00100000:2.0:1790771166.327218:0:13792:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533850496 00000100:00100000:1.0:1790771166.327227:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14876:x1877759533849856:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 217us (301us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.327232:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bac9951/0xfa0c505d97f0c90c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357bf expref: 24 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.327240:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5903 00000100:00100000:2.0:1790771166.327265:0:13792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 35 00000100:00100000:2.0:1790771166.327277:0:13792:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14118:x1877759533850496:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:3.0:1790771166.327302:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bac9951/0xfa0c505d97f0c90c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357bf expref: 24 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327305:0:13792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790771166.327317:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597a00, rc 0) 00000100:00100000:1.0:1790771166.327328:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.327328:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ba8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352fd expref: 133 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327348:0:13792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 132 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327364:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0212f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x42:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31cfc expref: 132 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327376:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:2.0:1790771166.327379:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327385:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.327392:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533842048:12345-192.168.204.50@tcp:101:ln.0 Request processed in 85850us (86390us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.327394:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.327400:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533848704 00000100:00100000:3.0:1790771166.327406:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 971 00000100:00100000:0.0:1790771166.327407:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533848704 00010000:00010000:2.0:1790771166.327424:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0c7b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354b6 expref: 131 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327432:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974400) 00010000:00010000:2.0:1790771166.327438:0:13792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.327450:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 404 00010000:00010000:2.0:1790771166.327453:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.327461:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759533848704:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:2.0:1790771166.327464:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327472:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 133 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327478:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327509:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 133 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327515:0:13792:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 7/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327536:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 133 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327548:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 133 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.327569:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06a11880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741440:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.327627:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327637:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 133 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.327648:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741568:192.168.204.50@tcp:104: 00002000:00010000:0.0:1790771166.327684:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x25:0x0] updating lvb size from disk: 0 -> 30132 00002000:00010000:0.0:1790771166.327688:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x25:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.327691:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x25:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.327693:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x25:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.327695:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x25:0x0] updating lvb blocks from disk: 0 -> 56 00010000:00010000:2.0:1790771166.327707:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 133 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327715:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 133 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.327723:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533848704:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 263us (398us total) trans 4294967604 rc 0/0 00000100:00100000:2.0:1790771166.327729:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04970000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741696:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.327734:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 404 00010000:00010000:2.0:1790771166.327765:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.327773:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 133 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.327780:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04971180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741824:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.327798:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05ffff00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.327819:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.327839:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533850880 00000100:00100000:0.0:1790771166.327841:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533850880 00000100:00100000:0.0:1790771166.327861:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1527 00000100:00100000:0.0:1790771166.327871:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13665:x1877759533850880:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.327893:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.327961:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.327964:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533850624 00000100:00100000:0.0:1790771166.327967:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13665:x1877759533850880:12345-192.168.204.50@tcp:35:ls.0 Request processed in 96us (147us total) trans 4294968681 rc 0/0 00000100:00100000:2.0:1790771166.327969:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533850624 00000100:00100000:0.0:1790771166.327976:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1527 00010000:00010000:2.0:1790771166.327991:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 134 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.327992:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.328000:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533849984 00000100:00100000:0.0:1790771166.328004:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533849984 00000100:00100000:2.0:1790771166.328024:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1630 00000100:00100000:1.0:1790771166.328030:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.328039:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533850624:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.328051:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.328057:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 784 00010000:00010000:2.0:1790771166.328059:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 134 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.328070:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533849984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.328077:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 134 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328079:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.328091:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.328094:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0c91a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357c6 expref: 131 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.328102:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0964c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34589 expref: 134 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328108:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.328114:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.328114:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00000100:00100000:1.0:1790771166.328115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.328122:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.328129:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.328136:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533849984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 69us (175us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.328138:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328150:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.328161:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 784 00000100:00100000:1.0:1790771166.328170:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533832576 00000100:00100000:1.0:1790771166.328174:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533832576 00010000:00010000:2.0:1790771166.328177:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.328185:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533851648 00000100:00100000:0.0:1790771166.328189:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533851648 00000100:00100000:1.0:1790771166.328204:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5904 00002000:00100000:0.0:1790771166.328210:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (512000->516095) req@ffff8bfc36307050 x1877759533851648/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.328211:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759533850624:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.328217:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14389:x1877759533832576:12345-192.168.204.50@tcp:101:ln.0 00002000:00100000:0.0:1790771166.328232:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc36307050 with x1877759533851648 ext(512000->516095) 00010000:00010000:1.0:1790771166.328234:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.328236:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1630 00002000:00010000:0.0:1790771166.328240:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc36307050 00010000:00010000:1.0:1790771166.328245:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3571e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.328266:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 405 00010000:00010000:1.0:1790771166.328270:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 134 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328270:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533851008 00000100:00100000:2.0:1790771166.328278:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533851008 00000100:00100000:0.0:1790771166.328283:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc36307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533851648:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.328284:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 134 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.328299:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.328302:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.328306:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00000100:00100000:2.0:1790771166.328313:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852032 00000100:00100000:2.0:1790771166.328318:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852032 00000100:00100000:1.0:1790771166.328335:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14389:x1877759533832576:12345-192.168.204.50@tcp:101:ln.0 Request processed in 121us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.328344:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5904 00000100:00100000:2.0:1790771166.328348:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 974 00000100:00100000:2.0:1790771166.328360:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2398:x1877759533851008:12345-192.168.204.50@tcp:2:touch.0 00000100:00100000:1.0:1790771166.328379:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 975 00000100:00100000:1.0:1790771166.328389:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2398:x1877759533852032:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771166.328395:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc36307050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533851648:12345-192.168.204.50@tcp:3:cat.0 Request processed in 116us (305us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.328400:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.328404:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 405 00002000:00100000:0.0:1790771166.328410:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (512000->516095) req@ffff8bfc36307050 x1877759533851648/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.328412:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c9a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3582f expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.328424:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc36307050 with x1877759533851648 ext(512000->516095) 00002000:00010000:0.0:1790771166.328429:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc36307050 00010000:00010000:0.0:1790771166.328455:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328456:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539741952:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.328458:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533851008:12345-192.168.204.50@tcp:2:touch.0 Request processed in 99us (464us total) trans 4294967605 rc 0/0 00010000:00010000:0.0:1790771166.328473:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328475:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 974 00000100:00100000:1.0:1790771166.328513:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829480 going to sleep for 11 seconds 00000004:00200000:0.0:1790771166.328528:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 47794 00000004:00200000:0.0:1790771166.328532:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.328542:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328549:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.328558:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328565:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328572:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328574:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.328582:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328587:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.328591:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328594:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533851904 00010000:00010000:0.0:1790771166.328597:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328599:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533851904 00010000:00010000:0.0:1790771166.328610:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.328613:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.328616:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328623:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.328629:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328635:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1528 00010000:00010000:0.0:1790771166.328636:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0c8cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328650:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14077:x1877759533851904:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:0.0:1790771166.328651:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328679:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328686:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.328690:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328695:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.328698:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328703:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328712:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd6e9df9d (ffff8bfc1ae7f200) 00000100:00100000:2.0:1790771166.328712:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852160 00010000:00010000:0.0:1790771166.328717:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.328718:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852160 00010000:00010000:0.0:1790771166.328721:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328726:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0c8d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328751:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533829248 00010000:00010000:0.0:1790771166.328755:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0c8c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 137 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.328755:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533829248 00010000:00010000:0.0:1790771166.328769:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 137 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328775:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771166.328780:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1790771166.328780:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14077:x1877759533851904:12345-192.168.204.50@tcp:35:cat.0 Request processed in 133us (750us total) trans 4294969272 rc 0/0 00000100:00100000:2.0:1790771166.328781:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533846144 00010000:00010000:0.0:1790771166.328785:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e200, rc 0) 00000100:00100000:2.0:1790771166.328786:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533846144 00000100:00100000:1.0:1790771166.328792:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1528 00000100:00100000:2.0:1790771166.328810:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533847296 00000100:00100000:0.0:1790771166.328814:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14555:x1877759533825920:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 88705us (88782us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.328815:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533847296 00000100:00100000:0.0:1790771166.328825:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5889 00000100:00100000:2.0:1790771166.328844:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5905 00000100:00100000:0.0:1790771166.328853:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5906 00000100:00100000:2.0:1790771166.328857:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14265:x1877759533852160:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:0.0:1790771166.328870:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:11824:x1877759533829248:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.328880:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.328880:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.328882:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.328896:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0c9ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35699 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.328898:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0ae78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e3b expref: 135 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.328901:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533848192 00000100:00100000:1.0:1790771166.328907:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533848192 00000100:00100000:1.0:1790771166.328934:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5907 00010000:00010000:2.0:1790771166.328934:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb0321a400) 00000100:00100000:1.0:1790771166.328945:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14385:x1877759533846144:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:2.0:1790771166.328947:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.328952:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.328955:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.328962:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328971:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.328973:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c9bb lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357f7 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.328973:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.328985:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.328998:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329003:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329007:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329013:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329032:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329042:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329051:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329072:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329081:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.329083:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.329088:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329092:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329095:0:13771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329107:0:13771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329114:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.329121:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-mdtlov_UUID:13771:1877759539742080:0@lo:101:mdt00_016.0 00010000:00010000:1.0:1790771166.329124:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329125:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.329136:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5908 00010000:00010000:0.0:1790771166.329146:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329148:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.329152:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:12123:x1877759533847296:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.329167:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329169:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.329170:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.329182:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0c9f3 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35805 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329184:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.329192:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329198:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329206:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.329208:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.329208:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10429540 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.329214:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329219:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0c9b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329221:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329227:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329231:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329233:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.329236:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5909 00010000:00010000:1.0:1790771166.329240:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329255:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.329256:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14184:x1877759533848192:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.329258:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329260:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329276:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.329282:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.329284:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 1310720 00010000:00010000:3.0:1790771166.329291:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329294:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ca0f lrc: 2/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35813 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329296:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.329303:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329323:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329324:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329334:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329342:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329345:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfc1ae7f800) 00010000:00010000:1.0:1790771166.329349:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329352:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.329358:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329361:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329366:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0c9c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329369:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.329374:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329380:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329387:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329390:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.329393:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539742080 00010000:00010000:1.0:1790771166.329398:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.329400:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539742080 00010000:00010000:1.0:1790771166.329403:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329404:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.329404:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.329426:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329428:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0c9d7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.329432:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00010000:00010000:3.0:1790771166.329439:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.329446:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:13771:x1877759539742080:12345-0@lo:101:mdt00_016.0 00010000:00010000:1.0:1790771166.329455:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329455:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329459:0:7449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.329459:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329471:0:7449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0ca32 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0c9de expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329474:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329480:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329482:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329523:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.329532:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329534:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0ca32 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0c9de expref: 8 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329535:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329535:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329550:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.329557:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329559:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329567:0:7449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0ca32 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0c9de expref: 8 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329577:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329581:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.329587:0:7449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc1ae7fb00) 00010000:00010000:3.0:1790771166.329589:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.329594:0:7449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.329595:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329600:0:7449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1e00, rc 0) 00010000:00010000:1.0:1790771166.329600:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc8b04d25 (ffff8bfb03218e00) 00010000:00010000:2.0:1790771166.329602:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329603:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0c9fa lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329608:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.329614:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329627:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329628:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0c9ec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.329635:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:13771:x1877759539742080:12345-0@lo:101:mdt00_016.0 Request processed in 191us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.329653:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:2.0:1790771166.329676:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.329687:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x83:0x0]: returning size 38336 00010000:00010000:1.0:1790771166.329698:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0c9bb lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329699:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.329712:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60a80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-mdtlov_UUID:13771:1877759539742080:0@lo:101:mdt00_016.0 00010000:00010000:2.0:1790771166.329721:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329731:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329734:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329743:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329756:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 107 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.329757:0:13771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329758:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.329764:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329783:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:2.0:1790771166.329785:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.329788:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.329793:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595400, rc 0) 00010000:00010000:3.0:1790771166.329804:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329806:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x83:0x0].0x0 (ffff8bfb03188f00) 00010000:00010000:2.0:1790771166.329814:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1790771166.329815:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14385:x1877759533846144:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 872us (1197us total) trans 4294968682 rc 0/0 00010000:00010000:3.0:1790771166.329815:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329820:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.329837:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5907 00010000:00010000:3.0:1790771166.329837:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.329840:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ca39 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x83:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329843:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329853:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329858:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329862:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc08974d00) 00010000:00010000:3.0:1790771166.329869:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.329872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.329879:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329885:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329888:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.329891:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329897:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.329905:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.329909:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:2.0:1790771166.329914:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.329921:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329921:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.329934:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.329945:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ca1d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.329946:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ca08 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.329964:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.329964:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329974:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329980:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.329985:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.329987:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852416 00010000:00010000:2.0:1790771166.329989:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.329992:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852416 00010000:00010000:2.0:1790771166.329996:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330005:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xd870248a (ffff8bfc310f2c00) 00010000:00010000:3.0:1790771166.330007:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0c9f3 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35805 expref: 113 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330008:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.330014:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.330017:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533850240 00000100:00100000:1.0:1790771166.330023:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533850240 00010000:00010000:2.0:1790771166.330032:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ca2b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330035:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:1.0:1790771166.330042:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852544 00010000:00010000:3.0:1790771166.330043:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771166.330046:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852544 00010000:00010000:3.0:1790771166.330053:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0c9f3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35805 expref: 115 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.330066:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533851264 00010000:00010000:2.0:1790771166.330070:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ca0f lrc: 1/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35813 expref: 115 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.330071:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533851264 00010000:00010000:2.0:1790771166.330085:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000040:00080000:0.0:1790771166.330087:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].39, 344 off55880 00010000:00010000:2.0:1790771166.330088:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.330094:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5910 00010000:00010000:2.0:1790771166.330096:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ca0f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35813 expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.330103:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14467:x1877759533852416:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:2.0:1790771166.330107:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00000100:00100000:2.0:1790771166.330129:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14184:x1877759533848192:12345-192.168.204.50@tcp:101:cp.0 Request processed in 878us (1248us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771166.330130:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2000, rc 0) 00000100:00100000:2.0:1790771166.330139:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5909 00000100:00100000:3.0:1790771166.330161:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:12123:x1877759533847296:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1013us (1496us total) trans 4294968683 rc 301/301 00000100:00100000:2.0:1790771166.330164:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5911 00000100:00100000:1.0:1790771166.330176:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14467:x1877759533852416:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 73us (307us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771166.330177:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5908 00000100:00100000:2.0:1790771166.330183:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:12016:x1877759533850240:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.330192:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5910 00010000:00010000:2.0:1790771166.330198:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.330212:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0ca40 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35821 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.330213:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5912 00000100:00100000:1.0:1790771166.330230:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5913 00000100:00100000:3.0:1790771166.330232:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14805:x1877759533852544:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:1.0:1790771166.330242:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13889:x1877759533851264:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.330244:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.330253:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.330258:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330260:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ca4e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35836 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330264:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0ca55 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35828 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330283:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330295:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330299:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0ca5c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330310:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0ca5c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330318:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0ca5c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330320:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330321:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330342:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330346:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330350:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330361:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330376:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330382:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330389:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330394:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ca4e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35836 expref: 116 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.330398:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0c9ad lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35699 expref: 137 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.330401:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.330417:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.330417:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0ca5c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35836 expref: 115 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.330423:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.330430:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771166.330431:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0c9ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35699 expref: 137 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330434:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00200000:1.0:1790771166.330438:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.330441:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330441:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3400, rc 0) 00010000:00010000:0.0:1790771166.330445:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00010000:00010000:2.0:1790771166.330453:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330459:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330463:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c72800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.330466:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14805:x1877759533852544:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 240us (534us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.330468:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.330474:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:11824:x1877759533829248:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1606us (1899us total) trans 4294969273 rc 301/301 00010000:00010000:1.0:1790771166.330477:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.330503:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5912 00010000:00010000:2.0:1790771166.330512:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.330515:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5906 00010000:00010000:1.0:1790771166.330516:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330528:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330531:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.330534:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.330537:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.330539:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330543:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330545:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330562:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0ca47 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330566:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:3.0:1790771166.330573:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.330574:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.330580:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330586:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ca63 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330589:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330597:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330598:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330608:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330613:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330614:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.330620:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330634:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330635:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.330652:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.330659:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.330675:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc310f2400) 00010000:00010000:1.0:1790771166.330677:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330680:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.330686:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330690:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330705:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ca6a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330724:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfb03218600) 00000100:00100000:0.0:1790771166.330732:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.330732:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.330738:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330746:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0ca40 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35821 expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.330750:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ca71 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.330755:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:3.0:1790771166.330761:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855616 00010000:00010000:2.0:1790771166.330762:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.330768:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0ca40 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35821 expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.330769:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855616 00010000:00010000:2.0:1790771166.330784:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73a00, rc 0) 00010000:00010000:1.0:1790771166.330802:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0ca55 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35828 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.330808:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:12016:x1877759533850240:12345-192.168.204.50@tcp:101:ls.0 Request processed in 630us (900us total) trans 4294968684 rc 301/301 00000100:00100000:3.0:1790771166.330814:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5914 00010000:00010000:1.0:1790771166.330818:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771166.330823:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771166.330826:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5911 00010000:00010000:1.0:1790771166.330833:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0ca55 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35828 expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.330833:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14008:x1877759533855616:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.330848:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.330849:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595a00, rc 0) 00000100:00100000:2.0:1790771166.330853:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852672 00000100:00100000:2.0:1790771166.330858:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852672 00010000:00010000:3.0:1790771166.330860:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ca86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35883 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.330885:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13889:x1877759533851264:12345-192.168.204.50@tcp:101:ls.0 Request processed in 645us (922us total) trans 4294968685 rc 301/301 00000100:00100000:2.0:1790771166.330888:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1529 00000100:00100000:1.0:1790771166.330905:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5913 00000100:00100000:2.0:1790771166.330907:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14827:x1877759533852672:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:3.0:1790771166.330907:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0ca8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330923:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0ca8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.330929:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0ca8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.330935:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.330959:0:13775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.330963:0:13775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.330993:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14827:x1877759533852672:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 95us (425us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.330998:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ca86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35883 expref: 133 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.331003:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1529 00010000:00010000:3.0:1790771166.331024:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78c00/0xfa0c505d97f0ca8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xf:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35883 expref: 132 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.331034:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771166.331037:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:0.0:1790771166.331041:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533852928 00010000:00010000:3.0:1790771166.331041:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78c00, rc 0) 00000100:00100000:0.0:1790771166.331047:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533852928 00000100:00100000:2.0:1790771166.331058:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.331068:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 136 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.331072:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14008:x1877759533855616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 245us (344us total) trans 4294969275 rc 0/0 00000100:00100000:3.0:1790771166.331088:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5914 00000100:00100000:3.0:1790771166.331109:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533832960 00000100:00100000:3.0:1790771166.331113:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533832960 00000100:00100000:1.0:1790771166.331119:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1631 00000100:00100000:2.0:1790771166.331133:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.331134:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2396:x1877759533852928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.331145:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.331150:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 137 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331164:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 137 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331175:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.331179:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331185:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.331200:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2396:x1877759533852928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.331206:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1631 00000100:00100000:0.0:1790771166.331236:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.331263:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853184 00000100:00100000:0.0:1790771166.331267:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853184 00000001:00080000:1.0:1790771166.331282:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969274 is committed 00000100:00100000:2.0:1790771166.331288:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:1.0:1790771166.331306:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969271 is committed 00000100:00100000:0.0:1790771166.331309:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533857792 00000100:00100000:0.0:1790771166.331314:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533857792 00000100:00100000:2.0:1790771166.331360:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000020:00080000:1.0:1790771166.331368:0:6473:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb05fffc00 refcount 2 committed 0 result -61 batchid 49 00000100:00100000:3.0:1790771166.331371:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5915 00000020:00080000:1.0:1790771166.331374:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc36099800 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -61 sub_th ffff8bfb05fffa80 00000020:00080000:1.0:1790771166.331378:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc36099300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc2d360400 00000100:00100000:3.0:1790771166.331385:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14113:x1877759533853184:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:0.0:1790771166.331390:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853312 00000100:00100000:0.0:1790771166.331394:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853312 00010000:00010000:3.0:1790771166.331395:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00080000:2.0:1790771166.331400:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 46 00000100:00100000:0.0:1790771166.331422:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5916 00000100:00100000:2.0:1790771166.331429:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.331436:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14717:x1877759533832960:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.331446:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.331459:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853056 00000100:00100000:1.0:1790771166.331466:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853056 00000100:00100000:2.0:1790771166.331519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.331533:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853568 00000100:00100000:1.0:1790771166.331537:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853568 00000100:00100000:1.0:1790771166.331564:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 976 00000100:00100000:2.0:1790771166.331571:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.331577:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2399:x1877759533853056:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771166.331585:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.331594:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098bd9cbb/0xfa0c505d97f0ca9b lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3583d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.331596:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853696 00000100:00100000:2.0:1790771166.331602:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853696 00010000:00010000:0.0:1790771166.331626:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3572c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.331627:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533853952 00010000:00010000:3.0:1790771166.331627:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35844 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.331633:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533853952 00000100:00100000:1.0:1790771166.331645:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539742208:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.331674:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5917 00010000:00010000:0.0:1790771166.331678:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 124 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.331689:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13998:x1877759533857792:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.331691:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 124 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.331703:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:1.0:1790771166.331703:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829300 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.331708:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.331709:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.331713:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1800, rc 0) 00010000:00010000:3.0:1790771166.331720:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.331724:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cab0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358b4 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.331729:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 977 00010000:00010000:3.0:1790771166.331739:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 110 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.331740:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14717:x1877759533832960:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 306us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.331746:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533853568:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:0.0:1790771166.331759:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5916 00010000:00010000:1.0:1790771166.331763:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.331767:0:13765:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.331773:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331776:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0cabe lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35852 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.331782:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 111 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.331783:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5918 00010000:00010000:2.0:1790771166.331789:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.331799:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14851:x1877759533853312:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771166.331814:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.331816:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.331817:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.331824:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.331828:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539742336:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.331829:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3584b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.331829:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.331835:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.331856:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.331859:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c35180 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.331870:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.331884:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5919 00000100:00100000:1.0:1790771166.331895:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14916:x1877759533853696:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.331895:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597e00, rc 0) 00010000:00010000:0.0:1790771166.331902:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 112 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331906:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.331918:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 112 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.331919:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0cad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35859 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.331919:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.331927:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14113:x1877759533853184:12345-192.168.204.50@tcp:101:cat.0 Request processed in 543us (688us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.331939:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.331946:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.331947:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5915 00010000:00010000:0.0:1790771166.331950:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.331958:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0400, rc 0) 00010000:00010000:2.0:1790771166.331965:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.331970:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5920 00010000:00010000:1.0:1790771166.331976:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.331977:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.331985:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14851:x1877759533853312:12345-192.168.204.50@tcp:101:chown.0 Request processed in 187us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.331986:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14912:x1877759533853952:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.332002:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332003:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332003:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.332006:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5918 00010000:00010000:3.0:1790771166.332014:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35860 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332022:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.332029:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332030:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332034:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332051:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332054:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332057:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332076:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332080:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.332083:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.332085:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.332086:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.332089:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.332093:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.332099:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.332103:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332110:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.332116:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332120:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cab7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.332120:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.332127:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.332134:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0cad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35859 expref: 111 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332138:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.332141:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332142:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332155:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35859 expref: 110 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332163:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:0.0:1790771166.332170:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.332174:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35860 expref: 111 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332176:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332181:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.332188:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332190:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.332194:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595800, rc 0) 00010000:00010000:0.0:1790771166.332198:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0c339 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332211:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332212:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35860 expref: 110 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332220:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332221:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14916:x1877759533853696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 327us (700us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.332232:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.332240:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.332243:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332243:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5919 00010000:00010000:2.0:1790771166.332243:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332244:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.332249:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00010000:00010000:0.0:1790771166.332266:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332266:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332274:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14912:x1877759533853952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 292us (704us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.332290:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.332291:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5920 00010000:00010000:2.0:1790771166.332292:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb03146e00) 00010000:00010000:0.0:1790771166.332299:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332299:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000040:00080000:1.0:1790771166.332301:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].39, 552 off62656 00010000:00010000:2.0:1790771166.332307:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.332315:0:13771:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc3fa636c0 with version 78 00010000:00010000:0.0:1790771166.332316:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332321:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cacc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.332337:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 78 rpc_version 78 00010000:00010000:0.0:1790771166.332348:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.332351:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.332355:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332360:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0c515 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:1.0:1790771166.332367:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:2.0:1790771166.332371:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cab0 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358b4 expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332372:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.332381:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332383:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb06738700 x1877759539742592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1790771166.332386:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.332393:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.332399:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332403:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cab0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358b4 expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332411:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539742592:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.332413:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332426:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:13797:1877759539740928:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.332432:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.332438:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332444:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b000, rc 0) 00010000:00010000:0.0:1790771166.332445:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.332446:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.332453:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.332462:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771166.332465:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.332468:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332471:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2396:x1877759533846400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 21301us (21486us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.332478:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0c4b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332479:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13998:x1877759533857792:12345-192.168.204.50@tcp:101:ls.0 Request processed in 791us (1192us total) trans 4294969276 rc 301/301 00000100:00100000:1.0:1790771166.332481:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06c359c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.332508:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1626 00000100:00100000:1.0:1790771166.332522:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854080 00000100:00100000:1.0:1790771166.332528:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854080 00000100:00100000:2.0:1790771166.332529:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5917 00010000:00010000:0.0:1790771166.332533:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332540:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332545:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332550:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.332554:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332559:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332565:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5921 00010000:00010000:0.0:1790771166.332568:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc08974a00) 00000100:00100000:3.0:1790771166.332573:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.332574:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.332579:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332585:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14911:x1877759533854080:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.332588:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0c792 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332595:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.332597:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854208 00000100:00100000:3.0:1790771166.332602:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854208 00010000:00010000:2.0:1790771166.332609:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0caf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35867 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332638:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1530 00000100:00100000:1.0:1790771166.332640:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.332641:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.332650:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14660:x1877759533854208:12345-192.168.204.50@tcp:37:chown.0 00010000:00010000:2.0:1790771166.332657:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.332661:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833984 00000100:00100000:0.0:1790771166.332679:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833984 00010000:00010000:2.0:1790771166.332683:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332695:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.332711:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.332713:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5922 00000004:00200000:2.0:1790771166.332715:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.332719:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854592 00000100:00100000:1.0:1790771166.332724:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854592 00000100:00100000:0.0:1790771166.332725:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13266:x1877759533833984:12345-192.168.204.50@tcp:101:ls.0 00000004:00010000:2.0:1790771166.332728:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332737:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.332742:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 124 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332748:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cb04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3573a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.332748:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0caf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35867 expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332771:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1632 00010000:00010000:2.0:1790771166.332780:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35867 expref: 110 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.332781:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2398:x1877759533854592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.332795:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.332796:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332797:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.332800:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.332806:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b800, rc 0) 00010000:00010000:1.0:1790771166.332807:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 125 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332811:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332823:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 125 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332825:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332828:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14911:x1877759533854080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 250us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.332847:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5921 00010000:00010000:0.0:1790771166.332851:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332859:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.332861:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.332868:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332870:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539742592 00010000:00010000:0.0:1790771166.332873:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.332876:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539742592 00010000:00010000:1.0:1790771166.332880:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.332900:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2398:x1877759533854592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.332907:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1790771166.332911:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1632 00000100:00100000:2.0:1790771166.332923:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7768:x1877759539742592:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.332925:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332935:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332941:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.332957:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.332960:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.332966:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771166.332972:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332981:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332986:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332991:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332995:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.332999:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.333002:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333008:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.333011:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333020:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.333022:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.333024:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333029:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cb0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333038:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333043:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333051:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.333055:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333061:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.333063:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333068:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333075:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc22108200) 00010000:00010000:0.0:1790771166.333077:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.333081:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333082:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.333089:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cb12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333102:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854848 00000100:00100000:1.0:1790771166.333106:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854848 00010000:00010000:0.0:1790771166.333115:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cb04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3573a expref: 125 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333128:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3573a expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333129:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854976 00000100:00100000:1.0:1790771166.333134:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854976 00010000:00010000:0.0:1790771166.333139:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:0.0:1790771166.333141:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790771166.333143:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592200, rc 0) 00000100:00100000:0.0:1790771166.333162:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13266:x1877759533833984:12345-192.168.204.50@tcp:101:ls.0 Request processed in 439us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.333164:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855104 00000100:00100000:1.0:1790771166.333169:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855104 00000100:00100000:0.0:1790771166.333174:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5922 00000100:00100000:3.0:1790771166.333184:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5923 00000100:00100000:3.0:1790771166.333196:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14914:x1877759533854848:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.333197:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5924 00000100:00100000:2.0:1790771166.333207:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7768:x1877759539742592:12345-0@lo:1000:osp_up1-0.0 Request processed in 285us (754us total) trans 4294968686 rc 0/0 00000100:00100000:1.0:1790771166.333208:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5925 00010000:00010000:3.0:1790771166.333210:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.333214:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14917:x1877759533854976:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.333227:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.333227:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14432:x1877759533855104:12345-192.168.204.50@tcp:41:rm.0 00000100:00100000:2.0:1790771166.333227:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00010000:00010000:3.0:1790771166.333227:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0cb20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35875 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333238:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0cb27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3587c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000024:1.0:1790771166.333263:0:13766:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7841333248 avail 7362322432 00010000:00010000:0.0:1790771166.333274:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333286:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333294:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14432:x1877759533855104:12345-192.168.204.50@tcp:41:rm.0 Request processed in 73us (211us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.333299:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333301:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333305:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5925 00000100:00100000:2.0:1790771166.333314:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539742592:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771166.333320:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.333330:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.333334:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.333338:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.333347:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000590fd218 reply state 0000000054140c7c transno 4294969274 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.333348:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.333349:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771166.333350:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.333356:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.333369:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.333374:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333383:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.333385:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0cb27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3587c expref: 115 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.333392:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfc310f2500) 00010000:00010000:3.0:1790771166.333393:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0cb20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35875 expref: 115 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.333400:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.333403:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855232 00000100:00100000:2.0:1790771166.333404:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.333406:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3587c expref: 114 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.333409:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855232 00010000:00010000:2.0:1790771166.333412:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.333419:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35875 expref: 113 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333421:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.333429:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.333433:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 978 00010000:00010000:0.0:1790771166.333435:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00010000:00010000:3.0:1790771166.333446:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.333448:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2398:x1877759533855232:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:3.0:1790771166.333454:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.333456:0:13771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.333460:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14917:x1877759533854976:12345-192.168.204.50@tcp:101:ls.0 Request processed in 249us (409us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.333461:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfca00, rc 0) 00000100:00100000:0.0:1790771166.333475:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5924 00000004:00080000:2.0:1790771166.333477:0:13771:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x2:0x0] 00000100:00100000:3.0:1790771166.333525:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14914:x1877759533854848:12345-192.168.204.50@tcp:101:ls.0 Request processed in 331us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.333532:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5923 00000100:00100000:0.0:1790771166.333539:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854336 00000004:00010000:2.0:1790771166.333540:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000590fd218 reply state 0000000054140c7c transno 4294969274 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.333544:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854336 00010000:00010000:2.0:1790771166.333556:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.333560:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/28 (0->18446744073709551615) 00002000:00100000:0.0:1790771166.333565:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1fa680 with x1877759533854336 ext(0->18446744073709551615) 00010000:00010000:2.0:1790771166.333566:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc310f2800) 00002000:00010000:0.0:1790771166.333572:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d1fa680. 00010000:00010000:2.0:1790771166.333572:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.333577:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1790771166.333584:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.333594:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 406 00000100:00100000:0.0:1790771166.333602:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533854336:12345-192.168.204.50@tcp:10:cp.0 00010000:00080000:2.0:1790771166.333614:0:13771:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771166.333626:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14265:x1877759533852160:12345-192.168.204.50@tcp:36:chown.0 Request processed in 4775us (5081us total) trans 4294969274 rc 0/0 00000100:00100000:2.0:1790771166.333634:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5905 00010000:00010000:0.0:1790771166.333679:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333686:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.333687:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533854720 00010000:00010000:0.0:1790771166.333694:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.333694:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533854720 00010000:00010000:0.0:1790771166.333701:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.333704:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333710:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333718:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc310f2800) 00010000:00010000:0.0:1790771166.333721:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.333723:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.333727:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1531 00010000:00010000:0.0:1790771166.333735:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0c9c2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.333739:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14331:x1877759533854720:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:0.0:1790771166.333753:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333759:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333764:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333767:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.333769:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333773:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.333774:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.333779:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.333784:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfc310f2500) 00010000:00010000:0.0:1790771166.333787:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.333789:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.333793:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0c9d0 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.333837:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14331:x1877759533854720:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 100us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.333848:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.333850:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1531 00000100:00100000:3.0:1790771166.333925:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533833856 00000100:00100000:3.0:1790771166.333930:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533833856 00002000:00010000:0.0:1790771166.333956:0:13795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790771166.333960:0:13795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime from disk: 1674053537 -> 1790771166 00000100:00100000:3.0:1790771166.333962:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5926 00002000:00010000:0.0:1790771166.333964:0:13795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771166.333968:0:13795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00000100:00100000:3.0:1790771166.333976:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13263:x1877759533833856:12345-192.168.204.50@tcp:101:ls.0 00002000:00010000:0.0:1790771166.333977:0:13795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771166.333977:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.333989:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.333999:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35733 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.334007:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533854336:12345-192.168.204.50@tcp:10:cp.0 Request processed in 404us (656us total) trans 4294967612 rc 0/0 00000100:00100000:1.0:1790771166.334014:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855360 00000100:00100000:0.0:1790771166.334015:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 406 00010000:00010000:3.0:1790771166.334017:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.334021:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/28 (0->18446744073709551615) 00000100:00100000:1.0:1790771166.334021:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855360 00002000:00100000:0.0:1790771166.334028:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1fa680 with x1877759533854336 ext(0->18446744073709551615) 00000100:00100000:2.0:1790771166.334033:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.334034:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.334036:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d1fa680. 00010000:00010000:3.0:1790771166.334045:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.334048:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.334050:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd800, rc 0) 00010000:00010000:1.0:1790771166.334058:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334070:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13263:x1877759533833856:12345-192.168.204.50@tcp:101:ls.0 Request processed in 100us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.334081:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5926 00000100:00100000:0.0:1790771166.334082:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2396:x1877759533838848:12345-192.168.204.50@tcp:4:cat.0 Request processed in 106508us (106820us total) trans 4294967611 rc 0/0 00000100:00100000:0.0:1790771166.334091:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 93 00002000:00100000:0.0:1790771166.334098:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x14:0x0] (10682368->14614527) req@ffff8bfb04971f80 x1877759533838848/t4294967611(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.334100:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835520 00000100:00100000:3.0:1790771166.334106:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835520 00000100:00100000:2.0:1790771166.334107:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.334111:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1633 00002000:00100000:0.0:1790771166.334120:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb04971f80 with x1877759533838848 ext(10682368->14614527) 00010000:00010000:0.0:1790771166.334127:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 31 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334136:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855744 00010000:00010000:0.0:1790771166.334139:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 31 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334140:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855744 00000100:00100000:1.0:1790771166.334147:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533855360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:0.0:1790771166.334153:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb04971f80 00000100:00100000:2.0:1790771166.334163:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.334164:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.334169:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5927 00002000:00010000:1.0:1790771166.334174:0:7434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x14:0x0] updating lvb blocks from disk: 6016 -> 16384 00000100:00100000:3.0:1790771166.334179:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14796:x1877759533835520:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.334184:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334188:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.334191:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856512 00010000:00010000:1.0:1790771166.334198:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.334198:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856512 00010000:00010000:3.0:1790771166.334199:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0cb43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35748 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334231:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444c41f0/0xfa0c505d97f0a53a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 6 type: EXT [9306112->10682367] (req 9306112->9371647) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34af3 expref: 26 pid: 8409 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.334231:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1532 00010000:00010000:3.0:1790771166.334238:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.334249:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14509:x1877759533856512:12345-192.168.204.50@tcp:35:5.0 00010000:00010000:1.0:1790771166.334254:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.334254:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334263:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.334276:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533855360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.334288:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5928 00000100:00100000:1.0:1790771166.334289:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1633 00000100:00100000:3.0:1790771166.334303:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14909:x1877759533855744:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.334310:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.334324:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cb51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3588a expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334350:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334357:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334364:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.334371:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14509:x1877759533856512:12345-192.168.204.50@tcp:35:5.0 Request processed in 126us (212us total) trans 4294968687 rc 0/0 00000100:00100000:2.0:1790771166.334379:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1532 00000004:00200000:3.0:1790771166.334381:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.334385:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.334396:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334416:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cb51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3588a expref: 114 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.334418:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539741056:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.334447:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3588a expref: 113 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.334453:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.334455:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.334458:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfcc00, rc 0) 00010000:00010000:1.0:1790771166.334462:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.334481:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14909:x1877759533855744:12345-192.168.204.50@tcp:101:ls.0 Request processed in 182us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.334510:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5928 00010000:00010000:2.0:1790771166.334576:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000cf1c26bb x1877759539741312) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 107 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334593:0:13768:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000dc89aaec x1877759539741184) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 1/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 107 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334595:0:13761:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 107 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334621:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0b38e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x42:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f61 expref: 107 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334622:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0c28a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3551f expref: 107 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334628:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.334660:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a10380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539741312:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.334674:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0000_UUID:13768:1877759539741184:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.334703:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771166.334704:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:2.0:1790771166.334709:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334712:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334723:0:13761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334725:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334733:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.334747:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334750:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334773:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334780:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.334782:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.334789:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.334825:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000976849c2 reply state 0000000048bf0b73 transno 4294969277 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334835:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.334842:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:1.0:1790771166.334844:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.334847:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.334858:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771166.334863:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004950d243 reply state 00000000744f4927 transno 4294969278 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334872:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.334878:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.334881:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.334883:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.334889:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14583:x1877759533849216:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 8428us (8520us total) trans 4294969277 rc 0/0 00000100:00100000:1.0:1790771166.334897:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5901 00000100:00100000:1.0:1790771166.334917:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856768 00000100:00100000:1.0:1790771166.334920:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856768 00000100:00100000:2.0:1790771166.334940:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14327:x1877759533849344:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 8457us (8526us total) trans 4294969278 rc 0/0 00000100:00100000:1.0:1790771166.334949:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835648 00000100:00100000:3.0:1790771166.334951:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.334953:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835648 00000100:00100000:2.0:1790771166.334957:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5902 00000100:00100000:1.0:1790771166.334982:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5929 00000100:00100000:2.0:1790771166.334983:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533857408 00000100:00100000:2.0:1790771166.334989:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533857408 00000100:00100000:1.0:1790771166.334996:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14856:x1877759533856768:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:3.0:1790771166.335005:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.335016:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.335019:0:13768:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0c28a) 00010000:00010000:1.0:1790771166.335022:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.335023:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533855872 00000100:00100000:2.0:1790771166.335026:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533855872 00010000:00010000:1.0:1790771166.335042:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335051:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.335061:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.335064:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.335067:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5930 00000100:00100000:2.0:1790771166.335085:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14801:x1877759533835648:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.335095:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.335107:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cb66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3574f expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.335128:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000098d1e1fd reply state 00000000a8cd41a5 transno 4294969279 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335138:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335138:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335159:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.335161:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335162:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.335166:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.335176:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335207:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14856:x1877759533856768:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 214us (584us total) trans 4294969279 rc 0/0 00000100:00100000:1.0:1790771166.335215:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5929 00010000:00010000:2.0:1790771166.335229:0:13792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000cebccbe1 x1877759539741440) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335241:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5931 00010000:00010000:2.0:1790771166.335247:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0c967 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356e6 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335256:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14876:x1877759533857408:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:2.0:1790771166.335271:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06a11880 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741440:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.335274:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790771166.335289:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596400/0xfa0c505d97f0c991 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3581a expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335300:0:13792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000097daaed2 x1877759539741568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 130 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335311:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f065df lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e334c6 expref: 113 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335319:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0c8bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35637 expref: 130 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335335:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:1.0:1790771166.335340:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.335343:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03c6dc00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741568:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.335349:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335360:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 113 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335368:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 113 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.335374:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5932 00010000:00010000:1.0:1790771166.335378:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 113 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335385:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 6/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.335389:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14913:x1877759533855872:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.335399:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.335408:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 113 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335411:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0cb7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35891 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335420:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 113 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335431:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742720:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.335443:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.335443:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856896 00000100:00100000:3.0:1790771166.335449:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856896 00010000:00010000:2.0:1790771166.335454:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335462:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.335479:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.335482:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.335512:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.335517:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 407 00010000:00010000:1.0:1790771166.335529:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 113 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.335532:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533856896:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:2.0:1790771166.335542:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0cb7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35891 expref: 114 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335560:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 113 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335571:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742848:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.335580:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35891 expref: 113 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.335588:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.335591:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.335593:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60200, rc 0) 00000100:00100000:2.0:1790771166.335620:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14913:x1877759533855872:12345-192.168.204.50@tcp:101:ls.0 Request processed in 237us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.335630:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5932 00010000:00010000:1.0:1790771166.335632:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 113 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.335647:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 113 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.335674:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742976:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.335710:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc086296c0 going to sleep for 11 seconds 00000001:00080000:2.0:1790771166.335736:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967611 is committed 00000001:00080000:2.0:1790771166.335751:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967609 is committed 00000100:00100000:1.0:1790771166.335757:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533857152 00000100:00100000:1.0:1790771166.335762:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533857152 00000100:00100000:1.0:1790771166.335792:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858048 00000100:00100000:1.0:1790771166.335795:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858048 00002000:00010000:3.0:1790771166.335795:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 47794 -> 47794 00002000:00010000:3.0:1790771166.335802:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771166.335806:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.335809:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771166.335814:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 72 -> 56 00000100:00100000:2.0:1790771166.335815:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533855232:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2368us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.335826:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1533 00000100:00100000:2.0:1790771166.335830:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 978 00000100:00100000:1.0:1790771166.335840:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:11804:x1877759533857152:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.335861:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1534 00000100:00100000:2.0:1790771166.335872:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14000:x1877759533858048:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.335905:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533856896:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 375us (899us total) trans 4294967606 rc 0/0 00000100:00100000:3.0:1790771166.335916:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 407 00000100:00100000:1.0:1790771166.335949:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:11804:x1877759533857152:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (1166us total) trans 4294969280 rc 0/0 00000100:00100000:1.0:1790771166.335957:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1533 00000100:00100000:3.0:1790771166.335964:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533847936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9863us (9952us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.335974:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14000:x1877759533858048:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (916us total) trans 4294969281 rc 0/0 00000100:00100000:3.0:1790771166.335974:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1629 00000100:00100000:2.0:1790771166.335986:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1534 00000100:00100000:2.0:1790771166.357178:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.357261:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533861248 00000100:00100000:1.0:1790771166.357271:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533861248 00000100:00100000:2.0:1790771166.357308:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.357328:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04970000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741696:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.357343:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5933 00010000:00010000:0.0:1790771166.357357:0:13792:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000af1662de x1877759539741824) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 128 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.357359:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:12119:x1877759533861248:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.357363:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858304 00000100:00100000:2.0:1790771166.357370:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858304 00010000:00010000:1.0:1790771166.357392:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.357394:0:13792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 129 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.357403:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1535 00010000:00010000:1.0:1790771166.357411:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0cb89 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358c9 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.357416:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14077:x1877759533858304:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:0.0:1790771166.357429:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0c82c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35629 expref: 129 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357448:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04971180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539741824:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.357478:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357481:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771166.357510:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.357529:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357531:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357549:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357551:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357566:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357573:0:13792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357576:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357584:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.357587:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.357596:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.357624:0:13788:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size: 2949120 -> 3407872 00000100:00100000:3.0:1790771166.357626:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.357641:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:13788:1877759539741952:192.168.204.50@tcp:106: 00000001:00080000:2.0:1790771166.357655:0:13790:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969282 00010000:00010000:0.0:1790771166.357677:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c9a6 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3582f expref: 25 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357696:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000600a4567/0xfa0c505d97f0c9a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3582f expref: 25 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.357699:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.357710:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00000100:00100000:3.0:1790771166.357735:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.357758:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357762:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533852032:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 29373us (29647us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.357772:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357774:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 975 00010000:00010000:1.0:1790771166.357782:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357791:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357796:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.357800:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357802:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856000 00000100:00100000:2.0:1790771166.357807:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14077:x1877759533858304:12345-192.168.204.50@tcp:35:cat.0 Request processed in 391us (499us total) trans 4294969283 rc 0/0 00000100:00100000:0.0:1790771166.357808:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856000 00010000:00010000:1.0:1790771166.357811:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.357820:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1535 00010000:00010000:1.0:1790771166.357824:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000020:00080000:2.0:1790771166.357826:0:13790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.357829:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.357835:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357840:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835776 00010000:00010000:1.0:1790771166.357840:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cb90 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.357843:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858432 00000100:00100000:0.0:1790771166.357845:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835776 00000100:00100000:2.0:1790771166.357851:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858432 00010000:00010000:1.0:1790771166.357858:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357865:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357870:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357874:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5934 00000100:00100000:2.0:1790771166.357879:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858944 00010000:00010000:1.0:1790771166.357881:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.357883:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858944 00010000:00010000:1.0:1790771166.357885:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.357889:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14915:x1877759533856000:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.357902:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357907:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.357911:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc3600d300) 00000100:00100000:2.0:1790771166.357913:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1536 00010000:00010000:1.0:1790771166.357915:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.357920:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357921:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0cba5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35898 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.357928:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cb97 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.357929:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14805:x1877759533858432:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:1.0:1790771166.357969:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0cb89 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358c9 expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.357975:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.357978:0:13790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.357979:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:3.0:1790771166.357980:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.357988:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000004:00200000:2.0:1790771166.357988:0:13790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.357997:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0cb89 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358c9 expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358002:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358005:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594a00, rc 0) 00010000:00010000:0.0:1790771166.358017:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.358043:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.358047:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.358060:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358087:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0cba5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35898 expref: 115 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358109:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35898 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358118:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.358121:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.358125:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592600, rc 0) 00000100:00100000:3.0:1790771166.358149:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533859456 00000100:00100000:3.0:1790771166.358156:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533859456 00000100:00100000:2.0:1790771166.358157:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14805:x1877759533858432:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 232us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.358163:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:12119:x1877759533861248:12345-192.168.204.50@tcp:101:ls.0 Request processed in 808us (992us total) trans 4294968688 rc 301/301 00000100:00100000:0.0:1790771166.358172:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14915:x1877759533856000:12345-192.168.204.50@tcp:101:ls.0 Request processed in 282us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.358180:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5933 00000100:00100000:2.0:1790771166.358181:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1536 00000100:00100000:0.0:1790771166.358192:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5934 00000100:00100000:1.0:1790771166.358212:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5935 00000100:00100000:2.0:1790771166.358217:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1537 00000100:00100000:3.0:1790771166.358222:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5936 00000100:00100000:1.0:1790771166.358225:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14802:x1877759533835776:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.358232:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:12016:x1877759533858944:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.358233:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.358237:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14499:x1877759533859456:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771166.358246:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cbb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35756 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358278:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358287:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358297:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.358306:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.358340:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:12016:x1877759533858944:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (754us total) trans 4294968689 rc 0/0 00000100:00100000:2.0:1790771166.358347:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1537 00000100:00100000:0.0:1790771166.358362:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.358380:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533859840 00000100:00100000:1.0:1790771166.358385:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533859840 00000100:00100000:0.0:1790771166.358400:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.358420:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1538 00000100:00100000:1.0:1790771166.358433:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13672:x1877759533859840:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.358437:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.358454:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533860224 00000100:00100000:0.0:1790771166.358460:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533860224 00000100:00100000:2.0:1790771166.358467:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.358516:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533860352 00000100:00100000:0.0:1790771166.358520:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533860352 00000100:00100000:3.0:1790771166.358531:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14499:x1877759533859456:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 299us (554us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.358541:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1539 00000100:00100000:3.0:1790771166.358541:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5936 00000100:00100000:0.0:1790771166.358559:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08479850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14487:x1877759533860224:12345-192.168.204.50@tcp:35:touch.0 00000100:00100000:2.0:1790771166.358568:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.358569:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13672:x1877759533859840:12345-192.168.204.50@tcp:35:ls.0 Request processed in 136us (204us total) trans 4294968690 rc 0/0 00000100:00100000:1.0:1790771166.358578:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1538 00000100:00100000:3.0:1790771166.358596:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533859200 00000100:00100000:1.0:1790771166.358597:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1540 00000100:00100000:3.0:1790771166.358602:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533859200 00000100:00100000:1.0:1790771166.358610:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:12123:x1877759533860352:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.358611:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.358631:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533866624 00000100:00100000:3.0:1790771166.358635:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533866624 00000100:00100000:2.0:1790771166.358672:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.358673:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533835904 00000100:00100000:3.0:1790771166.358679:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533835904 00000100:00100000:0.0:1790771166.358706:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08479850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14487:x1877759533860224:12345-192.168.204.50@tcp:35:touch.0 Request processed in 153us (274us total) trans 4294968691 rc 0/0 00000100:00100000:2.0:1790771166.358710:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533836288 00000100:00100000:3.0:1790771166.358710:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533860992 00000100:00100000:0.0:1790771166.358715:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1539 00000100:00100000:2.0:1790771166.358717:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533836288 00000100:00100000:3.0:1790771166.358718:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533860992 00000100:00100000:1.0:1790771166.358725:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:12123:x1877759533860352:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (256us total) trans 4294968692 rc 0/0 00000100:00100000:1.0:1790771166.358732:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1540 00000100:00100000:2.0:1790771166.358766:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5937 00000100:00100000:3.0:1790771166.358773:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5938 00000100:00100000:2.0:1790771166.358777:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13665:x1877759533859200:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.358784:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5939 00000100:00100000:3.0:1790771166.358787:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14000:x1877759533866624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.358790:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.358796:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5940 00000100:00100000:1.0:1790771166.358797:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14795:x1877759533835904:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.358801:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.358804:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0cbc1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358bb expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.358810:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14797:x1877759533836288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.358811:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.358813:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0cbc8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35916 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358826:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cbcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3575d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358828:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.358839:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cbd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3576b expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358858:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358868:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358875:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358891:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.358893:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358894:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358898:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358903:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358918:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.358927:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.358928:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358935:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.358935:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.358956:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.358963:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.358974:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.358982:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.358989:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5941 00010000:00010000:2.0:1790771166.358989:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.358998:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.359003:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:13663:x1877759533860992:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:3.0:1790771166.359035:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359043:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359048:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.359049:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.359059:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.359063:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359068:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359074:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:1.0:1790771166.359081:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.359081:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.359086:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539743104:0@lo:1000:mdt00_014.0 00010000:00010000:3.0:1790771166.359086:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359098:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0cbdd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359100:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359108:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359110:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359120:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359122:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359132:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.359140:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4aa00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.359141:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.359143:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359146:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359152:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.359159:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359170:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359173:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359179:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.359180:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3faee300 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.359200:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.359204:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.359205:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539743104 00010000:00010000:3.0:1790771166.359207:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc08974c00) 00000100:00100000:0.0:1790771166.359210:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539743104 00010000:00010000:2.0:1790771166.359211:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359213:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.359220:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359225:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.359228:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cbeb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359234:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cbf2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359243:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00010000:00010000:2.0:1790771166.359252:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359256:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:13769:x1877759539743104:12345-0@lo:1000:mdt00_014.0 00000100:00100000:1.0:1790771166.359271:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.359271:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359276:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0cbc8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35916 expref: 112 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359287:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359291:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.359297:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.359301:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.359303:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0cbc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35916 expref: 112 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359310:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359314:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597800, rc 0) 00010000:00010000:2.0:1790771166.359325:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359331:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:13769:x1877759539743104:12345-0@lo:1000:mdt00_014.0 Request processed in 78us (193us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.359338:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc34224f00) 00000100:00100000:0.0:1790771166.359344:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00010000:00010000:2.0:1790771166.359346:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.359346:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14000:x1877759533866624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 560us (943us total) trans 4294969284 rc 301/301 00010000:00010000:2.0:1790771166.359351:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359358:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5938 00000100:00100000:1.0:1790771166.359369:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.359370:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858688 00010000:00010000:2.0:1790771166.359370:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cc00 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359376:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858688 00000100:00100000:3.0:1790771166.359379:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533861504 00000100:00100000:3.0:1790771166.359384:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533861504 00010000:00010000:2.0:1790771166.359410:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0cbc1 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358bb expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359413:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533858560 00000100:00100000:0.0:1790771166.359420:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533858560 00000100:00100000:3.0:1790771166.359421:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5942 00010000:00010000:2.0:1790771166.359422:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.359427:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.359429:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.359438:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 136 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359439:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14096:x1877759533861504:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771166.359440:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0cbc1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358bb expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359454:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.359467:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0cc15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358d7 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359470:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a200, rc 0) 00000100:00100000:0.0:1790771166.359480:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533860736 00000100:00100000:0.0:1790771166.359509:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533860736 00000100:00100000:1.0:1790771166.359513:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8406:1877759539742208:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.359523:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0cc15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358d7 expref: 112 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.359530:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13665:x1877759533859200:12345-192.168.204.50@tcp:101:ls.0 Request processed in 752us (1225us total) trans 4294968693 rc 301/301 00010000:00010000:1.0:1790771166.359537:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098bd9cbb/0xfa0c505d97f0ca9b lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3583d expref: 23 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359538:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597a00/0xfa0c505d97f0cc15 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358d7 expref: 112 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359543:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1634 00000100:00100000:2.0:1790771166.359552:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5937 00000100:00100000:0.0:1790771166.359559:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2397:x1877759533858560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.359572:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00010000:00010000:0.0:1790771166.359575:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.359577:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098bd9cbb/0xfa0c505d97f0ca9b lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3583d expref: 23 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.359578:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862272 00010000:00010000:3.0:1790771166.359578:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771166.359584:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 137 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359584:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597a00, rc 0) 00000100:00100000:2.0:1790771166.359586:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862272 00010000:00010000:1.0:1790771166.359600:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594800, rc 0) 00010000:00010000:0.0:1790771166.359605:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 137 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359614:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14096:x1877759533861504:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 180us (393us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.359622:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0c8aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3563e expref: 137 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359622:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5942 00000100:00100000:1.0:1790771166.359630:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759533853056:12345-192.168.204.50@tcp:101:chown.0 Request processed in 28054us (28498us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.359635:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5943 00010000:00010000:0.0:1790771166.359649:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.359655:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 976 00010000:00010000:0.0:1790771166.359656:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359675:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 785 00000100:00100000:2.0:1790771166.359685:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14746:x1877759533862272:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.359686:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359693:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533858688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.359706:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40290400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359708:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.359715:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40290400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359724:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0ca5c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35836 expref: 120 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.359725:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 111 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.359731:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.359751:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.359751:0:8676:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime: 1790771165 -> 1790771166 00010000:00010000:3.0:1790771166.359751:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.359756:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 115 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359760:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359768:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539742336:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.359785:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.359786:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.359787:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 115 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.359798:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0cabe lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35852 expref: 22 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.359804:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.359810:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:2397:x1877759533858560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 253us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.359829:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2397:x1877759533858688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (749us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.359831:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 119 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359835:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1634 00010000:00010000:1.0:1790771166.359837:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0cabe lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35852 expref: 22 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.359850:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 785 00010000:00010000:2.0:1790771166.359856:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 6/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.359861:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 786 00010000:00010000:1.0:1790771166.359862:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:0.0:1790771166.359876:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:2397:x1877759533860736:12345-192.168.204.50@tcp:103:ln.0 00010000:00010000:0.0:1790771166.359885:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.359891:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359896:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2398:x1877759533853568:12345-192.168.204.50@tcp:101:chown.0 Request processed in 28152us (28467us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.359898:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0828e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33dda expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.359916:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 977 00010000:00010000:2.0:1790771166.359917:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 118 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.359920:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff8bfc3607dd00) 00010000:00010000:0.0:1790771166.359928:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.359935:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.359953:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533860736:12345-192.168.204.50@tcp:103:ln.0 Request processed in 79us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.359960:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 786 00000100:00100000:1.0:1790771166.359984:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.360005:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 115 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.360006:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533861760 00000100:00100000:1.0:1790771166.360011:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533861760 00010000:00010000:2.0:1790771166.360020:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 115 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360023:0:13792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360034:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360036:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.360037:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862656 00000100:00100000:1.0:1790771166.360042:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862656 00010000:00010000:0.0:1790771166.360064:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360071:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.360071:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1541 00010000:00010000:0.0:1790771166.360082:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.360086:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14827:x1877759533861760:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771166.360095:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 115 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360101:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.360107:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 115 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360109:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.360122:0:6496:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.360130:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.360130:0:6496:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.360141:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743488:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.360161:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14827:x1877759533861760:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 78us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.360167:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1541 00000100:00100000:2.0:1790771166.360172:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc205cc540 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.360187:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1542 00000100:00100000:1.0:1790771166.360195:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14008:x1877759533862656:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.360203:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360215:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360225:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360241:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360251:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360260:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360289:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360336:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360357:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360384:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360403:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360420:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360437:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360458:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.360512:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:0.0:1790771166.360526:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off11048 00000100:00100000:2.0:1790771166.360535:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533861888 00000100:00100000:2.0:1790771166.360541:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533861888 00000040:00080000:0.0:1790771166.360552:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10848 00000040:00080000:0.0:1790771166.360564:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off11112 00000100:00100000:2.0:1790771166.360576:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862912 00000100:00100000:2.0:1790771166.360581:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862912 00000100:00100000:3.0:1790771166.360611:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863168 00000100:00100000:3.0:1790771166.360617:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863168 00010000:00010000:0.0:1790771166.360618:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360621:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 979 00010000:00010000:0.0:1790771166.360630:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360638:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759533861888:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:0.0:1790771166.360639:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360651:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.360652:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 980 00010000:00010000:0.0:1790771166.360654:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360675:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.360680:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533862912:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:0.0:1790771166.360686:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:0.0:1790771166.360689:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790771166.360693:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360697:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0cc31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x42:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.360706:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009dc70b3d reply state 00000000ae79acd9 transno 4294969285 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360713:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360718:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00010000:00010000:0.0:1790771166.360721:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1790771166.360723:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.360726:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360730:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360735:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360739:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.360741:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360747:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.360750:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 2272 -> 2272 00010000:00010000:0.0:1790771166.360753:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00002000:00010000:2.0:1790771166.360755:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00010000:00010000:0.0:1790771166.360757:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:2.0:1790771166.360758:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771165 00002000:00010000:2.0:1790771166.360763:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.360763:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb size from disk: 23456 -> 23456 00010000:00010000:0.0:1790771166.360764:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.360768:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8216 -> 8 00002000:00010000:3.0:1790771166.360771:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb mtime from disk: 1790771166 -> 1790771165 00002000:00010000:3.0:1790771166.360777:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb atime from disk: 1790771161 -> 1752421453 00002000:00010000:3.0:1790771166.360783:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.360786:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x12:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:2.0:1790771166.360793:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533861888:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 159us (453us total) trans 4294967613 rc 0/0 00010000:00010000:0.0:1790771166.360794:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360804:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 979 00000100:00100000:3.0:1790771166.360811:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533862912:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 149us (450us total) trans 4294967607 rc 0/0 00000100:00100000:2.0:1790771166.360825:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 981 00000100:00100000:3.0:1790771166.360837:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 980 00010000:00010000:0.0:1790771166.360838:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360838:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533863168:12345-192.168.204.50@tcp:2:chmod.0 00010000:00010000:0.0:1790771166.360858:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360869:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360880:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360889:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360895:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.360899:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863552 00010000:00010000:0.0:1790771166.360900:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.360901:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb size from disk: 10485760 -> 10485760 00000100:00100000:1.0:1790771166.360905:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863552 00000100:00100000:3.0:1790771166.360906:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14660:x1877759533854208:12345-192.168.204.50@tcp:37:chown.0 Request processed in 28256us (28333us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771166.360909:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.360916:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb atime from disk: 1790771161 -> 1752421453 00002000:00010000:2.0:1790771166.360923:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:0.0:1790771166.360925:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.360925:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533864064 00002000:00010000:2.0:1790771166.360926:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x19:0x0] updating lvb blocks from disk: 384 -> 384 00000100:00100000:1.0:1790771166.360931:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533864064 00000100:00100000:3.0:1790771166.360932:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1530 00010000:00010000:0.0:1790771166.360943:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.360951:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.360953:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533863168:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 117us (438us total) trans 4294967608 rc 0/0 00000100:00100000:1.0:1790771166.360959:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1543 00000100:00100000:2.0:1790771166.360973:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 981 00000100:00100000:1.0:1790771166.360976:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14331:x1877759533863552:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:3.0:1790771166.360980:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1544 00010000:00010000:0.0:1790771166.360987:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.360994:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14478:x1877759533864064:12345-192.168.204.50@tcp:49:dd.0 00010000:00010000:0.0:1790771166.361004:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.361008:0:13778:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.361010:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.361013:0:13778:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.361022:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.361025:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361031:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361035:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361041:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361045:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361051:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14331:x1877759533863552:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 77us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.361055:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14478:x1877759533864064:12345-192.168.204.50@tcp:49:dd.0 Request processed in 62us (593us total) trans 0 rc -61/-61 00010000:00010000:0.0:1790771166.361061:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.361070:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.361073:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1543 00000100:00100000:3.0:1790771166.361088:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1544 00000100:00100000:1.0:1790771166.361101:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862528 00000100:00100000:1.0:1790771166.361105:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862528 00000100:00100000:2.0:1790771166.361120:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.361128:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361132:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361134:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863040 00000100:00100000:1.0:1790771166.361139:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863040 00010000:00010000:2.0:1790771166.361145:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361158:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361161:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539743616:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.361163:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361165:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 982 00000100:00100000:1.0:1790771166.361179:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2396:x1877759533862528:12345-192.168.204.50@tcp:2:chmod.0 00000004:00200000:3.0:1790771166.361201:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.361207:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 114 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.361208:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.361208:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:2.0:1790771166.361216:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.361225:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361226:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539743744:192.168.204.50@tcp:105: 00000004:00010000:2.0:1790771166.361237:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361249:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10487f00 going to sleep for 11 seconds 00002000:00010000:1.0:1790771166.361253:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 2272 -> 2272 00010000:00010000:3.0:1790771166.361254:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0cb43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 133 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.361259:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771166.361266:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771165 -> 1790771165 00010000:00010000:2.0:1790771166.361269:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cb66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.361270:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:1.0:1790771166.361277:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1790771166.361278:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 132 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361287:0:13769:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969132 gen 2 00000004:00080000:0.0:1790771166.361296:0:13769:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969132 committed transno 4294969132 00010000:00010000:3.0:1790771166.361297:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.361301:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.361303:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd600, rc 0) 00000100:00100000:1.0:1790771166.361307:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2396:x1877759533862528:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 127us (242us total) trans 4294967614 rc 0/0 00010000:00010000:2.0:1790771166.361309:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361326:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539743104:0@lo:1000:mdt00_014.0 00000100:00100000:1.0:1790771166.361327:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 982 00010000:00010000:2.0:1790771166.361328:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771166.361328:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14796:x1877759533835520:12345-192.168.204.50@tcp:101:ls.0 Request processed in 27149us (27296us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.361336:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.361341:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a400, rc 0) 00000100:00100000:3.0:1790771166.361342:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5927 00000100:00100000:1.0:1790771166.361358:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 983 00000100:00100000:3.0:1790771166.361363:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862784 00000100:00100000:2.0:1790771166.361366:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14801:x1877759533835648:12345-192.168.204.50@tcp:101:ls.0 Request processed in 26286us (26638us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.361368:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862784 00010000:00010000:0.0:1790771166.361369:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 3/0,1 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361370:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533863040:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:2.0:1790771166.361386:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5930 00010000:00010000:0.0:1790771166.361388:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.361390:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533837312 00000100:00100000:3.0:1790771166.361396:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533837312 00010000:00010000:0.0:1790771166.361399:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.361405:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840512 00000100:00100000:2.0:1790771166.361410:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840512 00010000:00010000:0.0:1790771166.361414:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.361419:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863808 00010000:00010000:0.0:1790771166.361421:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.361423:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863808 00010000:00010000:0.0:1790771166.361432:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.361443:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5944 00002000:00010000:1.0:1790771166.361444:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb size from disk: 11206656 -> 11206656 00002000:00010000:1.0:1790771166.361449:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:1.0:1790771166.361451:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb atime from disk: 1790771161 -> 1790771161 00000100:00100000:2.0:1790771166.361455:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14432:x1877759533862784:12345-192.168.204.50@tcp:101:rm.0 00002000:00010000:1.0:1790771166.361456:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:0.0:1790771166.361460:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.361464:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x19:0x0] updating lvb blocks from disk: 1408 -> 1408 00000100:00100000:3.0:1790771166.361466:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5945 00010000:00010000:2.0:1790771166.361470:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.361477:0:13769:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.361482:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14563:x1877759533837312:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1790771166.361509:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cc54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358de expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361511:0:13769:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361518:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759533863040:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 149us (397us total) trans 4294967615 rc 0/0 00010000:00010000:3.0:1790771166.361535:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.361537:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 983 00000100:00100000:0.0:1790771166.361541:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539743872:0@lo:101:mdt00_014.0 00010000:00010000:3.0:1790771166.361548:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0cc5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35780 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361559:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863680 00000100:00100000:1.0:1790771166.361564:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863680 00000100:00100000:0.0:1790771166.361570:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771166.361570:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361579:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361582:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 119 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361585:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361587:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10487e40 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.361590:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361609:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5946 00010000:00010000:2.0:1790771166.361612:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361614:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361622:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14793:x1877759533840512:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.361628:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1635 00010000:00010000:0.0:1790771166.361638:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.361638:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361644:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361646:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2396:x1877759533863680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.361649:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0cc7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357a3 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361678:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361680:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.361682:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361692:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 119 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361703:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361705:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361706:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361714:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 119 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361731:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361738:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771166.361740:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361744:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361753:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361757:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1790771166.361758:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.361762:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.361762:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x91:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361770:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361772:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.361773:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361778:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2396:x1877759533863680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 136us (759us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.361794:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361799:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1635 00010000:00010000:2.0:1790771166.361800:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361808:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0cc7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357a3 expref: 135 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361811:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.361826:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x91:0x0]: returning size 5 00000100:00100000:1.0:1790771166.361831:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5947 00000004:00200000:2.0:1790771166.361832:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:3.0:1790771166.361842:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.361843:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357a3 expref: 134 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.361847:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14718:x1877759533863808:12345-192.168.204.50@tcp:36:truncate.0 00000004:00200000:3.0:1790771166.361849:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.361850:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.361864:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361868:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.361873:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.361875:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.361878:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.361880:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00010000:00010000:3.0:1790771166.361883:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361892:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361894:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.361896:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0c75a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355dc expref: 134 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361905:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14793:x1877759533840512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 284us (1479us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.361915:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361917:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361928:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5946 00010000:00010000:1.0:1790771166.361928:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.361937:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.361940:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.361941:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361946:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.361949:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361954:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.361959:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533861632 00000100:00100000:0.0:1790771166.361964:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533861632 00010000:00010000:2.0:1790771166.361971:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.361975:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361975:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771166.361983:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.361986:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.361987:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.361988:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (516096->520191) req@ffff8bfc2d1f9180 x1877759533861632/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771166.362009:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0cc69 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362010:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00002000:00100000:0.0:1790771166.362011:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1f9180 with x1877759533861632 ext(516096->520191) 00010000:00010000:1.0:1790771166.362013:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362020:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1790771166.362021:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d1f9180 00010000:00010000:2.0:1790771166.362026:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362033:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.362038:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362044:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 408 00010000:00010000:2.0:1790771166.362045:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cc62 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362054:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362057:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533861632:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.362063:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362077:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362087:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362090:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362096:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.362101:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362102:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.362106:0:12030:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969286 00010000:00010000:2.0:1790771166.362120:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.362121:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.362124:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ff829b9 reply state 000000000c8760d8 transno 4294969287 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362125:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362130:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0xb62e0cbf (ffff8bfc08974d00) 00010000:00010000:3.0:1790771166.362137:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.362141:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362145:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362161:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0cc77 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362169:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533861632:12345-192.168.204.50@tcp:3:cat.0 Request processed in 113us (2898us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.362171:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362190:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 408 00010000:00010000:1.0:1790771166.362194:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:2.0:1790771166.362198:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0xc8b04d25 (ffff8bfc34224700) 00002000:00100000:0.0:1790771166.362199:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (516096->520191) req@ffff8bfc2d1f9180 x1877759533861632/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.362199:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.362204:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.362205:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.362211:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362213:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0cc5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35780 expref: 135 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.362219:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1f9180 with x1877759533861632 ext(516096->520191) 00002000:00010000:0.0:1790771166.362227:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d1f9180 00010000:00010000:2.0:1790771166.362236:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0cc70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362246:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35780 expref: 135 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362247:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14718:x1877759533863808:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 401us (1804us total) trans 4294969287 rc 0/0 00010000:00010000:0.0:1790771166.362256:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362267:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5947 00010000:00010000:3.0:1790771166.362269:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:0.0:1790771166.362274:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.362275:0:12030:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790771166.362275:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.362276:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cc54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358de expref: 117 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362281:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597600, rc 0) 00000004:00200000:0.0:1790771166.362304:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.362305:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14563:x1877759533837312:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 827us (1900us total) trans 0 rc 0/0 00000004:00200000:0.0:1790771166.362309:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.362311:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358de expref: 116 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362320:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742720:192.168.204.50@tcp:104: 00000004:00010000:0.0:1790771166.362321:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.362332:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5945 00010000:00010000:2.0:1790771166.362341:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x91:0x0].0x0 (ffff8bfb0321aa00) 00010000:00010000:2.0:1790771166.362345:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.362347:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0c6b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356c3 expref: 118 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362348:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2800, rc 0) 00010000:00010000:0.0:1790771166.362354:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0cbd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 134 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362371:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742848:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.362373:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14432:x1877759533862784:12345-192.168.204.50@tcp:101:rm.0 Request processed in 921us (2085us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.362376:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.362391:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.362392:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539742976:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.362393:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5944 00010000:00010000:0.0:1790771166.362396:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.362403:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00000100:00100000:3.0:1790771166.362404:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.362430:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14797:x1877759533836288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 3623us (3819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.362430:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539743872 00010000:00010000:1.0:1790771166.362431:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.362437:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539743872 00000100:00100000:3.0:1790771166.362443:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.362447:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5940 00000100:00100000:3.0:1790771166.362470:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863424 00000100:00100000:1.0:1790771166.362474:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533863936 00000100:00100000:2.0:1790771166.362475:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1790771166.362476:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863424 00000100:00100000:1.0:1790771166.362480:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533863936 00000100:00100000:2.0:1790771166.362523:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:13769:x1877759539743872:12345-0@lo:101:mdt00_014.0 00010000:00010000:3.0:1790771166.362523:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 118 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362541:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.362550:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1636 00010000:00010000:2.0:1790771166.362558:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0cc4d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362565:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759533863424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.362565:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:0.0:1790771166.362570:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.362581:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2396:x1877759533863936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.362582:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.362593:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 118 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362598:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.362609:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 115 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.362613:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 118 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362614:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0cb19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3573a expref: 133 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362634:0:6499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 4/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362635:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.362645:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771166.362649:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.362654:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0c714 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ca expref: 118 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362682:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 115 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.362684:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:3.0:1790771166.362684:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2396:x1877759533863936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 105us (245us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.362696:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.362707:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 787 00000100:00100000:0.0:1790771166.362708:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.362713:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 115 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.362717:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.362729:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.362731:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6499:1877759539744000:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.362737:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533864320 00000100:00100000:3.0:1790771166.362742:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533864320 00000100:00100000:1.0:1790771166.362754:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759533863424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.362762:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.362769:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1636 00000100:00100000:3.0:1790771166.362773:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533857536 00000100:00100000:3.0:1790771166.362777:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533857536 00000100:00100000:2.0:1790771166.362786:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1106fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.362810:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5948 00000100:00100000:1.0:1790771166.362811:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533865088 00000100:00100000:1.0:1790771166.362816:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533865088 00000100:00100000:3.0:1790771166.362822:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14658:x1877759533864320:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.362838:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5949 00000100:00100000:1.0:1790771166.362850:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533865472 00000100:00100000:2.0:1790771166.362850:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13742:x1877759533857536:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.362852:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362856:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533865472 00000100:00100000:0.0:1790771166.362863:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.362866:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.362881:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 2/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358ad expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.362885:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1545 00000100:00100000:0.0:1790771166.362886:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533864576 00000100:00100000:0.0:1790771166.362892:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533864576 00000100:00100000:1.0:1790771166.362898:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:11864:x1877759533865088:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.362906:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362910:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.362918:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.362921:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.362927:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 788 00000100:00100000:0.0:1790771166.362942:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759533864576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.362945:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224500) 00010000:00010000:2.0:1790771166.362949:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.362951:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72000, rc 0) 00010000:00010000:0.0:1790771166.362952:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.362965:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0cb2e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3587c expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.362970:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13742:x1877759533857536:12345-192.168.204.50@tcp:101:ls.0 Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.362978:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:11864:x1877759533865088:12345-192.168.204.50@tcp:35:ls.0 Request processed in 79us (277us total) trans 4294969288 rc 0/0 00010000:00010000:0.0:1790771166.362983:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:2.0:1790771166.362985:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5949 00010000:00010000:0.0:1790771166.362992:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.362993:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1545 00000100:00100000:1.0:1790771166.363017:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1546 00000100:00100000:0.0:1790771166.363021:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759533864576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (159us total) trans 0 rc 0/0 00000004:00010000:3.0:1790771166.363029:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d9c4db39 reply state 000000000a59f2d6 transno 4294969289 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363030:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14511:x1877759533865472:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:0.0:1790771166.363038:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 788 00000100:00100000:2.0:1790771166.363049:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.363051:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.363058:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.363060:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.363062:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.363071:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533864192 00000100:00100000:0.0:1790771166.363077:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533864192 00000100:00100000:3.0:1790771166.363094:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14658:x1877759533864320:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 274us (533us total) trans 4294969289 rc 0/0 00010000:00010000:0.0:1790771166.363099:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 117 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.363108:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5948 00000100:00100000:1.0:1790771166.363113:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14511:x1877759533865472:12345-192.168.204.50@tcp:35:rm.0 Request processed in 84us (353us total) trans 4294969290 rc 0/0 00000100:00100000:2.0:1790771166.363126:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.363127:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1546 00000100:00100000:0.0:1790771166.363148:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533864832 00000100:00100000:0.0:1790771166.363154:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533864832 00000100:00100000:1.0:1790771166.363159:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1637 00000100:00100000:1.0:1790771166.363170:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2397:x1877759533864192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.363179:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.363184:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 117 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.363195:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 117 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.363199:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 789 00010000:00010000:3.0:1790771166.363201:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.363207:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.363218:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759533864832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.363222:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.363228:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.363228:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0b214 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e96 expref: 117 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.363242:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000004:00200000:3.0:1790771166.363242:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.363245:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0cb35 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35875 expref: 116 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.363249:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.363251:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.363262:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.363267:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.363270:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.363272:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.363277:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.363284:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.363295:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cbcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3575d expref: 134 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.363300:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533864832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (175us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.363306:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.363313:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 789 00010000:00010000:3.0:1790771166.363321:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3575d expref: 133 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.363327:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.363330:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.363333:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373c00, rc 0) 00000100:00100000:1.0:1790771166.363336:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:2397:x1877759533864192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 165us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.363343:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.363358:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14795:x1877759533835904:12345-192.168.204.50@tcp:101:ls.0 Request processed in 4561us (4799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.363359:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1637 00000100:00100000:3.0:1790771166.363370:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5939 00000100:00100000:1.0:1790771166.363386:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533865984 00010000:00010000:2.0:1790771166.363387:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.363392:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533865728 00000100:00100000:1.0:1790771166.363393:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533865984 00010000:00010000:2.0:1790771166.363400:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.363400:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533865728 00000004:00200000:2.0:1790771166.363421:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.363424:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.363435:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363436:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 790 00000100:00100000:3.0:1790771166.363437:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5950 00000100:00100000:1.0:1790771166.363455:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533865984:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.363455:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14763:x1877759533865728:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771166.363462:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cbb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35756 expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.363472:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.363474:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.363537:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35756 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.363544:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0ccb6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35901 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.363550:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cafd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35867 expref: 115 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.363574:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.363578:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.363580:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.363584:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.363585:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00010000:00010000:3.0:1790771166.363602:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363607:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2397:x1877759533865984:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.363614:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14802:x1877759533835776:12345-192.168.204.50@tcp:101:ls.0 Request processed in 5390us (5877us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.363616:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363623:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 790 00000100:00100000:2.0:1790771166.363629:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5935 00010000:00010000:3.0:1790771166.363632:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.363647:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 0 00000004:00200000:3.0:1790771166.363650:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.363659:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363702:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533865600 00000100:00100000:2.0:1790771166.363704:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.363711:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533865600 00010000:00010000:3.0:1790771166.363731:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0ccb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35901 expref: 120 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363739:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 984 00010000:00010000:3.0:1790771166.363747:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35901 expref: 119 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.363751:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533865600:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:3.0:1790771166.363761:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000100:00100000:2.0:1790771166.363766:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.363767:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.363772:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfce00, rc 0) 00000100:00100000:2.0:1790771166.363814:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.363834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.363854:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14763:x1877759533865728:12345-192.168.204.50@tcp:101:cp.0 Request processed in 402us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.363863:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5950 00000100:00100000:2.0:1790771166.363875:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.363882:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533866112 00000100:00100000:3.0:1790771166.363886:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533866112 00000100:00100000:0.0:1790771166.363905:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867008 00000100:00100000:0.0:1790771166.363911:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867008 00000100:00100000:2.0:1790771166.363917:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.363944:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867136 00000100:00100000:0.0:1790771166.363948:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867136 00000100:00100000:2.0:1790771166.363955:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.363975:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533866240 00000100:00100000:3.0:1790771166.363975:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533840896 00000100:00100000:3.0:1790771166.363981:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533840896 00000100:00100000:0.0:1790771166.363982:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1547 00000100:00100000:2.0:1790771166.363982:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533866752 00000100:00100000:1.0:1790771166.363983:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533866240 00000100:00100000:2.0:1790771166.363990:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533866752 00000100:00100000:0.0:1790771166.363997:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13637:x1877759533867008:12345-192.168.204.50@tcp:35:dd.0 00000100:00100000:3.0:1790771166.364015:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5951 00000100:00100000:3.0:1790771166.364024:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13998:x1877759533866112:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.364025:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867264 00000100:00100000:1.0:1790771166.364030:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867264 00010000:00010000:3.0:1790771166.364039:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.364043:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 791 00010000:00010000:1.0:1790771166.364048:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.364054:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 792 00010000:00010000:3.0:1790771166.364055:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0ccc4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3590f expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.364057:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533866240:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.364074:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759533866752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.364075:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.364095:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cb82 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35891 expref: 115 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364095:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.364104:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1638 00010000:00010000:2.0:1790771166.364111:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0cb58 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3588a expref: 115 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.364118:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364119:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.364119:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533867264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.364130:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.364130:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.364135:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.364138:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.364146:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364150:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.364158:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759533866240:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 102us (391us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.364161:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.364164:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759533866752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.364181:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 791 00000100:00100000:2.0:1790771166.364194:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 792 00000004:00200000:3.0:1790771166.364195:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.364202:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.364212:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364216:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.364233:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597800/0xfa0c505d97f0ccc4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 122 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364236:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080d2c882/0xfa0c505d97f06c99 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 5 type: EXT [10682368->18446744073709551615] (req 10682368->10747903) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33934 expref: 24 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.364254:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 121 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364256:0:13797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(16 1) 00010000:00010000:1.0:1790771166.364267:0:13797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(16 1) 00010000:00010000:3.0:1790771166.364269:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00000100:00100000:2.0:1790771166.364271:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.364278:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00080000:0.0:1790771166.364280:0:13780:0:(mdd_object.c:4189:mdd_close()) Object [0x200000402:0xa2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1790771166.364282:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->12582911) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356df expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.364283:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596c00, rc 0) 00010000:00010000:1.0:1790771166.364296:0:13797:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->12582911) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356df expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.364306:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13998:x1877759533866112:12345-192.168.204.50@tcp:101:ls.0 Request processed in 283us (603us total) trans 0 rc 0/0 00000040:00080000:0.0:1790771166.364308:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off11176 00000100:00100000:3.0:1790771166.364315:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5951 00010000:00010000:1.0:1790771166.364328:0:13797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000708bb751/0xfa0c505d97f0c706 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8388608->12582911) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356df expref: 23 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.364337:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5952 00000100:00100000:2.0:1790771166.364345:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.364346:0:13780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.364354:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14527:x1877759533840896:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:2.0:1790771166.364365:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856128 00010000:00010000:3.0:1790771166.364368:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.364370:0:13780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.364370:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856128 00000100:00100000:1.0:1790771166.364374:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:13797:1877759539744128:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.364377:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ccd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357aa expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364386:0:13780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364394:0:13780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.364399:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5953 00010000:00010000:3.0:1790771166.364400:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0cce0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364403:0:13780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.364415:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14919:x1877759533856128:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.364416:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08629cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.364422:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0cce0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364424:0:13780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364429:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.364434:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867520 00010000:00010000:3.0:1790771166.364438:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0cce0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.364441:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867520 00010000:00010000:2.0:1790771166.364442:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0cce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3589f expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364450:0:13780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771166.364475:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 793 00010000:00010000:2.0:1790771166.364476:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.364507:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2399:x1877759533867520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.364510:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13637:x1877759533867008:12345-192.168.204.50@tcp:35:dd.0 Request processed in 492us (611us total) trans 4294969291 rc 0/0 00010000:00010000:2.0:1790771166.364510:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364522:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.364523:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0ccd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357aa expref: 134 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.364530:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1547 00010000:00010000:2.0:1790771166.364536:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364543:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0caef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35860 expref: 114 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.364548:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3400/0xfa0c505d97f0cce0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357aa expref: 133 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.364555:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1548 00010000:00010000:1.0:1790771166.364564:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.364564:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000004:00200000:2.0:1790771166.364565:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.364571:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13889:x1877759533867136:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.364574:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.364574:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00200000:2.0:1790771166.364575:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.364580:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3400, rc 0) 00000004:00010000:2.0:1790771166.364591:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.364596:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2399:x1877759533867520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.364604:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14527:x1877759533840896:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 254us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.364612:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 793 00010000:00010000:2.0:1790771166.364618:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0cce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3589f expref: 114 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.364618:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5952 00010000:00010000:2.0:1790771166.364645:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3589f expref: 112 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364654:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.364656:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13889:x1877759533867136:12345-192.168.204.50@tcp:35:ls.0 Request processed in 89us (740us total) trans 4294968694 rc 0/0 00010000:00010000:2.0:1790771166.364672:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.364679:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73e00, rc 0) 00000100:00100000:0.0:1790771166.364683:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1548 00000100:00100000:2.0:1790771166.364708:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14919:x1877759533856128:12345-192.168.204.50@tcp:101:ls.0 Request processed in 296us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.364714:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5953 00010000:00010000:0.0:1790771166.364728:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.364736:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364742:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.364749:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.364750:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.364758:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.364761:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364766:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364775:0:8424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa2:0x0].0x0 (ffff8bfc36078c00) 00010000:00010000:2.0:1790771166.364778:0:8424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790771166.364781:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364786:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0ccd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.364799:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.364803:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.364807:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771166.364819:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533856256 00000100:00100000:1.0:1790771166.364824:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533856256 00000100:00100000:1.0:1790771166.364884:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5954 00000100:00100000:1.0:1790771166.364912:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14920:x1877759533856256:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.364919:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.364935:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ccf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358a6 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364966:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364973:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.364980:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.364997:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.365000:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.365010:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.365022:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ccf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358a6 expref: 115 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.365037:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358a6 expref: 114 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.365042:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.365045:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.365048:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00000100:00100000:1.0:1790771166.365074:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14920:x1877759533856256:12345-192.168.204.50@tcp:101:ls.0 Request processed in 184us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.365079:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5954 00000001:00080000:1.0:1790771166.365328:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967608 is committed 00000001:00080000:1.0:1790771166.365340:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967604 is committed 00000100:00100000:2.0:1790771166.365417:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533865600:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1670us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.365424:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 984 00000001:00080000:1.0:1790771166.365892:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968695 is committed 00000001:00080000:1.0:1790771166.365902:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968694 is committed 00000001:00080000:1.0:1790771166.365918:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968686 is committed 00010000:00010000:0.0:1790771166.365921:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.365933:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.365934:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.365956:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.365957:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.365966:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.365974:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.365975:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.365981:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.365983:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.365988:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366002:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.366002:0:7423:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 18 batchid updated 00010000:00010000:2.0:1790771166.366004:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:2.0:1790771166.366011:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.366015:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366022:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0c1fe lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366027:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:0.0:1790771166.366032:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000020:00080000:3.0:1790771166.366035:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 18 00010000:00010000:0.0:1790771166.366038:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366039:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.366045:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 18 00000004:00010000:1.0:1790771166.366046:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006ad6e326 reply state 000000007262c953 transno 4294968695 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366066:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366067:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0bf73 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366088:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.366091:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366093:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.366106:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.366106:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.366110:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.366112:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.366116:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.366117:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.366122:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.366129:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366132:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366146:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.366154:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366154:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.366162:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00080000:1.0:1790771166.366163:0:13768:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:0.0:1790771166.366166:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366169:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.366174:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14876:x1877759533857408:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 30921us (31314us total) trans 4294968695 rc 0/0 00010000:00010000:0.0:1790771166.366178:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfc10471800) 00010000:00010000:0.0:1790771166.366186:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.366188:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0c332 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.366190:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5931 00010000:00010000:0.0:1790771166.366191:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366209:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0c172 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366221:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366230:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366232:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366248:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366248:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366267:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366268:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.366274:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366276:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.366282:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366298:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366303:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366305:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc310f2900) 00010000:00010000:0.0:1790771166.366311:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.366315:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366322:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0c81e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366324:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0xf7a5b27a (ffff8bfc08974300) 00010000:00010000:2.0:1790771166.366328:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.366332:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366335:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366338:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0c649 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366344:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366350:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366354:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.366357:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366359:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366364:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366367:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366374:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.366376:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366378:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.366382:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366384:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.366389:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.366392:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cb74 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366397:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366406:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:2.0:1790771166.366408:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.366410:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366415:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0c50e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366425:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366428:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366433:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366436:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.366438:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366441:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366446:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x73:0x0].0x0 (ffff8bfc1ae7f100) 00010000:00010000:2.0:1790771166.366447:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.366449:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366452:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0c7f4 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x73:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366458:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366462:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366466:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366470:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.366472:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366475:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366479:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc3607d800) 00010000:00010000:2.0:1790771166.366480:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.366517:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.366523:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0c7ed lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.367639:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.367678:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533869312 00000100:00100000:0.0:1790771166.367683:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533869312 00000100:00100000:0.0:1790771166.367707:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5955 00000100:00100000:0.0:1790771166.367713:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:11832:x1877759533869312:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.367723:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.367730:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cd03 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35939 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367756:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367763:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367769:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367776:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367781:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367785:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.367823:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.367851:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367856:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367860:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367867:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.367869:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367873:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367879:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.367880:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.367883:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367886:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cd0a lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367892:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367896:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367901:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367904:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.367905:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367909:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367916:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc13395700) 00010000:00010000:0.0:1790771166.367917:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.367919:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367923:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cd11 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367940:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cd03 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35939 expref: 65 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367945:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.367947:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.367949:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cd03 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35939 expref: 65 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.367954:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00000100:00100000:0.0:1790771166.367978:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:11832:x1877759533869312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 266us (341us total) trans 4294968696 rc 301/301 00000100:00100000:0.0:1790771166.367983:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5955 00000100:00100000:3.0:1790771166.368128:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.368147:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867904 00000100:00100000:3.0:1790771166.368151:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.368154:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867904 00000100:00100000:0.0:1790771166.368185:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868032 00000100:00100000:0.0:1790771166.368190:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868032 00000100:00100000:2.0:1790771166.368192:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1549 00000100:00100000:3.0:1790771166.368197:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.368208:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:12119:x1877759533867904:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.368224:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5956 00000100:00100000:3.0:1790771166.368224:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868160 00000100:00100000:3.0:1790771166.368231:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868160 00000100:00100000:0.0:1790771166.368236:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14499:x1877759533868032:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:0.0:1790771166.368245:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.368255:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cd1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35924 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368265:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1550 00000100:00100000:3.0:1790771166.368278:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08478050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14559:x1877759533868160:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:0.0:1790771166.368290:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368299:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368306:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368317:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368322:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368328:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.368345:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:12119:x1877759533867904:12345-192.168.204.50@tcp:35:ls.0 Request processed in 141us (216us total) trans 4294968697 rc 0/0 00000100:00100000:2.0:1790771166.368353:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1549 00010000:00010000:0.0:1790771166.368359:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368365:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368371:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368388:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.368389:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x8e:0x0]: returning size 37366 00000004:00200000:0.0:1790771166.368393:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.368405:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.368415:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868288 00010000:00010000:0.0:1790771166.368416:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.368420:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868288 00000100:00100000:3.0:1790771166.368425:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08478050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14559:x1877759533868160:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 146us (233us total) trans 4294969292 rc 0/0 00010000:00010000:0.0:1790771166.368428:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368437:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368437:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1550 00010000:00010000:0.0:1790771166.368446:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368451:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00030200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.368454:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5957 00010000:00010000:0.0:1790771166.368456:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.368466:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:13665:x1877759533868288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.368468:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368468:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.368479:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.368480:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.368504:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.368507:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368512:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868544 00010000:00010000:0.0:1790771166.368514:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cd26 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.368514:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd3b lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3592b expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368518:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868544 00010000:00010000:0.0:1790771166.368540:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368547:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368552:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368557:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.368560:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368565:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368566:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1551 00010000:00010000:0.0:1790771166.368578:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc13395100) 00010000:00010000:2.0:1790771166.368579:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368581:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14000:x1877759533868544:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.368584:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.368589:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368601:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cd2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.368602:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368612:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.368624:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368640:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868800 00000004:00200000:2.0:1790771166.368644:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.368646:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cd1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35924 expref: 125 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368648:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868800 00000004:00200000:2.0:1790771166.368649:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.368680:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368682:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35924 expref: 125 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.368702:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14000:x1877759533868544:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (235us total) trans 4294969293 rc 0/0 00010000:00010000:0.0:1790771166.368705:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:0.0:1790771166.368714:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.368714:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd3b lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 88 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.368721:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00000100:00100000:1.0:1790771166.368722:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1551 00010000:00010000:2.0:1790771166.368740:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 87 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.368748:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5958 00010000:00010000:2.0:1790771166.368750:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.368754:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.368759:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4be00, rc 0) 00000100:00100000:0.0:1790771166.368760:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14499:x1877759533868032:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 522us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.368765:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14096:x1877759533868800:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:0.0:1790771166.368781:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5956 00000100:00100000:2.0:1790771166.368788:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:13665:x1877759533868288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 323us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.368796:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.368801:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5957 00000100:00100000:0.0:1790771166.368832:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868672 00000100:00100000:0.0:1790771166.368839:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868672 00000100:00100000:1.0:1790771166.368848:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.368875:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1552 00000100:00100000:0.0:1790771166.368888:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14533:x1877759533868672:12345-192.168.204.50@tcp:49:ln.0 00000100:00100000:2.0:1790771166.368891:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533868928 00000100:00100000:1.0:1790771166.368897:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.368898:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533868928 00000100:00100000:0.0:1790771166.368921:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533869184 00000100:00100000:0.0:1790771166.368927:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533869184 00000100:00100000:2.0:1790771166.368937:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5959 00000100:00100000:2.0:1790771166.368949:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14870:x1877759533868928:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771166.368959:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.368968:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 794 00010000:00010000:2.0:1790771166.368971:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cd49 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35932 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.368980:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:2397:x1877759533869184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.368989:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.368993:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cd50 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.369000:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0cbac lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35898 expref: 87 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.369003:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cd50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.369017:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cd50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.369018:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.369026:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.369053:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:2397:x1877759533869184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.369059:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 794 00000100:00100000:0.0:1790771166.369111:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:14533:x1877759533868672:12345-192.168.204.50@tcp:49:ln.0 Request processed in 226us (319us total) trans 0 rc -61/-61 00010000:00010000:2.0:1790771166.369113:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cd49 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35932 expref: 68 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.369119:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.369129:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1552 00010000:00010000:2.0:1790771166.369138:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cd50 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35932 expref: 67 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.369145:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.369147:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771166.369150:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4aa00, rc 0) 00000100:00100000:2.0:1790771166.369184:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14870:x1877759533868928:12345-192.168.204.50@tcp:101:chown.0 Request processed in 237us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.369194:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5959 00000100:00100000:2.0:1790771166.369216:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533869568 00000100:00100000:2.0:1790771166.369220:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533869568 00000100:00100000:2.0:1790771166.369268:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5960 00000100:00100000:2.0:1790771166.369281:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14264:x1877759533869568:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:2.0:1790771166.369305:0:13774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.369320:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cae1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35859 expref: 86 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.369333:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.369336:0:13774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.369389:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:14264:x1877759533869568:12345-192.168.204.50@tcp:36:ln.0 Request processed in 113us (277us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771166.369395:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5960 00000100:00100000:2.0:1790771166.369566:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743232:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.369616:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.369634:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14008:x1877759533862656:12345-192.168.204.50@tcp:37:ls.0 Request processed in 9439us (9652us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.369647:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1542 00000100:00100000:3.0:1790771166.369841:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.369860:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539743488:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.369868:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533841408 00000100:00100000:0.0:1790771166.369873:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533841408 00010000:00010000:2.0:1790771166.369887:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.369904:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5961 00000100:00100000:0.0:1790771166.369912:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14530:x1877759533841408:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.369921:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.369928:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539743616:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.369929:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357b1 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.369948:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.369956:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.369962:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.369964:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.369966:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4200, rc 0) 00000100:00100000:0.0:1790771166.369990:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14530:x1877759533841408:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.369994:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5961 00010000:00010000:3.0:1790771166.370057:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370067:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.370068:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370085:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370091:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370094:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.370097:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370104:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370111:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.370113:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.370115:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370119:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0cb5f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.370137:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.370144:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790771166.370167:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06a02c00/0xfa0c505d97f0c9de lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0ca32 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.370185:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539744256:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:3.0:1790771166.370187:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969293 is committed 00000001:00080000:3.0:1790771166.370205:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969292 is committed 00010000:00010000:0.0:1790771166.370219:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.370229:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.370231:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370237:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370241:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.370243:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370247:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370256:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:0.0:1790771166.370258:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.370261:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370265:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539744256 00010000:00010000:0.0:1790771166.370272:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0c97c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x42:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370272:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539744256 00010000:00010000:0.0:1790771166.370285:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370290:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370294:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.370301:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14096:x1877759533868800:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 1541us (1694us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.370303:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.370308:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370311:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1790771166.370317:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5958 00010000:00010000:0.0:1790771166.370322:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370327:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1877759539744256:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1790771166.370334:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.370336:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.370339:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.370339:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.370347:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0c983 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.370356:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0ca32 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0c9de expref: 6 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370358:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370373:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.370376:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc1ae7fb00) 00010000:00010000:0.0:1790771166.370379:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370385:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.370385:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.370389:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370394:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370401:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:0.0:1790771166.370403:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.370405:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370409:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cc9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370421:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370426:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1877759539744256:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 101us (201us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.370428:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.370438:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539744256:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1790771166.370441:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.370444:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00010000:00010000:0.0:1790771166.370453:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfc800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.370456:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370464:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370469:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.370471:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.370473:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.370476:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0cca8 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.385959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.386002:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533843584 00000100:00100000:2.0:1790771166.386009:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533843584 00000100:00100000:3.0:1790771166.386031:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.386052:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533847040 00000100:00100000:2.0:1790771166.386057:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533847040 00000100:00100000:1.0:1790771166.386085:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5962 00000100:00100000:3.0:1790771166.386086:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.386102:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5963 00000100:00100000:1.0:1790771166.386103:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13271:x1877759533843584:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.386110:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533871744 00000100:00100000:2.0:1790771166.386117:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13261:x1877759533847040:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.386119:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.386121:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533871744 00010000:00010000:2.0:1790771166.386129:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.386135:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cd5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e356fb expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386141:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cd65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35702 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.386170:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5964 00000100:00100000:0.0:1790771166.386183:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14463:x1877759533871744:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1790771166.386196:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.386210:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0cd6c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3594e expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386218:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cd73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386220:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd7a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386236:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cd73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386249:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cd73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386252:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.386257:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.386269:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd7a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.386278:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.386287:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.386302:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.386313:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533872384 00010000:00010000:0.0:1790771166.386317:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.386318:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533872384 00010000:00010000:0.0:1790771166.386330:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386342:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cd5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356fb expref: 129 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386349:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386357:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cd73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356fb expref: 129 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386362:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0cd65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35702 expref: 129 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386364:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386370:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.386378:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.386384:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372c00, rc 0) 00010000:00010000:0.0:1790771166.386390:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386396:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd7a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35702 expref: 128 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.386404:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5965 00010000:00010000:2.0:1790771166.386412:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.386415:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:3.0:1790771166.386419:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:12118:x1877759533872384:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.386420:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00000100:00100000:1.0:1790771166.386426:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13271:x1877759533843584:12345-192.168.204.50@tcp:101:ls.0 Request processed in 326us (468us total) trans 4294969294 rc 0/0 00000100:00100000:1.0:1790771166.386434:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5962 00010000:00010000:3.0:1790771166.386434:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.386438:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386450:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386451:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0cda4 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35955 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386456:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13261:x1877759533847040:12345-192.168.204.50@tcp:101:ls.0 Request processed in 342us (465us total) trans 4294969295 rc 0/0 00010000:00010000:0.0:1790771166.386474:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.386508:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.386509:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5963 00010000:00010000:0.0:1790771166.386521:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386528:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386531:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386535:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386545:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.386547:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386550:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386557:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386559:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.386577:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539743744:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.386577:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386578:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.386587:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.386595:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386595:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386605:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386611:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0cd9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386627:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0c998 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386629:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3800 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6499:1877759539744000:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.386631:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386637:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.386651:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009dc70b3d reply state 00000000ae79acd9 transno 4294969285 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386653:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386677:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386679:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386690:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386703:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386707:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff8bfc3607dd00) 00010000:00010000:1.0:1790771166.386709:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc22108800) 00000004:00200000:3.0:1790771166.386713:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.386714:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.386717:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.386718:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.386722:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.386723:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1790771166.386724:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.386732:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009dc70b3d reply state 00000000ae79acd9 transno 4294969285 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386744:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 3/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386746:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386751:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386752:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.386768:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3600, rc 0) 00010000:00010000:0.0:1790771166.386773:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.386777:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.386777:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386779:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc22108500) 00010000:00010000:0.0:1790771166.386785:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386786:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.386790:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1790771166.386791:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386805:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386807:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386811:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13769:x1877759539743872:12345-0@lo:101:mdt00_014.0 Request processed in 24323us (25238us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.386821:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cd88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386832:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:3.0:1790771166.386832:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.386834:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386838:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386849:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386860:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386862:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386863:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386890:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386890:0:13792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386890:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.386899:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.386906:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386914:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386915:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.386921:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.386923:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.386932:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386934:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.386951:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfc13395100) 00010000:00010000:1.0:1790771166.386953:0:13792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790771166.386956:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.386961:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533847808 00010000:00010000:0.0:1790771166.386962:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386963:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0cdab lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.386966:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533847808 00010000:00010000:0.0:1790771166.386986:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cd96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.386990:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790771166.386997:0:13792:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1790771166.387000:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387002:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5966 00000100:00100000:1.0:1790771166.387012:0:13792:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14118:x1877759533850496:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 59736us (59827us total) trans 4294969285 rc 0/0 00010000:00010000:3.0:1790771166.387013:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387017:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14888:x1877759533847808:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.387025:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0cd6c lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3594e expref: 111 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.387034:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.387036:0:13792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 35 00010000:00010000:2.0:1790771166.387036:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.387041:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387051:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cdc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3580c expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.387058:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387061:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771166.387071:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.387071:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387079:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.387081:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc1040f500) 00010000:00010000:0.0:1790771166.387087:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0cd6c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3594e expref: 110 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.387088:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.387094:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:3.0:1790771166.387095:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387102:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387115:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4e00, rc 0) 00010000:00010000:3.0:1790771166.387119:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0cdb2 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387122:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387133:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387144:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x42:0x0].0x0 (ffff8bfc3607ee00) 00010000:00010000:2.0:1790771166.387146:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.387148:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14463:x1877759533871744:12345-192.168.204.50@tcp:101:dd.0 Request processed in 967us (1065us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.387148:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771166.387154:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387168:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cdc0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387171:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.387173:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5964 00010000:00010000:3.0:1790771166.387173:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0cda4 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35955 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387195:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.387199:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.387199:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.387202:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.387203:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.387209:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0cda4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35955 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.387212:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.387218:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.387227:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539743872:0@lo:101:mdt00_014.0 00000100:00100000:1.0:1790771166.387228:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-OST0001_UUID:13797:1877759539744128:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.387228:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2200, rc 0) 00000004:00010000:2.0:1790771166.387234:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.387251:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.387253:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387257:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:12118:x1877759533872384:12345-192.168.204.50@tcp:101:ls.0 Request processed in 841us (982us total) trans 4294968698 rc 301/301 00010000:00010000:2.0:1790771166.387264:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0cdc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 129 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387276:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5965 00000100:00100000:1.0:1790771166.387278:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533867264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 23160us (23324us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.387279:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387305:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.387309:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1638 00010000:00010000:0.0:1790771166.387317:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.387328:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.387331:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387332:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.387337:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38800, rc 0) 00010000:00010000:0.0:1790771166.387341:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387348:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.387348:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870848 00010000:00010000:0.0:1790771166.387355:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387355:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870848 00010000:00010000:0.0:1790771166.387364:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387369:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14888:x1877759533847808:12345-192.168.204.50@tcp:101:ls.0 Request processed in 353us (438us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.387377:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc22108500) 00000100:00100000:2.0:1790771166.387380:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5966 00010000:00010000:0.0:1790771166.387384:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.387384:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.387390:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387391:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1553 00010000:00010000:0.0:1790771166.387399:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0cc2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.387405:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:13742:x1877759533870848:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771166.387414:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533871104 00010000:00010000:0.0:1790771166.387417:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387419:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533871104 00010000:00010000:0.0:1790771166.387426:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387431:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387436:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.387439:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387444:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.387452:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.387454:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5967 00010000:00010000:0.0:1790771166.387458:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc22108800) 00010000:00010000:0.0:1790771166.387461:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.387464:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14432:x1877759533871104:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771166.387466:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387474:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0cc23 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.387474:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533871232 00000100:00100000:1.0:1790771166.387480:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533871232 00010000:00010000:2.0:1790771166.387515:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771166.387517:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387523:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387528:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.387531:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1554 00010000:00010000:2.0:1790771166.387534:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0cc8c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358de expref: 110 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387544:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.387545:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14851:x1877759533871232:12345-192.168.204.50@tcp:37:chown.0 00010000:00010000:0.0:1790771166.387550:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387563:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387569:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x91:0x0].0x0 (ffff8bfb0321aa00) 00010000:00010000:0.0:1790771166.387571:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00010000:00010000:0.0:1790771166.387575:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771166.387578:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387583:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02200/0xfa0c505d97f0cc38 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xab:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387587:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0c603 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35684 expref: 109 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387599:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:2.0:1790771166.387602:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.387612:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387619:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387625:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387640:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387649:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.387656:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.387680:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.387692:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533860608 00000100:00100000:0.0:1790771166.387697:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533860608 00000100:00100000:0.0:1790771166.387719:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5968 00000100:00100000:0.0:1790771166.387728:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:11824:x1877759533860608:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.387732:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387737:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.387742:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 128 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387751:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0cdea lrc: 2/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358c2 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387751:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387777:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 129 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.387785:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 129 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387795:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539744384:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.387799:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387807:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387814:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.387826:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.387829:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.387834:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1106fe40 going to sleep for 11 seconds 00000004:00010000:0.0:1790771166.387837:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387853:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0cdea lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358c2 expref: 130 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387864:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358c2 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.387870:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc13395700) 00010000:00010000:0.0:1790771166.387872:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.387876:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4c00, rc 0) 00000100:00100000:2.0:1790771166.387877:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.387904:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:11824:x1877759533860608:12345-192.168.204.50@tcp:101:ls.0 Request processed in 177us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.387916:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.387920:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5968 00000100:00100000:3.0:1790771166.387945:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870080 00000100:00100000:3.0:1790771166.387949:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870080 00010000:00010000:3.0:1790771166.387971:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 86 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.387982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.388010:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870336 00000100:00100000:0.0:1790771166.388012:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870592 00000100:00100000:3.0:1790771166.388015:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870336 00000100:00100000:0.0:1790771166.388018:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870592 00000100:00100000:2.0:1790771166.388020:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.388035:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 108 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.388056:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1639 00000100:00100000:2.0:1790771166.388062:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.388067:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1640 00000100:00100000:0.0:1790771166.388069:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:2396:x1877759533870080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.388078:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.388079:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2396:x1877759533870336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.388086:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 86 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.388090:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.388098:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 108 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.388100:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 86 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388105:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.388130:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0c00d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3543f expref: 86 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388131:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.388132:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 108 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388146:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533871872 00000100:00100000:2.0:1790771166.388153:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533871872 00010000:00010000:0.0:1790771166.388157:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.388162:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.388166:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f067a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3343a expref: 109 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.388170:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388178:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533872128 00000100:00100000:2.0:1790771166.388184:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533872128 00010000:00010000:0.0:1790771166.388185:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.388190:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff8bfc3607dd00) 00010000:00010000:3.0:1790771166.388198:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388206:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533872768 00000100:00100000:0.0:1790771166.388212:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:2396:x1877759533870080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 144us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.388212:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533872768 00010000:00010000:3.0:1790771166.388213:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.388230:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1639 00010000:00010000:3.0:1790771166.388231:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.388238:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533873152 00000100:00100000:2.0:1790771166.388243:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533873152 00010000:00010000:3.0:1790771166.388260:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.388271:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:9499:1877759539744512:0@lo:105: 00000100:00100000:0.0:1790771166.388279:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 796 00000100:00100000:2.0:1790771166.388279:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1555 00000100:00100000:0.0:1790771166.388292:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2396:x1877759533870592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.388298:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08479050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13998:x1877759533871872:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.388300:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.388308:0:9499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.388313:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1556 00010000:00010000:0.0:1790771166.388315:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cc85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357a3 expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.388327:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.388327:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:11832:x1877759533872128:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.388330:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113e06c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.388336:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.388358:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759533870592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.388363:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 796 00000100:00100000:0.0:1790771166.388385:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1557 00000100:00100000:0.0:1790771166.388391:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:13665:x1877759533872768:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.388422:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:11832:x1877759533872128:12345-192.168.204.50@tcp:35:ls.0 Request processed in 101us (367us total) trans 4294968699 rc 0/0 00000100:00100000:1.0:1790771166.388429:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1556 00000100:00100000:1.0:1790771166.388443:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1558 00000100:00100000:1.0:1790771166.388448:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:14870:x1877759533873152:12345-192.168.204.50@tcp:35:chown.0 00000100:00100000:0.0:1790771166.388479:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:13665:x1877759533872768:12345-192.168.204.50@tcp:35:ls.0 Request processed in 88us (380us total) trans 4294968700 rc 0/0 00000100:00100000:0.0:1790771166.388524:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1557 00000001:00080000:1.0:1790771166.388584:0:13778:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968701 00000100:00100000:1.0:1790771166.388630:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14870:x1877759533873152:12345-192.168.204.50@tcp:35:chown.0 Request processed in 181us (503us total) trans 4294968702 rc 0/0 00000100:00100000:1.0:1790771166.388636:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1558 00000020:00080000:1.0:1790771166.388640:0:13778:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790771166.388690:0:6477:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539744512 00000100:00100000:1.0:1790771166.388694:0:6477:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539744512 00000100:00100000:1.0:1790771166.388723:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1790771166.388730:0:6477:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9499:x1877759539744512:12345-0@lo:105: 00010000:00010000:1.0:1790771166.388738:0:6477:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 5/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388747:0:6477:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 5/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388753:0:6477:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 5/0,1 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388759:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 5/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388764:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388770:0:6477:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 6/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.388784:0:6477:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb063e1c00) 00010000:00010000:0.0:1790771166.388801:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.388810:0:13769:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.388818:0:6477:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:9499:x1877759539744512:12345-0@lo:105: Request processed in 88us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.388824:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000004:00080000:0.0:1790771166.388827:0:13769:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00000100:00100000:3.0:1790771166.388842:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b03480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:9499:1877759539744512:0@lo:105: 00010000:00010000:3.0:1790771166.388853:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.388880:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2396:x1877759533870336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 805us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.388882:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539744640:0@lo:1000:mdt00_014.0 00000100:00100000:3.0:1790771166.388896:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1640 00000100:00100000:0.0:1790771166.388922:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.388941:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.388959:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539744640 00000100:00100000:0.0:1790771166.388962:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539744640 00000100:00100000:0.0:1790771166.388988:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1790771166.388995:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13769:x1877759539744640:12345-0@lo:1000:mdt00_014.0 00000100:00100000:0.0:1790771166.389067:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13769:x1877759539744640:12345-0@lo:1000:mdt00_014.0 Request processed in 71us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.389073:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:1.0:1790771166.389086:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539744640:0@lo:1000:mdt00_014.0 00000100:00100000:1.0:1790771166.389138:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539744768:0@lo:1000:mdt00_014.0 00000100:00100000:1.0:1790771166.389161:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.389177:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.389199:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539744768 00000100:00100000:2.0:1790771166.389203:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539744768 00000100:00100000:2.0:1790771166.389235:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1790771166.389244:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:13769:x1877759539744768:12345-0@lo:1000:mdt00_014.0 00000100:00100000:2.0:1790771166.389317:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:13769:x1877759539744768:12345-0@lo:1000:mdt00_014.0 Request processed in 74us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.389327:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1790771166.389334:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001-mdtlov_UUID:13769:1877759539744768:0@lo:1000:mdt00_014.0 00000040:00080000:1.0:1790771166.389571:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].18, 800 off46720 00000040:00080000:1.0:1790771166.389597:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].18, 880 off49408 00000004:00080000:1.0:1790771166.389602:0:13769:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfc06b14b40 with version 38 00000004:00080000:0.0:1790771166.389633:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 38 rpc_version 38 00000020:00100000:0.0:1790771166.389651:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1790771166.389657:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3f9d8e00 x1877759539745024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790771166.389683:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539745024:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1790771166.389707:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.389723:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f3f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.389738:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539745024 00000100:00100000:1.0:1790771166.389742:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539745024 00000100:00100000:1.0:1790771166.389766:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1790771166.389772:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7438:x1877759539745024:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1790771166.389894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.389933:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533848448 00000100:00100000:2.0:1790771166.389940:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533848448 00000100:00100000:2.0:1790771166.389967:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5969 00000100:00100000:2.0:1790771166.389974:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13269:x1877759533848448:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.389982:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.389992:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0cdf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35710 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.390041:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0cdff lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.390053:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0cdff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.390060:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:7438:x1877759539745024:12345-0@lo:1000:osp_up0-1.0 Request processed in 285us (348us total) trans 4294969296 rc 0/0 00010000:00010000:2.0:1790771166.390068:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0cdff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390070:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.390075:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000004:00200000:2.0:1790771166.390087:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.390099:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533862400 00000100:00100000:0.0:1790771166.390103:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533862400 00000100:00100000:3.0:1790771166.390126:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539745024:0@lo:1000:osp_up0-1.0 00000004:00080000:1.0:1790771166.390138:0:13769:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0x5:0x0] 00000100:00100000:0.0:1790771166.390144:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5970 00010000:00010000:2.0:1790771166.390145:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0cdf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35710 expref: 132 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390148:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390157:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14616:x1877759533862400:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.390173:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.390173:0:13769:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.390183:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2a00/0xfa0c505d97f0cdff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35710 expref: 131 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.390184:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ce0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35795 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390184:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390206:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.390213:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.390215:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.390217:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.390223:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2a00, rc 0) 00010000:00010000:1.0:1790771166.390225:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390231:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.390234:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390240:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.390247:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390249:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00000100:00100000:3.0:1790771166.390251:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.390257:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.390262:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 3/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.390266:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 132 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390270:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:13269:x1877759533848448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 292us (371us total) trans 4294969297 rc 0/0 00000100:00100000:3.0:1790771166.390271:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533873536 00000100:00100000:3.0:1790771166.390278:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533873536 00010000:00010000:1.0:1790771166.390281:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0cc3f lrc: 0/0,0 mode: --/CW res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390295:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5969 00010000:00010000:0.0:1790771166.390307:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.390307:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009071a087 reply state 00000000c2a2b1f9 transno 4294968703 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.390321:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5971 00010000:00010000:1.0:1790771166.390330:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.390336:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14533:x1877759533873536:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:0.0:1790771166.390340:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 131 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.390342:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xc8b04d25 (ffff8bfc22108b00) 00010000:00010000:1.0:1790771166.390348:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.390351:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.390358:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 131 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390367:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539745152:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.390385:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:13663:x1877759533860992:12345-192.168.204.50@tcp:36:ln.0 Request processed in 31384us (31727us total) trans 4294968703 rc 0/0 00010000:00010000:3.0:1790771166.390387:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 3/0,1 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.390396:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5941 00010000:00010000:3.0:1790771166.390402:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390411:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080600 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.390412:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390422:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.390448:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533873792 00000100:00100000:1.0:1790771166.390453:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533873792 00000100:00100000:2.0:1790771166.390454:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.390468:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.390476:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390525:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5972 00000100:00100000:2.0:1790771166.390539:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:14520:x1877759533873792:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:3.0:1790771166.390546:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390551:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533872896 00000100:00100000:0.0:1790771166.390555:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533872896 00010000:00010000:2.0:1790771166.390566:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.390583:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0ccee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3589f expref: 87 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390592:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 797 00010000:00010000:2.0:1790771166.390597:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.390601:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.390602:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2399:x1877759533872896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.390613:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.390623:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cbba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35756 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.390634:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.390637:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.390684:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14520:x1877759533873792:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 146us (261us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.390685:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2399:x1877759533872896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 82us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.390700:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 797 00000100:00100000:2.0:1790771166.390711:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5972 00000004:00200000:3.0:1790771166.390746:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x75:0x0]: returning size 1 00010000:00010000:3.0:1790771166.390753:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390760:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.390767:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.390785:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533873920 00000100:00100000:2.0:1790771166.390785:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.390791:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533873920 00010000:00010000:3.0:1790771166.390811:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.390813:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533872640 00000100:00100000:2.0:1790771166.390819:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.390820:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533872640 00000100:00100000:0.0:1790771166.390823:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1559 00010000:00010000:3.0:1790771166.390829:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.390835:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.390838:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14530:x1877759533873920:12345-192.168.204.50@tcp:37:lfs.0 00010000:00010000:3.0:1790771166.390840:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.390849:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390857:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.390863:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533873280 00010000:00010000:3.0:1790771166.390866:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:1.0:1790771166.390869:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533873280 00010000:00010000:3.0:1790771166.390869:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.390875:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 3/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.390880:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ce1b lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.390889:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:3.0:1790771166.390899:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fd5f8bce reply state 0000000007aaf878 transno 4294968704 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.390907:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.390911:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 798 00010000:00010000:3.0:1790771166.390915:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xbc0ca3a9 (ffff8bfc1040fe00) 00010000:00010000:3.0:1790771166.390918:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.390920:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.390928:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2399:x1877759533872640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.390930:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.390944:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.390959:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533871360 00010000:00010000:1.0:1790771166.390962:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cbf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3575d expref: 132 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.390963:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14533:x1877759533873536:12345-192.168.204.50@tcp:36:ln.0 Request processed in 630us (713us total) trans 4294968704 rc 0/0 00000100:00100000:2.0:1790771166.390965:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533871360 00000100:00100000:3.0:1790771166.390978:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5971 00010000:00010000:1.0:1790771166.390992:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.390997:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.390997:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874432 00000100:00100000:3.0:1790771166.391002:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874432 00000100:00100000:2.0:1790771166.391011:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5973 00000100:00100000:2.0:1790771166.391022:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14717:x1877759533871360:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771166.391028:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5974 00000100:00100000:1.0:1790771166.391033:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2399:x1877759533872640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (245us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.391035:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.391042:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14674:x1877759533874432:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:1.0:1790771166.391047:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 798 00010000:00010000:2.0:1790771166.391050:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ce29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35947 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391067:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.391067:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 799 00010000:00010000:0.0:1790771166.391072:0:13767:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0c82c) 00010000:00010000:0.0:1790771166.391074:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.391078:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:2399:x1877759533873280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.391087:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.391094:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391097:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.391101:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ccfc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358a6 expref: 86 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.391111:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391122:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 109 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.391130:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.391133:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391136:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 109 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.391137:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.391151:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391158:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 133 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.391164:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.391166:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 133 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391167:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:2399:x1877759533873280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000004:00200000:2.0:1790771166.391170:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.391185:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391186:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 799 00000004:00010000:2.0:1790771166.391188:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391209:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391214:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874176 00010000:00010000:0.0:1790771166.391217:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 10/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391218:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874176 00010000:00010000:2.0:1790771166.391230:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ce29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391242:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1560 00010000:00010000:0.0:1790771166.391243:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.391252:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 133 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391253:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:12253:x1877759533874176:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.391257:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 133 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.391280:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:0.0:1790771166.391283:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745280:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.391286:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.391292:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00000100:00100000:2.0:1790771166.391328:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14717:x1877759533871360:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 308us (475us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.391332:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.391341:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5973 00010000:00010000:0.0:1790771166.391347:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 133 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.391352:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:12253:x1877759533874176:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (464us total) trans 4294969298 rc 0/0 00000100:00100000:0.0:1790771166.391365:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745408:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.391367:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1560 00010000:00010000:0.0:1790771166.391399:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391407:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 132 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.391418:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745536:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.391436:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 132 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391443:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 132 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.391454:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745664:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.391517:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391530:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 132 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.391541:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d91880 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745792:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.391595:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 108 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391605:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.391618:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d91500 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745920:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.391652:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 108 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.391687:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 108 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.391700:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539746048:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.391722:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080780 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.392332:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:13742:x1877759533870848:12345-192.168.204.50@tcp:37:ls.0 Request processed in 4931us (5014us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.392339:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1553 00000100:00100000:1.0:1790771166.392554:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14851:x1877759533871232:12345-192.168.204.50@tcp:37:chown.0 Request processed in 5011us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.392561:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1554 00000100:00100000:2.0:1790771166.392652:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08479050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13998:x1877759533871872:12345-192.168.204.50@tcp:37:ls.0 Request processed in 4359us (4632us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.392677:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1555 00000100:00100000:3.0:1790771166.396413:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.396434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.396457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.396476:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533875712 00000100:00100000:2.0:1790771166.396481:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533875712 00000100:00100000:1.0:1790771166.396511:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533867648 00000100:00100000:0.0:1790771166.396519:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876096 00000100:00100000:1.0:1790771166.396519:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533867648 00000100:00100000:0.0:1790771166.396526:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876096 00000100:00100000:2.0:1790771166.396537:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5975 00000100:00100000:2.0:1790771166.396551:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:11826:x1877759533875712:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.396555:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5976 00000100:00100000:1.0:1790771166.396567:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5977 00010000:00010000:2.0:1790771166.396569:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.396574:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14657:x1877759533867648:12345-192.168.204.50@tcp:101:touch.0 00000100:00100000:1.0:1790771166.396581:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14596:x1877759533876096:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771166.396584:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ce3e lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3595c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396591:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.396598:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.396603:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ce45 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e357cd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396610:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ce4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35963 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396622:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396634:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396640:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396652:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396657:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396658:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396694:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396695:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396695:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396720:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 135 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396722:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396732:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396736:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.396755:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.396761:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396767:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 135 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396770:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396785:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 135 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396789:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396791:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.396805:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539746176:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.396811:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396818:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396822:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396826:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.396830:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396838:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396848:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396849:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.396854:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.396858:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396864:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396866:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396867:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0ce53 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396892:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396894:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.396895:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396908:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.396918:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2c:0x0]: returning size 1621 00010000:00010000:2.0:1790771166.396927:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.396932:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539746304:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.396934:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.396940:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396945:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396951:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc34224700) 00010000:00010000:2.0:1790771166.396952:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.396955:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396965:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.396965:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0ce5a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396984:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396990:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.396994:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.396997:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397002:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397003:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ce3e lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3595c expref: 75 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.397009:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc205cc540 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.397026:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.397027:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.397033:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.397035:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.397038:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397044:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0ce3e lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3595c expref: 75 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397047:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0ce68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397071:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397073:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00010000:00010000:1.0:1790771166.397078:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397084:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397088:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.397091:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397096:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397102:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfb03218e00) 00010000:00010000:1.0:1790771166.397103:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.397105:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397112:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0ce6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.397112:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:11826:x1877759533875712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 564us (697us total) trans 4294968705 rc 301/301 00000100:00100000:2.0:1790771166.397126:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5975 00010000:00010000:1.0:1790771166.397149:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0ce4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 110 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397164:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 109 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397169:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:1.0:1790771166.397171:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.397173:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:1.0:1790771166.397194:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14596:x1877759533876096:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 621us (737us total) trans 4294969299 rc 0/0 00000100:00100000:1.0:1790771166.397201:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5977 00000100:00100000:0.0:1790771166.397521:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.397572:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.397589:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539744384:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.397595:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874688 00010000:00010000:2.0:1790771166.397605:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.397610:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874816 00000100:00100000:1.0:1790771166.397617:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874816 00000100:00100000:0.0:1790771166.397618:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.397650:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5978 00000100:00100000:2.0:1790771166.397652:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874944 00000100:00100000:2.0:1790771166.397658:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874944 00000100:00100000:1.0:1790771166.397674:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14602:x1877759533874816:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:3.0:1790771166.397675:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874688 00000100:00100000:0.0:1790771166.397684:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.397714:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533875072 00000100:00100000:2.0:1790771166.397719:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533875072 00000100:00100000:0.0:1790771166.397726:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.397727:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5979 00010000:00010000:2.0:1790771166.397736:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 139 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.397744:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:14537:x1877759533874688:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:0.0:1790771166.397767:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.397771:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1641 00000100:00100000:2.0:1790771166.397780:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2399:x1877759533875072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.397787:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.397792:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 140 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.397795:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533875200 00010000:00010000:1.0:1790771166.397797:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.397803:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533875200 00010000:00010000:2.0:1790771166.397806:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 140 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397814:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397822:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0a87b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x91:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c20 expref: 141 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397824:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.397833:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.397837:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533875456 00010000:00010000:2.0:1790771166.397838:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x91:0x0].0x0 (ffff8bfb0321aa00) 00000100:00100000:0.0:1790771166.397843:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533875456 00010000:00010000:2.0:1790771166.397845:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.397847:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.397864:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1561 00010000:00010000:2.0:1790771166.397866:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.397867:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.397873:0:13774:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969300 00000100:00100000:0.0:1790771166.397876:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08479450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:11824:x1877759533875200:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771166.397892:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.397901:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045a710fa reply state 00000000f377ccc4 transno 4294969301 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.397901:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397914:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.397926:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397934:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.397936:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.397936:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.397941:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.397946:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533875072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 163us (281us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.397962:0:13774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.397962:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1641 00010000:00010000:1.0:1790771166.397969:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.397978:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 800 00000100:00100000:1.0:1790771166.397982:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.397987:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2399:x1877759533874944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.397990:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.397995:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.397997:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398011:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0cd7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35702 expref: 141 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398020:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.398023:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.398030:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:14602:x1877759533874816:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 372us (459us total) trans 4294969301 rc 0/0 00000100:00100000:1.0:1790771166.398036:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5978 00000020:00080000:1.0:1790771166.398039:0:13774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.398051:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2399:x1877759533874944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.398060:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 800 00000100:00100000:1.0:1790771166.398064:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1562 00000100:00100000:1.0:1790771166.398076:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:12118:x1877759533875456:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.398117:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398124:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398164:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:12118:x1877759533875456:12345-192.168.204.50@tcp:35:ls.0 Request processed in 92us (401us total) trans 4294968706 rc 0/0 00000100:00100000:1.0:1790771166.398170:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1562 00000100:00100000:1.0:1790771166.398217:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.398232:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533875840 00000100:00100000:1.0:1790771166.398235:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533875840 00010000:00010000:1.0:1790771166.398250:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 139 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771166.398263:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 88 off11264 00000100:00100000:1.0:1790771166.398269:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1642 00000100:00100000:1.0:1790771166.398278:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2399:x1877759533875840:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.398285:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.398289:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 140 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.398299:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fbb326e5 reply state 00000000dc3471d6 transno 4294969302 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790771166.398308:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10912 00010000:00010000:1.0:1790771166.398309:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 140 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.398309:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.398331:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771166.398334:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.398336:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.398339:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.398344:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398347:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x91:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398350:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.398359:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398366:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398372:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533875840:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 94us (152us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.398374:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.398381:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14537:x1877759533874688:12345-192.168.204.50@tcp:36:chown.0 Request processed in 643us (860us total) trans 4294969302 rc 0/0 00010000:00010000:2.0:1790771166.398387:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398390:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1642 00000100:00100000:3.0:1790771166.398395:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5979 00010000:00010000:2.0:1790771166.398403:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398426:0:13771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.398439:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398444:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398449:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398451:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.398459:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.398460:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398463:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398474:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:3.0:1790771166.398476:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.398480:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398482:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398509:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398515:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x91:0x0].0x0 (ffff8bfb0321aa00) 00010000:00010000:2.0:1790771166.398519:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771166.398522:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398527:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x91:0x0].0x0 (ffff8bfb0321aa00) 00010000:00010000:2.0:1790771166.398530:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0cde3 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x91:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398531:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771166.398536:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398546:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0ce99 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x91:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398558:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398564:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.398568:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398569:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.398573:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771166.398584:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.398591:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398594:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876352 00010000:00010000:2.0:1790771166.398596:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398599:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876352 00010000:00010000:2.0:1790771166.398604:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.398608:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398615:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398626:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:2.0:1790771166.398629:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.398633:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398641:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1563 00010000:00010000:2.0:1790771166.398642:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0cdd5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.398649:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.398658:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:13263:x1877759533876352:12345-192.168.204.50@tcp:35:ls.0 00000004:00010000:2.0:1790771166.398678:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000466ee55a reply state 0000000019eee854 transno 4294969303 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398691:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398698:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0xc8b04d25 (ffff8bfc34224f00) 00010000:00010000:2.0:1790771166.398700:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.398703:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.398709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.398739:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14432:x1877759533871104:12345-192.168.204.50@tcp:36:rm.0 Request processed in 11277us (11364us total) trans 4294969303 rc 0/0 00000100:00100000:2.0:1790771166.398748:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5967 00000100:00100000:2.0:1790771166.398767:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876224 00000100:00100000:2.0:1790771166.398770:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876224 00000100:00100000:3.0:1790771166.398777:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.398794:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876480 00000100:00100000:1.0:1790771166.398795:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13263:x1877759533876352:12345-192.168.204.50@tcp:35:ls.0 Request processed in 141us (323us total) trans 4294969304 rc 0/0 00000100:00100000:2.0:1790771166.398798:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876480 00000100:00100000:1.0:1790771166.398808:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1563 00000100:00100000:2.0:1790771166.398823:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5980 00000100:00100000:2.0:1790771166.398831:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14689:x1877759533876224:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:1.0:1790771166.398843:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533869952 00000100:00100000:1.0:1790771166.398850:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533869952 00000100:00100000:3.0:1790771166.398859:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.398861:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398870:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.398874:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 75 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.398879:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398913:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870208 00000100:00100000:1.0:1790771166.398919:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870208 00000100:00100000:3.0:1790771166.398923:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.398941:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 84 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.398965:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870464 00000100:00100000:1.0:1790771166.398968:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870464 00000100:00100000:3.0:1790771166.398978:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533870720 00010000:00010000:1.0:1790771166.398983:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 142 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.398984:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533870720 00010000:00010000:3.0:1790771166.399006:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 143 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.399014:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1643 00000100:00100000:1.0:1790771166.399024:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:2397:x1877759533869952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.399033:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.399037:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 75 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399042:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1644 00010000:00010000:1.0:1790771166.399055:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 75 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399057:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:2397:x1877759533870208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.399072:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.399077:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669600/0xfa0c505d97f0c531 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3565a expref: 75 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399081:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 84 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399097:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 84 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399103:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771166.399108:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399113:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399118:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.399127:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0bfb2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3541c expref: 84 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399141:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00000100:00100000:1.0:1790771166.399145:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533869952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 121us (435us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.399147:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.399161:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1643 00010000:00010000:3.0:1790771166.399165:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399174:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.399181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1645 00000100:00100000:1.0:1790771166.399191:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:2397:x1877759533870464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.399200:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.399203:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.399205:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 144 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399217:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 144 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.399218:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:14530:x1877759533873920:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 8382us (8458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.399232:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:2397:x1877759533870208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 177us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.399238:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1559 00010000:00010000:1.0:1790771166.399239:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771166.399246:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1644 00010000:00010000:1.0:1790771166.399247:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399254:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.399268:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1646 00000100:00100000:3.0:1790771166.399278:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:2397:x1877759533870720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.399282:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:2397:x1877759533870464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (422us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.399288:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.399291:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.399297:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 143 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.399299:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1645 00010000:00010000:3.0:1790771166.399313:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 142 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399326:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.399329:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.399331:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876608 00000100:00100000:1.0:1790771166.399336:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876608 00010000:00010000:3.0:1790771166.399338:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.399343:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.399369:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2397:x1877759533870720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 91us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.399374:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5981 00000100:00100000:3.0:1790771166.399382:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1646 00000100:00100000:1.0:1790771166.399387:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+82:14520:x1877759533876480:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771166.399395:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.399407:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399408:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cea7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3596a expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399410:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533874304 00000100:00100000:0.0:1790771166.399417:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d91500 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745920:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.399418:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533874304 00010000:00010000:2.0:1790771166.399429:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399451:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 985 00010000:00010000:1.0:1790771166.399456:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399463:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533874304:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:1.0:1790771166.399469:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399480:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399520:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399521:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399539:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399540:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399565:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399565:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.399566:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533874304:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.399586:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 985 00010000:00010000:2.0:1790771166.399594:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.399598:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399604:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399614:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:2.0:1790771166.399616:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.399619:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399620:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cebc lrc: 3/1,0 mode: --/PR res: [0x240000403:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.399627:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0cc1c lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399631:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cebc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399643:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cebc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.399702:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x36:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.399704:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14746:x1877759533862272:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 40054us (40283us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771166.399706:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5982 00000004:00200000:1.0:1790771166.399710:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1790771166.399722:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14325:x1877759533876608:12345-192.168.204.50@tcp:101:mrename.0 00000004:00010000:1.0:1790771166.399725:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cebc lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399731:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.399734:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399742:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399743:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cec3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35971 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399767:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399773:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399778:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.399781:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399786:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399787:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.399801:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5943 00010000:00010000:1.0:1790771166.399809:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.399813:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.399816:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399820:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0ceae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399831:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399835:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399840:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399841:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399856:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.399858:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399860:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399874:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399880:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399883:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd6e9df9d (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.399890:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.399893:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399894:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399910:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0ceb5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399911:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399945:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cea7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3596a expref: 84 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.399956:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399958:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595800/0xfa0c505d97f0cebc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3596a expref: 83 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399976:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x36:0x0].0x0 (ffff8bfb03218600) 00010000:00010000:1.0:1790771166.399978:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.399979:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.399980:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595800, rc 0) 00010000:00010000:3.0:1790771166.399993:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.400010:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:14520:x1877759533876480:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 627us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.400017:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5981 00000004:00200000:3.0:1790771166.400019:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00000004:00200000:3.0:1790771166.400024:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.400038:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400050:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400060:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400066:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400071:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400077:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400081:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.400085:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400089:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400096:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.400098:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.400100:0:13773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400109:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400114:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ceca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400121:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400125:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400130:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400133:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.400181:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400189:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400199:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc1040f500) 00010000:00010000:3.0:1790771166.400202:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.400206:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400211:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ced1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400231:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cec3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35971 expref: 112 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400241:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35971 expref: 111 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400246:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771166.400248:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.400249:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00000100:00100000:3.0:1790771166.400279:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14325:x1877759533876608:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 563us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.400284:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5982 00000001:00080000:2.0:1790771166.400329:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969305 is committed 00000001:00080000:2.0:1790771166.400346:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969303 is committed 00010000:00010000:1.0:1790771166.400359:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.400364:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969296 is committed 00010000:00010000:3.0:1790771166.400364:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400375:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400384:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400391:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.400395:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400404:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400412:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.400414:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000133362da reply state 00000000d853ba49 transno 4294969305 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400419:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.400427:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.400428:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400432:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.400436:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400442:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.400448:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400453:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ce8b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.400455:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:3.0:1790771166.400459:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.400462:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.400467:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790771166.400473:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.400479:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0xc8b04d25 (ffff8bfc34224f00) 00010000:00010000:3.0:1790771166.400482:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.400506:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.400513:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38600/0xfa0c505d97f0cddc lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7c:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400517:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400525:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400530:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400534:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00080000:0.0:1790771166.400537:0:13771:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771166.400537:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.400547:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14689:x1877759533876224:12345-192.168.204.50@tcp:36:chown.0 Request processed in 1715us (1965us total) trans 4294969305 rc 0/0 00010000:00010000:1.0:1790771166.400552:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.400559:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5980 00010000:00010000:1.0:1790771166.400564:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.400567:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.400570:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400574:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ce92 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400589:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400594:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400599:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400602:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.400604:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400608:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400612:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:1.0:1790771166.400614:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.400615:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.400623:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cea0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.401861:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.401896:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533877120 00000100:00100000:0.0:1790771166.401902:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533877120 00000100:00100000:0.0:1790771166.401929:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5983 00000100:00100000:0.0:1790771166.401936:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:10887:x1877759533877120:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:0.0:1790771166.401945:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.401947:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790771166.401959:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0296a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31faa expref: 107 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.401969:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:0.0:1790771166.401972:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.401978:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0cedf lrc: 2/0,0 mode: --/CW res: [0x200000403:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3597f expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402027:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402035:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402040:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402049:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402054:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402059:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402084:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cef4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402089:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402094:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.402100:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x37:0x0]: returning size 5 00010000:00010000:0.0:1790771166.402146:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402155:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402162:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402168:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.402172:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402179:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402189:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0x0 (ffff8bfb03026000) 00010000:00010000:0.0:1790771166.402192:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.402196:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402202:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0cee6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402213:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402221:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402227:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402233:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.402236:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402243:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402256:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x31:0x0].0xdcc87686 (ffff8bfc13395100) 00010000:00010000:0.0:1790771166.402259:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.402262:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 2/0,0 mode: --/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402269:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ceed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x31:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402299:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0cedf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3597f expref: 109 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402314:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cef4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3597f expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.402322:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00010000:00010000:0.0:1790771166.402325:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.402328:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5200, rc 0) 00000100:00100000:0.0:1790771166.402361:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:10887:x1877759533877120:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 424us (499us total) trans 4294969306 rc 0/0 00000100:00100000:0.0:1790771166.402369:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5983 00000100:00100000:2.0:1790771166.406103:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.406170:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533878656 00000100:00100000:0.0:1790771166.406175:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533878656 00000100:00100000:0.0:1790771166.406206:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5984 00000100:00100000:0.0:1790771166.406212:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:12188:x1877759533878656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.406224:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.406234:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cf02 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3598d expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406270:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406279:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406284:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406293:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406297:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406302:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.406340:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.406367:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406373:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406377:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406380:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00030200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.406382:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406390:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406397:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.406398:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.406401:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406405:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0cf09 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406412:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406416:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406421:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406424:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.406425:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406429:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406433:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc13395500) 00010000:00010000:0.0:1790771166.406434:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.406436:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406443:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cf10 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406461:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cf02 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3598d expref: 76 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406467:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.406469:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.406471:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cf02 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3598d expref: 76 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.406477:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031000, rc 0) 00000100:00100000:0.0:1790771166.406523:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:12188:x1877759533878656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 311us (422us total) trans 4294968707 rc 301/301 00000100:00100000:0.0:1790771166.406528:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5984 00000100:00100000:3.0:1790771166.407024:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.407043:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.407065:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.407070:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539746048:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.407082:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876992 00000100:00100000:1.0:1790771166.407087:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533877248 00000100:00100000:2.0:1790771166.407088:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876992 00000100:00100000:3.0:1790771166.407095:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.407096:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533877248 00000100:00100000:0.0:1790771166.407116:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b00e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539746176:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.407118:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533877504 00010000:00010000:1.0:1790771166.407124:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.407125:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533877504 00000100:00100000:2.0:1790771166.407130:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5985 00000100:00100000:0.0:1790771166.407132:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b03b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539746304:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.407145:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13269:x1877759533876992:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.407160:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.407160:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533877760 00010000:00010000:2.0:1790771166.407161:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.407168:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1647 00010000:00010000:2.0:1790771166.407177:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf1e lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35978 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.407183:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2399:x1877759533877248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.407196:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1564 00010000:00010000:1.0:1790771166.407197:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.407204:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.407209:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:11826:x1877759533877504:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.407224:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 108 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.407224:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533877760 00010000:00010000:1.0:1790771166.407241:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0c6f1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356f4 expref: 109 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407247:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407253:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.407259:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407262:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407266:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.407277:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.407295:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.407299:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2399:x1877759533877248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (229us total) trans 0 rc 0/0 00000004:00200000:2.0:1790771166.407299:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.407307:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:11826:x1877759533877504:12345-192.168.204.50@tcp:35:ls.0 Request processed in 101us (260us total) trans 4294968708 rc 0/0 00000100:00100000:3.0:1790771166.407308:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1565 00000004:00010000:2.0:1790771166.407311:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.407324:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1647 00000100:00100000:3.0:1790771166.407325:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:11863:x1877759533877760:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.407328:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1564 00010000:00010000:2.0:1790771166.407347:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf1e lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 133 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407360:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 132 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407366:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.407369:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.407372:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5600, rc 0) 00000100:00100000:2.0:1790771166.407400:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:13269:x1877759533876992:12345-192.168.204.50@tcp:101:ls.0 Request processed in 260us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.407408:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.407413:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5985 00000100:00100000:1.0:1790771166.407448:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.407449:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:11863:x1877759533877760:12345-192.168.204.50@tcp:35:ls.0 Request processed in 124us (353us total) trans 4294969307 rc 0/0 00000100:00100000:3.0:1790771166.407459:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1565 00000100:00100000:1.0:1790771166.407473:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533877888 00000100:00100000:1.0:1790771166.407478:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533877888 00010000:00010000:1.0:1790771166.407522:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 132 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.407551:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1648 00000100:00100000:1.0:1790771166.407558:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2399:x1877759533877888:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.407566:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.407572:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879936 00010000:00010000:1.0:1790771166.407577:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 132 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407578:0:13767:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000002da0655d x1877759539745280) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 132 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.407579:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879936 00010000:00010000:1.0:1790771166.407607:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 132 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407611:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cdce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3580c expref: 132 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.407622:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.407623:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5986 00000100:00100000:3.0:1790771166.407637:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14824:x1877759533879936:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.407641:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0ce30 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35947 expref: 131 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.407645:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745280:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.407651:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.407680:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.407680:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cf2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359a9 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407686:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407689:0:13767:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000002ae651a0 x1877759539745408) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407709:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407716:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0cbe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3576b expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.407717:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533878400 00010000:00010000:1.0:1790771166.407718:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407723:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.407724:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533878400 00000100:00100000:0.0:1790771166.407749:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.407753:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.407754:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5987 00000100:00100000:2.0:1790771166.407767:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14870:x1877759533878400:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:0.0:1790771166.407780:0:13767:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000171d5685 x1877759539745536) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 1/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 129 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.407784:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2399:x1877759533877888:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 224us (378us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.407793:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1790771166.407795:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.407805:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1648 00010000:00010000:2.0:1790771166.407811:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0c665 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356b5 expref: 76 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407818:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407820:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0cb6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3574f expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407835:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0add7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dbd expref: 75 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407839:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.407842:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1180 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745536:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.407859:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0b9ae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352c5 expref: 74 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407860:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407860:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.407868:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90380 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745664:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.407885:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d91880 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539745792:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.407885:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407888:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407891:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.407902:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.407906:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.407911:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407918:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407920:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407928:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407937:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407946:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 82 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.407947:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.407951:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539745152:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.407956:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.407967:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.407976:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407981:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.407999:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.408006:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 76520 00010000:00010000:2.0:1790771166.408021:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 82 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.408034:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 82 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408047:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.408057:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:13763:1877759539746432:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.408060:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408072:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408081:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408088:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.408092:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408099:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.408121:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cddcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.408147:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.408150:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.408154:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408162:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408177:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408184:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408191:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.408196:0:6495:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x26:0x0], index 1: 0 00010000:00010000:3.0:1790771166.408239:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.408243:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408255:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408265:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xdcc87686 (ffff8bfc1040f500) 00010000:00010000:3.0:1790771166.408268:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.408271:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408275:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408304:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cf2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408314:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408320:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:1.0:1790771166.408322:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cf5d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.408322:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.408327:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372400, rc 0) 00010000:00010000:1.0:1790771166.408338:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408345:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cf5d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.408357:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14824:x1877759533879936:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 723us (914us total) trans 4294969308 rc 0/0 00000100:00100000:3.0:1790771166.408364:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5986 00010000:00010000:1.0:1790771166.408365:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408372:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408377:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408382:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408385:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.408388:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408391:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408398:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.408400:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.408404:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408412:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0ce61 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.408426:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f21045cb reply state 00000000f2c2764b transno 4294969309 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408436:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408443:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x61bf1dfb (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.408447:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.408449:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.408469:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ce45 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357cd expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408511:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cf5d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357cd expref: 128 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.408520:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff8bfb03218e00) 00010000:00010000:1.0:1790771166.408522:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.408524:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00000100:00100000:1.0:1790771166.408556:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14657:x1877759533867648:12345-192.168.204.50@tcp:101:touch.0 Request processed in 11990us (12121us total) trans 4294969309 rc 0/0 00000100:00100000:1.0:1790771166.408562:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5976 00000100:00100000:0.0:1790771166.412358:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.412381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.412396:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533878784 00000100:00100000:0.0:1790771166.412402:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.412403:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533878784 00010000:00010000:1.0:1790771166.412422:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.412424:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879040 00000100:00100000:2.0:1790771166.412432:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879040 00000100:00100000:3.0:1790771166.412433:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879168 00000100:00100000:3.0:1790771166.412439:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879168 00000100:00100000:1.0:1790771166.412456:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1649 00000100:00100000:1.0:1790771166.412465:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2399:x1877759533878784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.412473:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.412477:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412526:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412548:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0c3a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35573 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412561:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.412566:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.412575:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5988 00010000:00010000:1.0:1790771166.412581:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.412588:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:13894:x1877759533879040:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771166.412597:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412602:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.412615:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0cf6b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35994 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.412627:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5989 00010000:00010000:1.0:1790771166.412629:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.412638:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14511:x1877759533879168:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771166.412650:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.412673:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.412677:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2399:x1877759533878784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (305us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.412677:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cf79 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3599b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.412699:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1649 00010000:00010000:2.0:1790771166.412700:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412710:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412723:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412727:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412728:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412733:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412753:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412753:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412755:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412779:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.412781:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 21450 00010000:00010000:3.0:1790771166.412825:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412832:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412840:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412841:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412846:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ce0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 128 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412862:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412869:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 127 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412872:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412883:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.412895:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.412898:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.412900:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5600, rc 0) 00000004:00200000:2.0:1790771166.412904:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.412908:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.412917:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.412924:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14616:x1877759533862400:12345-192.168.204.50@tcp:101:cp.0 Request processed in 22770us (22857us total) trans 4294969310 rc 0/0 00010000:00010000:2.0:1790771166.412926:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412936:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.412937:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5970 00010000:00010000:2.0:1790771166.412949:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.412949:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412962:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.412965:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412970:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412977:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:2.0:1790771166.412980:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.412983:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.412988:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0cf72 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.412997:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.412999:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413006:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413011:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.413016:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879424 00000100:00100000:1.0:1790771166.413022:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879424 00010000:00010000:2.0:1790771166.413024:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.413024:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413032:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413042:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.413048:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x61:0x0]: returning size 0 00000100:00100000:1.0:1790771166.413051:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5990 00000004:00200000:3.0:1790771166.413053:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.413054:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc4205d300) 00000100:00100000:1.0:1790771166.413061:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14753:x1877759533879424:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.413061:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:3.0:1790771166.413064:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413068:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413074:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.413081:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413084:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0cf87 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413085:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cfaa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359a2 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413097:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413114:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413119:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413124:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413129:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08479450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:11824:x1877759533875200:12345-192.168.204.50@tcp:37:ls.0 Request processed in 15254us (15404us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.413130:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0cf6b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35994 expref: 76 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413133:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413135:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.413141:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413151:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1561 00010000:00010000:3.0:1790771166.413163:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413164:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413165:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35994 expref: 75 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413191:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:3.0:1790771166.413193:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.413194:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.413195:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413200:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00010000:00010000:3.0:1790771166.413200:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.413208:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413216:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0cf80 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413220:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413234:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413237:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.413237:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.413238:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:13894:x1877759533879040:12345-192.168.204.50@tcp:101:rm.0 Request processed in 648us (849us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.413247:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413256:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885440 00010000:00010000:1.0:1790771166.413262:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.413262:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5988 00000100:00100000:0.0:1790771166.413263:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885440 00010000:00010000:3.0:1790771166.413264:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413284:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.413288:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.413293:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5991 00010000:00010000:3.0:1790771166.413296:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.413306:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:12122:x1877759533885440:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.413307:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xdcc87686 (ffff8bfc1040f500) 00010000:00010000:3.0:1790771166.413313:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.413316:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413316:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413319:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.413330:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0cfc6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a35 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413339:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0cf95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413340:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413349:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.413362:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413368:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413369:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879552 00000100:00100000:0.0:1790771166.413374:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879552 00000004:00200000:1.0:1790771166.413376:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00010000:00010000:2.0:1790771166.413379:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413388:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.413394:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413399:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5992 00010000:00010000:2.0:1790771166.413399:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413415:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14145:x1877759533879552:12345-192.168.204.50@tcp:55:truncate.0 00010000:00010000:3.0:1790771166.413416:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0cf79 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3599b expref: 114 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413422:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413437:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413451:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413451:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413453:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3599b expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.413459:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413478:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.413519:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413520:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413521:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x61:0x0].0x0 (ffff8bfb0321a500) 00000004:00200000:2.0:1790771166.413526:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.413529:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.413535:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00010000:00010000:1.0:1790771166.413544:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.413547:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413550:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.413566:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14511:x1877759533879168:12345-192.168.204.50@tcp:101:rm.0 Request processed in 927us (1160us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.413572:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413584:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.413586:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413588:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413608:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.413608:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.413616:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 126 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413617:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.413620:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.413624:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413626:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.413645:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5989 00000100:00100000:0.0:1790771166.413649:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539746560:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.413652:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0cfb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413653:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413697:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.413699:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413700:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.413706:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413709:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413711:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080780 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.413716:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0cfcd lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413727:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413736:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.413742:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413743:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.413754:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.413763:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.413766:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413773:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413781:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.413782:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x18618557 (ffff8bfb03218f00) 00010000:00010000:2.0:1790771166.413784:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413786:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.413792:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413794:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413800:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881472 00000100:00100000:0.0:1790771166.413806:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881472 00010000:00010000:1.0:1790771166.413815:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0cfb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413817:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc4205de00) 00010000:00010000:2.0:1790771166.413823:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.413825:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413830:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0cfd4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.413836:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5993 00000100:00100000:3.0:1790771166.413848:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14376:x1877759533881472:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.413853:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0cfaa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a2 expref: 114 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413859:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.413871:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0cfe9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413872:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0cfc6 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a35 expref: 77 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.413873:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a2 expref: 113 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413878:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.413901:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.413903:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:2.0:1790771166.413903:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.413911:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.413911:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1790771166.413913:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880064 00010000:00010000:1.0:1790771166.413916:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595000, rc 0) 00000100:00100000:0.0:1790771166.413918:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880064 00010000:00010000:2.0:1790771166.413920:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0cfc6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a35 expref: 77 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.413923:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.413938:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00010000:00010000:3.0:1790771166.413939:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413940:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880192 00000100:00100000:0.0:1790771166.413946:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880192 00000100:00100000:1.0:1790771166.413947:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14753:x1877759533879424:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 886us (952us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.413958:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.413960:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5990 00000100:00100000:2.0:1790771166.413970:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:12122:x1877759533885440:12345-192.168.204.50@tcp:101:ls.0 Request processed in 666us (738us total) trans 4294968709 rc 301/301 00000100:00100000:0.0:1790771166.413971:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5994 00000100:00100000:2.0:1790771166.413983:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5991 00010000:00010000:3.0:1790771166.413983:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.413986:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14676:x1877759533880064:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771166.413995:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5995 00010000:00010000:3.0:1790771166.414003:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414009:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.414013:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14460:x1877759533880192:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771166.414018:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414021:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cffe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359b7 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414023:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.414029:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879808 00010000:00010000:1.0:1790771166.414035:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d005 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359be expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.414035:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879808 00010000:00010000:3.0:1790771166.414044:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0d00c lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414051:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0d00c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414057:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0d00c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414058:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414068:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414070:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414071:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.414079:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 986 00000100:00100000:2.0:1790771166.414093:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:14596:x1877759533879808:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.414096:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414097:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414103:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.414113:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359b0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414129:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414135:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414135:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414148:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 22 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414155:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414159:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414169:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414173:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771166.414185:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1790771166.414186:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414186:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414192:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414194:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [24576->36863] (req 24576->36863) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b0 expref: 23 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414214:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.414221:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414224:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414236:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414242:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 22 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414251:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414251:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.414259:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 22 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414260:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.414267:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414268:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414272:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.414291:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539746688:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.414291:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0cff0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414298:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414298:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414315:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.414319:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cddf00 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.414322:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414328:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414329:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.414336:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00010000:00010000:3.0:1790771166.414350:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414353:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.414357:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414357:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.414364:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414375:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414378:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414382:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf7a5b27a (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.414388:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.414393:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414395:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414409:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0cff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414415:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.414417:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414431:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414438:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.414442:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414448:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414460:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0cfe9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359ef expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414461:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.414462:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.414469:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.414474:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414505:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d01a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414516:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414521:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.414524:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0d00c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359ef expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414528:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880448 00010000:00010000:1.0:1790771166.414532:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414535:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880448 00010000:00010000:3.0:1790771166.414542:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:1.0:1790771166.414547:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.414547:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.414549:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00010000:00010000:1.0:1790771166.414555:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414567:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881088 00010000:00010000:1.0:1790771166.414571:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414572:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881088 00000100:00100000:2.0:1790771166.414583:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5996 00000100:00100000:3.0:1790771166.414584:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14376:x1877759533881472:12345-192.168.204.50@tcp:101:cat.0 Request processed in 737us (831us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.414588:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfb03218000) 00010000:00010000:1.0:1790771166.414593:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.414599:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14733:x1877759533880448:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:1.0:1790771166.414600:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414610:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.414612:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d02f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414619:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d044 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359cc expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.414635:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5993 00010000:00010000:2.0:1790771166.414639:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0d04b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414644:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5997 00010000:00010000:1.0:1790771166.414646:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d005 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359be expref: 120 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.414671:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14851:x1877759533881088:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:2.0:1790771166.414681:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414689:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359be expref: 119 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414695:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.414696:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0d04b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.414697:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:1.0:1790771166.414705:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.414710:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339a00, rc 0) 00010000:00010000:0.0:1790771166.414713:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f09d53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34853 expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414727:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfc3600fc00) 00010000:00010000:0.0:1790771166.414736:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.414745:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14460:x1877759533880192:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 737us (845us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.414748:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.414754:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5995 00010000:00010000:0.0:1790771166.414763:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.414770:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414778:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d044 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359cc expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414791:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39600/0xfa0c505d97f0d04b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359cc expref: 117 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414797:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:2.0:1790771166.414799:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771166.414802:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39600, rc 0) 00000100:00100000:1.0:1790771166.414814:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.414839:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14733:x1877759533880448:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 244us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.414845:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881728 00000100:00100000:2.0:1790771166.414849:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5996 00000100:00100000:3.0:1790771166.414851:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881728 00000100:00100000:2.0:1790771166.414899:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5998 00000100:00100000:1.0:1790771166.414904:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.414912:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14817:x1877759533881728:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.414934:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.414944:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.414954:0:13773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.414960:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880320 00010000:00010000:2.0:1790771166.414963:0:13773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 118 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.414964:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880320 00000100:00100000:1.0:1790771166.414975:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.414978:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.414997:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533882240 00010000:00010000:2.0:1790771166.414998:0:13773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 118 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.415002:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533882240 00000100:00100000:1.0:1790771166.415008:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 987 00010000:00010000:2.0:1790771166.415015:0:13773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 118 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.415023:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759533880320:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:2.0:1790771166.415031:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06793100 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539746816:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.415032:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.415033:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 988 00010000:00010000:1.0:1790771166.415044:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5149f2e/0xfa0c505d97f0d060 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359c5 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.415045:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759533882240:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771166.415059:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.415071:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e239a23d/0xfa0c505d97f0d067 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a04 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.415088:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539746944:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.415102:0:13773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415115:0:13773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 126 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.415124:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539747072:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.415132:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10487cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.415153:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.415159:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539747200:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.415168:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.415178:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533876736 00000100:00100000:2.0:1790771166.415182:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533876736 00000100:00100000:0.0:1790771166.415192:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533879296 00000100:00100000:0.0:1790771166.415197:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533879296 00002000:00100000:2.0:1790771166.415208:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (520192->524287) req@ffff8bfb06733b80 x1877759533876736/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1790771166.415215:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/4 (13255->18446744073709551615) 00002000:00100000:2.0:1790771166.415218:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06733b80 with x1877759533876736 ext(520192->524287) 00002000:00100000:0.0:1790771166.415219:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc08b00e00 with x1877759533879296 ext(13255->18446744073709551615) 00002000:00010000:2.0:1790771166.415228:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06733b80 00002000:00010000:0.0:1790771166.415229:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc08b00e00. 00000100:00100000:3.0:1790771166.415254:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.415268:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 409 00000100:00100000:0.0:1790771166.415276:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 410 00000100:00100000:2.0:1790771166.415282:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533876736:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771166.415289:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533879296:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:3.0:1790771166.415297:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.415320:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881984 00000100:00100000:3.0:1790771166.415323:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881984 00000100:00100000:1.0:1790771166.415347:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.415355:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 989 00000100:00100000:3.0:1790771166.415364:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533881984:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771166.415371:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.415380:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047331246/0xfa0c505d97f0d06e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359fd expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.415392:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.415399:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533876736:12345-192.168.204.50@tcp:3:cat.0 Request processed in 121us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.415405:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 409 00002000:00100000:2.0:1790771166.415413:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (520192->524287) req@ffff8bfb06733b80 x1877759533876736/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.415416:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539747328:192.168.204.50@tcp:106: 00002000:00100000:2.0:1790771166.415429:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06733b80 with x1877759533876736 ext(520192->524287) 00000100:00100000:1.0:1790771166.415431:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.415435:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06733b80 00000100:00100000:3.0:1790771166.415452:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de000 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.415463:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533882368 00000100:00100000:1.0:1790771166.415466:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880832 00000100:00100000:2.0:1790771166.415467:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533882368 00000100:00100000:1.0:1790771166.415471:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880832 00000100:00100000:3.0:1790771166.415478:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533878912 00000100:00100000:3.0:1790771166.415506:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533878912 00010000:00010000:2.0:1790771166.415513:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 119 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415525:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 127 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.415538:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 990 00000100:00100000:2.0:1790771166.415548:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1650 00000100:00100000:1.0:1790771166.415554:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533880832:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:3.0:1790771166.415559:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1651 00000100:00100000:2.0:1790771166.415567:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759533882368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.415571:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.415576:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2397:x1877759533878912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.415582:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.415585:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7bc89a/0xfa0c505d97f0d075 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359da expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415585:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.415591:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 119 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415594:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 127 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415622:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 119 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415634:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 127 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.415643:0:13795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 25161 -> 13255 00000100:00100000:1.0:1790771166.415647:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06730e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539747456:192.168.204.50@tcp:106: 00002000:00010000:0.0:1790771166.415649:0:13795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790771165 -> 1790771166 00010000:00010000:2.0:1790771166.415653:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0caa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35844 expref: 119 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415657:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0cb4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35748 expref: 127 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.415658:0:13795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771166.415682:0:13795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.415691:0:13795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 48 -> 24 00000100:00100000:1.0:1790771166.415701:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10487e40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.415703:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.415708:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415714:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.415715:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.415720:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415726:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.415757:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533879296:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 470us (590us total) trans 4294967609 rc 0/0 00000100:00100000:2.0:1790771166.415758:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759533882368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 198us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.415764:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2397:x1877759533878912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 192us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.415781:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1650 00000100:00100000:0.0:1790771166.415782:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 410 00000100:00100000:1.0:1790771166.415786:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771166.415790:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/4 (13255->18446744073709551615) 00000100:00100000:3.0:1790771166.415794:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1651 00002000:00100000:0.0:1790771166.415796:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc08b00e00 with x1877759533879296 ext(13255->18446744073709551615) 00002000:00010000:0.0:1790771166.415803:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc08b00e00. 00000100:00100000:2.0:1790771166.415806:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533882112 00000100:00100000:2.0:1790771166.415809:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533882112 00010000:00010000:2.0:1790771166.415827:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 118 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.415856:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.415861:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1652 00000100:00100000:2.0:1790771166.415870:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759533882112:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.415878:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.415882:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 118 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415892:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 118 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.415892:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533882624 00000100:00100000:3.0:1790771166.415898:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533882624 00000100:00100000:1.0:1790771166.415905:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.415910:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0cac5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3584b expref: 118 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415920:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.415924:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.415929:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.415930:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 5999 00000100:00100000:3.0:1790771166.415941:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14898:x1877759533882624:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.415956:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759533882112:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.415959:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.415961:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.415969:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533882752 00000100:00100000:2.0:1790771166.415971:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1652 00000100:00100000:0.0:1790771166.415978:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533882752 00010000:00010000:3.0:1790771166.415979:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ab53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d1c expref: 126 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.415994:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:3.0:1790771166.415997:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.416004:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.416007:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416016:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 116 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416023:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 126 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416028:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 116 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416033:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 6/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.416040:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533883008 00000100:00100000:1.0:1790771166.416046:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533883008 00010000:00010000:3.0:1790771166.416052:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 116 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416062:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 116 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.416071:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539747584:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.416078:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1566 00000100:00100000:2.0:1790771166.416078:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533883520 00000100:00100000:1.0:1790771166.416084:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6000 00000100:00100000:2.0:1790771166.416086:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533883520 00000100:00100000:0.0:1790771166.416093:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13261:x1877759533882752:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.416095:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14905:x1877759533883008:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.416118:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6001 00000100:00100000:2.0:1790771166.416128:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:14520:x1877759533883520:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771166.416137:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416151:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 127 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416159:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 127 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416163:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416179:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 128 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.416193:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06792300 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539747840:0@lo:1000:mdt00_017.0 00000100:00100000:3.0:1790771166.416197:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539747712:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.416203:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13261:x1877759533882752:12345-192.168.204.50@tcp:35:ls.0 Request processed in 111us (295us total) trans 4294969312 rc 0/0 00010000:00010000:1.0:1790771166.416204:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 128 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416219:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1566 00010000:00010000:1.0:1790771166.416231:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 127 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.416245:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539747968:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.416254:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 116 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.416255:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.416271:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 116 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.416276:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10487f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.416282:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539748096:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.416284:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd480 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.416293:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539747840 00000100:00100000:0.0:1790771166.416300:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539747840 00000100:00100000:3.0:1790771166.416312:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc0715d780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.416345:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.416371:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1790771166.416375:0:13785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533883776 00000100:00100000:1.0:1790771166.416380:0:13785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533883776 00000100:00100000:2.0:1790771166.416391:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.416412:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539747840:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.416414:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533883904 00000100:00100000:1.0:1790771166.416420:0:13785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 36 00000100:00100000:2.0:1790771166.416421:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533883904 00000100:00100000:1.0:1790771166.416434:0:13785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14619:x1877759533883776:12345-192.168.204.50@tcp:36:mrename.0 00000100:00100000:2.0:1790771166.416456:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6002 00000100:00100000:2.0:1790771166.416467:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14530:x1877759533883904:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.416471:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416476:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.416507:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416513:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d091 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a12 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416515:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416540:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539747840:12345-0@lo:1000:mdt00_017.0 Request processed in 159us (286us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.416543:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416548:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1790771166.416559:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.416561:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416573:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416577:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.416592:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969311 is committed 00010000:00010000:1.0:1790771166.416596:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.416600:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1790771166.416612:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969310 is committed 00010000:00010000:2.0:1790771166.416616:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416618:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416630:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416631:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416636:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416647:0:13772:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969296 gen 2 00010000:00010000:3.0:1790771166.416649:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.416656:0:13772:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969296 committed transno 4294969296 00010000:00010000:3.0:1790771166.416681:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.416685:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x85:0x0]: returning size 38336 00010000:00010000:3.0:1790771166.416686:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.416691:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416693:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06792300 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539747840:0@lo:1000:mdt00_017.0 00000004:00200000:2.0:1790771166.416693:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.416703:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.416712:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416714:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x61bf1dfb (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.416721:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416722:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.416727:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416734:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416735:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0cf41 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416739:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d091 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 128 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416741:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539748224:0@lo:1000:mdt00_017.0 00010000:00010000:1.0:1790771166.416761:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416769:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.416778:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533887360 00010000:00010000:2.0:1790771166.416784:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000100:00100000:3.0:1790771166.416784:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533887360 00010000:00010000:1.0:1790771166.416785:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.416791:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.416796:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:1.0:1790771166.416801:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 83 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.416807:0:13785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 4/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.416815:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6003 00000100:00100000:2.0:1790771166.416828:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14530:x1877759533883904:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 359us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.416829:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.416829:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14199:x1877759533887360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.416833:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 83 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416846:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.416849:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6002 00000100:00100000:0.0:1790771166.416850:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.416854:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 83 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416856:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0d0bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3586e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416872:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539748224 00000100:00100000:1.0:1790771166.416878:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049eb480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0001_UUID:13785:1877759539748352:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.416881:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539748224 00010000:00010000:3.0:1790771166.416907:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416915:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416922:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.416927:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10429b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.416929:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00010000:00010000:3.0:1790771166.416933:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.416940:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.416946:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539748224:12345-0@lo:1000:mdt00_017.0 00010000:00010000:3.0:1790771166.416951:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.416995:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000071a8c6a reply state 00000000338020c2 transno 4294969311 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417005:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417010:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfc13395100) 00010000:00010000:1.0:1790771166.417013:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.417015:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.417019:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0d0d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.417021:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x63:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.417036:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0d0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417047:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0d0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.417056:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3e:0x0]: returning size 5 00010000:00080000:1.0:1790771166.417073:0:6495:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1790771166.417074:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539748224:12345-0@lo:1000:mdt00_017.0 Request processed in 134us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.417085:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1790771166.417090:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14851:x1877759533881088:12345-192.168.204.50@tcp:36:chown.0 Request processed in 2431us (2631us total) trans 4294969311 rc 0/0 00000100:00100000:1.0:1790771166.417103:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5997 00010000:00010000:2.0:1790771166.417132:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417141:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417142:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539748224:0@lo:1000:mdt00_017.0 00010000:00010000:2.0:1790771166.417157:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417164:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.417169:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.417170:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.417172:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417183:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.417185:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533884416 00000100:00100000:1.0:1790771166.417191:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533884416 00010000:00010000:2.0:1790771166.417200:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfc13395100) 00010000:00010000:2.0:1790771166.417204:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.417207:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417212:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d052 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x63:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.417219:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6004 00000100:00100000:0.0:1790771166.417230:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa44000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539748480:0@lo:1000:mdt00_017.0 00010000:00010000:3.0:1790771166.417230:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.417236:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:14522:x1877759533884416:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:3.0:1790771166.417249:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417254:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417258:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.417261:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417268:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417271:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.417272:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001_UUID:13763:1877759539746432:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.417281:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417288:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:1.0:1790771166.417290:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417292:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.417295:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.417296:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417297:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417308:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417320:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0d0c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417335:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.417342:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417344:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417354:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533884032 00010000:00010000:1.0:1790771166.417356:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417357:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417359:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533884032 00000100:00100000:0.0:1790771166.417367:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.417376:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (14473->18446744073709551615) 00010000:00010000:3.0:1790771166.417378:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417381:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.417382:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b1c00 with x1877759533884032 ext(14473->18446744073709551615) 00002000:00010000:2.0:1790771166.417393:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb057b1c00. 00010000:00010000:3.0:1790771166.417397:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.417402:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.417404:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417411:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417419:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x84832a57 (ffff8bfc1040fb00) 00000100:00100000:2.0:1790771166.417423:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 411 00010000:00010000:3.0:1790771166.417424:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.417425:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885056 00010000:00010000:3.0:1790771166.417430:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417431:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885056 00000100:00100000:2.0:1790771166.417437:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2397:x1877759533884032:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:3.0:1790771166.417440:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d0c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3a:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417462:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1567 00000100:00100000:0.0:1790771166.417471:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08479c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:12188:x1877759533885056:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.417476:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0d0bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3586e expref: 129 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417535:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a400/0xfa0c505d97f0d0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3586e expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417541:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3e:0x0].0x0 (ffff8bfc29009e00) 00010000:00010000:3.0:1790771166.417543:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.417545:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a400, rc 0) 00000100:00100000:3.0:1790771166.417572:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14199:x1877759533887360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 750us (977us total) trans 4294969313 rc 0/0 00000100:00100000:3.0:1790771166.417578:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6003 00000100:00100000:0.0:1790771166.417592:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08479c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:12188:x1877759533885056:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (194us total) trans 4294968710 rc 0/0 00000100:00100000:3.0:1790771166.417593:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880960 00000100:00100000:3.0:1790771166.417599:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880960 00000100:00100000:0.0:1790771166.417603:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1567 00000100:00100000:3.0:1790771166.417627:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6005 00000100:00100000:3.0:1790771166.417636:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14745:x1877759533880960:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771166.417643:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.417652:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0d0ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359e1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.417656:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 14680064 -> 14473 00002000:00010000:2.0:1790771166.417679:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.417683:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.417688:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00000100:00100000:0.0:1790771166.417689:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.417695:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1790771166.417696:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417707:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417714:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417726:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533884032:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 291us (1167us total) trans 4294967610 rc 0/0 00010000:00010000:3.0:1790771166.417729:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417735:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 411 00010000:00010000:3.0:1790771166.417741:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417743:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.417743:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/19 (14473->18446744073709551615) 00002000:00100000:2.0:1790771166.417751:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b1c00 with x1877759533884032 ext(14473->18446744073709551615) 00010000:00010000:3.0:1790771166.417755:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.417757:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb057b1c00. 00000100:00100000:0.0:1790771166.417779:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.417792:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885696 00010000:00010000:3.0:1790771166.417795:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417796:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885696 00010000:00010000:3.0:1790771166.417805:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.417811:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417827:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533880576 00000100:00100000:2.0:1790771166.417830:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533880576 00010000:00010000:1.0:1790771166.417831:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.417832:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 5134 00000004:00200000:3.0:1790771166.417838:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.417846:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.417847:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417848:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533886080 00000004:00010000:3.0:1790771166.417851:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417852:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533886080 00010000:00010000:1.0:1790771166.417863:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771166.417875:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000044ac98cc reply state 0000000065588d2f transno 4294968711 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417880:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6006 00010000:00010000:1.0:1790771166.417890:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.417892:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14896:x1877759533885696:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771166.417904:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.417907:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:1.0:1790771166.417912:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.417914:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.417915:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.417917:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa6:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.417927:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417928:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.417928:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417932:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417942:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533886464 00000100:00100000:0.0:1790771166.417948:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533886464 00010000:00010000:3.0:1790771166.417954:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417955:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417959:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 115 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417967:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533886592 00000100:00100000:0.0:1790771166.417971:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533886592 00010000:00010000:3.0:1790771166.417978:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.417979:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.417981:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 4/0,1 mode: --/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.417992:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1568 00010000:00010000:3.0:1790771166.417999:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418007:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14000:x1877759533886464:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.418008:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418010:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.418017:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418020:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 116 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418027:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.418033:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418037:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418052:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 116 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418056:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418059:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.418066:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.418073:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418080:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:2.0:1790771166.418080:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539748608:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.418081:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0d0f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418088:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.418094:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14000:x1877759533886464:12345-192.168.204.50@tcp:35:ls.0 Request processed in 88us (193us total) trans 4294969314 rc 0/0 00010000:00010000:1.0:1790771166.418095:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418112:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d0de lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418113:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1568 00010000:00010000:3.0:1790771166.418113:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418122:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cddcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.418132:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418136:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1569 00000004:00010000:1.0:1790771166.418137:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000044ac98cc reply state 0000000065588d2f transno 4294968711 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418142:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533884544 00010000:00010000:3.0:1790771166.418146:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418149:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533884544 00000100:00100000:0.0:1790771166.418150:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14432:x1877759533886592:12345-192.168.204.50@tcp:35:rm.0 00010000:00010000:1.0:1790771166.418160:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418169:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.418171:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03218b00) 00010000:00010000:1.0:1790771166.418175:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.418176:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.418177:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1790771166.418188:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533884800 00010000:00010000:3.0:1790771166.418189:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418195:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533884800 00010000:00010000:3.0:1790771166.418207:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xcdd6ff3 (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.418211:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.418216:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14522:x1877759533884416:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 984us (1047us total) trans 4294968711 rc 0/0 00010000:00010000:3.0:1790771166.418217:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418225:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 991 00000100:00100000:1.0:1790771166.418235:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6004 00010000:00010000:3.0:1790771166.418235:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0d0fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418236:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14432:x1877759533886592:12345-192.168.204.50@tcp:35:rm.0 Request processed in 87us (304us total) trans 4294969315 rc 0/0 00000100:00100000:2.0:1790771166.418245:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:14824:x1877759533884544:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:0.0:1790771166.418258:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1569 00000100:00100000:1.0:1790771166.418258:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6007 00010000:00010000:2.0:1790771166.418262:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.418273:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:12241:x1877759533880576:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.418276:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0d0ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418277:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a20 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418282:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.418295:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d11d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359d3 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418303:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418304:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.418310:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418318:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa:0x0].0x0 since=0s v=(4 8) 00010000:00010000:2.0:1790771166.418321:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(5 8) 00000100:00100000:0.0:1790771166.418322:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533886720 00000100:00100000:0.0:1790771166.418327:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533886720 00010000:00010000:2.0:1790771166.418329:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 29 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418333:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418344:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418349:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1570 00010000:00010000:2.0:1790771166.418354:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418356:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418364:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13269:x1877759533886720:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771166.418388:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 24 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418390:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:1.0:1790771166.418391:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418397:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.418402:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b000, rc 0) 00010000:00010000:1.0:1790771166.418413:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418414:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539748736:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.418428:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14745:x1877759533880960:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 791us (1063us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.418430:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418438:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6005 00000100:00100000:2.0:1790771166.418448:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd240 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.418459:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6008 00010000:00010000:1.0:1790771166.418465:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418471:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14320:x1877759533886080:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.418478:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418482:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.418511:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418518:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.418536:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.418539:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.418553:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418564:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885824 00000100:00100000:2.0:1790771166.418565:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.418567:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418570:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885824 00010000:00010000:1.0:1790771166.418582:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418586:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 131 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418602:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418615:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885952 00010000:00010000:1.0:1790771166.418618:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418618:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885952 00000100:00100000:2.0:1790771166.418629:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.418633:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 86 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418637:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.418643:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418650:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418659:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.418675:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.418678:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418687:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.418690:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d124 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418704:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418704:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1653 00010000:00010000:1.0:1790771166.418710:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418715:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2397:x1877759533885824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.418725:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418728:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.418734:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.418737:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 131 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418739:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418758:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.418775:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418777:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888512 00010000:00010000:3.0:1790771166.418780:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 131 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418783:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888512 00010000:00010000:1.0:1790771166.418788:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfb03218900) 00010000:00010000:1.0:1790771166.418793:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.418795:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418799:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d12b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418812:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881216 00000100:00100000:2.0:1790771166.418816:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881216 00010000:00010000:1.0:1790771166.418825:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d11d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359d3 expref: 118 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418842:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6009 00010000:00010000:1.0:1790771166.418843:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359d3 expref: 117 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.418846:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0cd57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357b1 expref: 131 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.418856:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+78:11823:x1877759533888512:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.418869:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.418873:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790771166.418876:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4000, rc 0) 00010000:00010000:2.0:1790771166.418878:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.418878:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.418883:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418888:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533886848 00010000:00010000:3.0:1790771166.418890:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418891:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d139 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a43 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.418894:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533886848 00000100:00100000:1.0:1790771166.418901:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1654 00010000:00010000:3.0:1790771166.418906:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.418917:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:2397:x1877759533885952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.418924:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1571 00010000:00010000:1.0:1790771166.418931:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.418934:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.418937:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13742:x1877759533886848:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.418940:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 86 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418942:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418960:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2397:x1877759533885824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 246us (442us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.418962:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 86 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.418963:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.418974:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1653 00010000:00010000:2.0:1790771166.418987:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.418996:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0b674 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351ad expref: 86 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419002:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.419004:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533885184 00010000:00010000:1.0:1790771166.419008:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000100:00100000:3.0:1790771166.419010:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533885184 00010000:00010000:2.0:1790771166.419011:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419015:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419016:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13742:x1877759533886848:12345-192.168.204.50@tcp:35:ls.0 Request processed in 80us (331us total) trans 4294969316 rc 0/0 00010000:00010000:2.0:1790771166.419031:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.419036:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 992 00000100:00100000:0.0:1790771166.419037:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1571 00010000:00010000:1.0:1790771166.419038:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.419050:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2399:x1877759533884800:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771166.419062:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.419063:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419071:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b653edf9/0xfa0c505d97f0d14e lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a27 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419092:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.419100:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.419100:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.419113:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0487b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539748864:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771166.419122:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:2397:x1877759533885952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 205us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.419134:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1654 00010000:00010000:2.0:1790771166.419136:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419144:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419151:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419159:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.419164:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.419166:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 993 00000100:00100000:3.0:1790771166.419170:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc0639bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.419180:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2399:x1877759533885184:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771166.419183:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419189:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.419190:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533884160 00000100:00100000:0.0:1790771166.419196:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.419199:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c8a/0xfa0c505d97f0d15c lrc: 2/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a2e expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419204:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.419210:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.419214:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419220:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d140 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419222:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888000 00000100:00100000:1.0:1790771166.419228:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539748992:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.419230:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888000 00000100:00100000:3.0:1790771166.419235:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533884160 00010000:00010000:2.0:1790771166.419237:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419247:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419256:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.419260:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc105a7540 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.419264:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.419270:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419275:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1572 00000100:00100000:3.0:1790771166.419277:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6010 00010000:00010000:1.0:1790771166.419283:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419287:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419295:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:13894:x1877759533888000:12345-192.168.204.50@tcp:35:rm.0 00000100:00100000:3.0:1790771166.419298:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14858:x1877759533881216:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1790771166.419309:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419311:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc4205de00) 00010000:00010000:2.0:1790771166.419317:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.419318:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.419322:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419330:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d163 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359e8 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419332:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d147 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419373:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d139 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a43 expref: 82 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419380:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.419382:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.419386:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d139 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a43 expref: 82 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419395:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:13894:x1877759533888000:12345-192.168.204.50@tcp:35:rm.0 Request processed in 107us (205us total) trans 4294968713 rc 0/0 00010000:00010000:2.0:1790771166.419396:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02800, rc 0) 00000100:00100000:0.0:1790771166.419405:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1572 00000100:00100000:2.0:1790771166.419421:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+80:11823:x1877759533888512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 569us (795us total) trans 4294968712 rc 301/301 00000100:00100000:2.0:1790771166.419429:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6009 00000100:00100000:2.0:1790771166.419450:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6011 00010000:00010000:3.0:1790771166.419454:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.419461:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14325:x1877759533884160:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:3.0:1790771166.419468:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419470:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.419471:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.419481:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419505:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d171 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a19 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419511:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419518:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419524:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419536:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771166.419543:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 88 off9936 00010000:00010000:2.0:1790771166.419549:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419566:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419581:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.419583:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419591:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.419595:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e3043c20 reply state 0000000065bbee3f transno 4294968714 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419597:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419603:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888256 00000100:00100000:0.0:1790771166.419609:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888256 00010000:00010000:3.0:1790771166.419621:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419622:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419642:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1573 00010000:00010000:3.0:1790771166.419643:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419644:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.419650:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419654:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.419656:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:12122:x1877759533888256:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.419675:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.419678:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419691:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419703:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.419708:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.419724:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14870:x1877759533878400:12345-192.168.204.50@tcp:36:chown.0 Request processed in 11957us (12107us total) trans 4294968714 rc 0/0 00000004:00010000:3.0:1790771166.419724:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.419725:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x85:0x0]: returning size 38336 00000004:00200000:2.0:1790771166.419732:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.419743:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5987 00010000:00010000:3.0:1790771166.419744:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.419748:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419755:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419759:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.419762:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533881856 00010000:00010000:3.0:1790771166.419763:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419765:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:12122:x1877759533888256:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (182us total) trans 4294968715 rc 0/0 00000100:00100000:1.0:1790771166.419769:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533881856 00010000:00010000:2.0:1790771166.419785:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419785:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.419786:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1573 00000100:00100000:1.0:1790771166.419798:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6012 00010000:00010000:3.0:1790771166.419804:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.419817:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14784:x1877759533881856:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.419821:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419822:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.419830:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419833:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419835:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.419847:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539746560:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.419850:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.419851:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0d19b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e359f6 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419856:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.419864:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419869:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419878:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419902:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.419904:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.419905:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.419907:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419910:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419911:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.419917:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419930:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419930:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d17f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419932:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d16a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419959:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419959:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419962:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419981:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419984:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.419993:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.419993:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.419994:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420016:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.420017:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.420018:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420025:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420026:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420028:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420048:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420052:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420056:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x7a94fdef (ffff8bfc1040f500) 00010000:00010000:3.0:1790771166.420062:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.420066:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420072:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc4205d300) 00010000:00010000:2.0:1790771166.420078:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.420079:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420079:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d178 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420084:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420104:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420105:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d186 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420119:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d163 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e8 expref: 124 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420127:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420142:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420142:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e8 expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420157:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d171 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a19 expref: 124 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420164:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420166:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:3.0:1790771166.420175:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.420182:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00010000:00010000:2.0:1790771166.420192:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a19 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420202:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771166.420204:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771166.420209:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14858:x1877759533881216:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 917us (1454us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.420210:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00000100:00100000:1.0:1790771166.420220:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12241:x1877759533880576:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1948us (2477us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.420225:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6010 00000100:00100000:1.0:1790771166.420235:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6007 00000100:00100000:2.0:1790771166.420242:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14325:x1877759533884160:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 781us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.420254:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6011 00010000:00010000:3.0:1790771166.420271:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420277:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420292:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420298:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420302:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06790000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539746688:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.420307:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420322:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [24576->36863] (req 24576->36863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b0 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.420338:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38600, rc 0) 00000100:00100000:2.0:1790771166.420357:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:14596:x1877759533879808:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 6267us (6600us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.420362:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 986 00000100:00100000:2.0:1790771166.420398:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06793100 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539746816:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.420447:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539748480 00000100:00100000:2.0:1790771166.420451:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539748480 00000100:00100000:2.0:1790771166.420522:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1790771166.420535:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539748480:12345-0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.420556:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13269:x1877759533886720:12345-192.168.204.50@tcp:37:ls.0 Request processed in 2196us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.420564:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1570 00000100:00100000:2.0:1790771166.420620:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539748480:12345-0@lo:1000:mdt00_017.0 Request processed in 89us (3352us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.420629:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa44000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539748480:0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.420630:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00010000:00010000:1.0:1790771166.420651:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d1be lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a3c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.420688:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749120:0@lo:1000:mdt00_017.0 00010000:00010000:1.0:1790771166.420701:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420710:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.420717:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.420723:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420736:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.420739:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.420743:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420751:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420758:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749120 00000100:00100000:2.0:1790771166.420763:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749120 00010000:00010000:3.0:1790771166.420778:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420787:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420791:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420794:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00010000:00010000:3.0:1790771166.420798:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420806:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539749120:12345-0@lo:1000:mdt00_017.0 00010000:00010000:1.0:1790771166.420810:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420821:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.420838:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.420840:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.420849:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420860:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420867:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.420871:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009d83d9ea reply state 00000000f1d45a47 transno 4294969317 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420872:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539749120:12345-0@lo:1000:mdt00_017.0 Request processed in 67us (155us total) trans 0 rc -2/-2 00010000:00010000:1.0:1790771166.420878:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.420890:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1790771166.420891:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749120:0@lo:1000:mdt00_017.0 00010000:00010000:3.0:1790771166.420898:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420899:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420915:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:1.0:1790771166.420916:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.420922:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420922:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.420926:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771166.420931:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.420932:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.420933:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420940:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420955:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.420957:0:13772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420957:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420960:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.420965:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420980:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.420984:0:13772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.420984:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d1c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.420987:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421008:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.421016:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.421017:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749248:0@lo:101:mdt00_017.0 00010000:00010000:3.0:1790771166.421017:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421037:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421037:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.421047:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.421056:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421058:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.421065:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.421067:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.421069:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.421070:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080300 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.421072:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421085:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ce37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421087:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.421087:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749248 00000100:00100000:2.0:1790771166.421093:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749248 00010000:00010000:1.0:1790771166.421110:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc3600d000) 00000004:00010000:3.0:1790771166.421111:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009d83d9ea reply state 00000000f1d45a47 transno 4294969317 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421115:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.421120:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421124:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.421125:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1790771166.421140:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13772:x1877759539749248:12345-0@lo:101:mdt00_017.0 00010000:00010000:1.0:1790771166.421141:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d1cc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.421143:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc1040fd00) 00010000:00010000:3.0:1790771166.421150:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.421155:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1790771166.421156:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.421172:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d1e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0d1e1 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421174:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d1be lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a3c expref: 132 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421198:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a3c expref: 131 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.421207:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d1e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0d1e1 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421208:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00000100:00100000:3.0:1790771166.421209:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14674:x1877759533874432:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 30166us (30278us total) trans 4294969317 rc 0/0 00010000:00010000:1.0:1790771166.421216:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790771166.421220:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594600, rc 0) 00000100:00100000:3.0:1790771166.421229:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5974 00010000:00010000:2.0:1790771166.421236:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d1e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0d1e1 expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.421248:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14320:x1877759533886080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 2780us (3468us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.421249:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:2.0:1790771166.421257:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.421263:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b200, rc 0) 00000100:00100000:1.0:1790771166.421264:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6008 00000100:00100000:2.0:1790771166.421302:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13772:x1877759539749248:12345-0@lo:101:mdt00_017.0 Request processed in 166us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.421308:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1790771166.421318:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749248:0@lo:101:mdt00_017.0 00010000:00010000:0.0:1790771166.421330:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.421339:0:13772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.421350:0:13772:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4:0x0] 00010000:00010000:0.0:1790771166.421377:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.421382:0:13772:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.421387:0:13772:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.421395:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749376:0@lo:101:mdt00_017.0 00000100:00100000:0.0:1790771166.421412:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.421428:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.421446:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749376 00000100:00100000:1.0:1790771166.421451:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749376 00000100:00100000:1.0:1790771166.421476:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1790771166.421481:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+8:13772:x1877759539749376:12345-0@lo:101:mdt00_017.0 00010000:00010000:1.0:1790771166.421512:0:13776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.421523:0:13776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0d1ef expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421538:0:13776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421550:0:13776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.421558:0:13776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd6e9df9d (ffff8bfc3600d100) 00010000:00010000:1.0:1790771166.421561:0:13776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.421563:0:13776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594000, rc 0) 00000100:00100000:1.0:1790771166.421603:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749376:12345-0@lo:101:mdt00_017.0 Request processed in 119us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.421609:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:0.0:1790771166.421612:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749376:0@lo:101:mdt00_017.0 00010000:00010000:0.0:1790771166.421623:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.421634:0:13772:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.421642:0:13772:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4:0x0] 00000100:00100000:0.0:1790771166.421658:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749504:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.421689:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.421704:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.421721:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749504 00000100:00100000:2.0:1790771166.421725:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749504 00000100:00100000:2.0:1790771166.421748:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1790771166.421753:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749504:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.421797:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749504:12345-0@lo:1000:mdt00_017.0 Request processed in 44us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.421803:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1790771166.421828:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa46d80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749504:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.421862:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749632:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.421908:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.421924:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.421935:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749632 00000100:00100000:2.0:1790771166.421940:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749632 00000100:00100000:2.0:1790771166.421960:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1790771166.421964:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749632:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.422065:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749632:12345-0@lo:1000:mdt00_017.0 Request processed in 98us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.422076:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1790771166.422095:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749632:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422139:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749760:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422157:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.422170:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.422182:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749760 00000100:00100000:2.0:1790771166.422188:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749760 00000100:00100000:2.0:1790771166.422216:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:2.0:1790771166.422227:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749760:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.422289:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749760:12345-0@lo:1000:mdt00_017.0 Request processed in 65us (129us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790771166.422296:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:0.0:1790771166.422299:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749760:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422354:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749888:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422382:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.422401:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.422414:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539749888 00000100:00100000:1.0:1790771166.422420:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539749888 00000100:00100000:1.0:1790771166.422447:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1790771166.422455:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749888:12345-0@lo:1000:mdt00_017.0 00000100:00100000:1.0:1790771166.422576:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539749888:12345-0@lo:1000:mdt00_017.0 Request processed in 120us (192us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790771166.422590:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539749888:0@lo:1000:mdt00_017.0 00000100:00100000:1.0:1790771166.422591:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:0.0:1790771166.422623:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750016:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422641:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.422655:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.422677:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539750016 00000100:00100000:2.0:1790771166.422683:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539750016 00000100:00100000:2.0:1790771166.422709:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1790771166.422715:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750016:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.422758:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750016:12345-0@lo:1000:mdt00_017.0 Request processed in 43us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.422764:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1790771166.422774:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d93480 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750016:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422799:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750144:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422816:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.422830:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.422834:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539750144 00000100:00100000:2.0:1790771166.422838:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539750144 00000100:00100000:2.0:1790771166.422859:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1790771166.422863:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750144:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.422904:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750144:12345-0@lo:1000:mdt00_017.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.422910:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1790771166.422926:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750144:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422949:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750272:0@lo:1000:mdt00_017.0 00000100:00100000:0.0:1790771166.422965:0:13772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.422980:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.422985:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539750272 00000100:00100000:2.0:1790771166.422988:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539750272 00000100:00100000:2.0:1790771166.423009:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1790771166.423015:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750272:12345-0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.423067:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:13772:x1877759539750272:12345-0@lo:1000:mdt00_017.0 Request processed in 50us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.423074:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193800 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001-mdtlov_UUID:13772:1877759539750272:0@lo:1000:mdt00_017.0 00000100:00100000:2.0:1790771166.423081:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000040:00080000:0.0:1790771166.423309:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].19, 968 off47688 00000040:00080000:0.0:1790771166.423337:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].19, 1120 off50528 00000004:00080000:0.0:1790771166.423341:0:13772:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfb06080300 with version 39 00000004:00080000:3.0:1790771166.423370:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 39 rpc_version 39 00000020:00100000:3.0:1790771166.423388:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790771166.423393:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb0487b100 x1877759539750528/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771166.423404:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0487b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539750528:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1790771166.423428:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.423444:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633480 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.423458:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539750528 00000100:00100000:1.0:1790771166.423463:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539750528 00000100:00100000:1.0:1790771166.423501:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1790771166.423508:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+9:7438:x1877759539750528:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1790771166.423729:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+10:7438:x1877759539750528:12345-0@lo:1000:osp_up0-1.0 Request processed in 221us (299us total) trans 4294969318 rc 0/0 00000100:00100000:1.0:1790771166.423736:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:3.0:1790771166.423764:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0487b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539750528:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1790771166.423805:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423813:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423820:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.423828:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000131406e3 reply state 000000002cc1d399 transno 4294968716 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423834:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423839:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0x0 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.423841:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.423843:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790771166.423845:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa5:0x0]: returning size 4096 00000004:00080000:0.0:1790771166.423849:0:13772:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4:0x0] 00010000:00010000:0.0:1790771166.423861:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423867:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423872:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423886:0:13772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1790771166.423890:0:13772:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000401:0x4:0x0] 00010000:00010000:0.0:1790771166.423893:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.423898:0:13772:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.423905:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.423912:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.423920:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4600 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:1.0:1790771166.423925:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.423932:0:6483:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.423937:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14520:x1877759533883520:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 7810us (7933us total) trans 4294968716 rc 0/0 00000100:00100000:0.0:1790771166.423948:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6001 00010000:00010000:1.0:1790771166.423961:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.423967:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790771166.423990:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.423996:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05ef4600/0xfa0c505d97f0d1e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0d1e8 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.424006:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539750656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.424016:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.424021:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.424023:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790771166.424046:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.424076:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539750656 00000100:00100000:1.0:1790771166.424080:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539750656 00000100:00100000:1.0:1790771166.424118:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1790771166.424129:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3626:x1877759539750656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.424138:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.424150:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d1e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0d1e1 expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.424163:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc4205dc00) 00010000:00010000:1.0:1790771166.424169:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.424207:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539750656:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.424216:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:3.0:1790771166.424230:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539750656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.428060:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.428112:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889152 00000100:00100000:2.0:1790771166.428118:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889152 00000100:00100000:2.0:1790771166.428150:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6013 00000100:00100000:2.0:1790771166.428160:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+86:14376:x1877759533889152:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1790771166.428172:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.428184:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d204 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a4a expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.428250:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.428302:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d204 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a4a expref: 88 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.428310:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.428312:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.428315:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d204 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a4a expref: 88 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.428322:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5000, rc 0) 00000100:00100000:2.0:1790771166.428351:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:14376:x1877759533889152:12345-192.168.204.50@tcp:101:cat.0 Request processed in 193us (293us total) trans 4294968717 rc 301/301 00000100:00100000:2.0:1790771166.428356:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6013 00000100:00100000:0.0:1790771166.428835:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06793b80 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539747072:192.168.204.50@tcp:104: 00002000:00010000:1.0:1790771166.428847:0:8408:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb atime: 0 -> 1790771160 00010000:00010000:0.0:1790771166.428858:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.428864:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06732300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539746944:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.428896:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5149f2e/0xfa0c505d97f0d060 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359c5 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.428914:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5149f2e/0xfa0c505d97f0d060 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359c5 expref: 26 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.428918:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06730e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539747456:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.428938:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00010000:00010000:0.0:1790771166.428949:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa7bc89a/0xfa0c505d97f0d075 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359da expref: 32 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.428958:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.428969:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539747200:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771166.428974:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7bc89a/0xfa0c505d97f0d075 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359da expref: 32 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.428982:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533880320:12345-192.168.204.50@tcp:101:chown.0 Request processed in 13963us (14078us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.428988:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00000100:00100000:1.0:1790771166.428992:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 987 00010000:00010000:3.0:1790771166.428997:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e239a23d/0xfa0c505d97f0d067 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a04 expref: 31 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429015:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e239a23d/0xfa0c505d97f0d067 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a04 expref: 31 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429020:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2397:x1877759533880832:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 13472us (13588us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.429027:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 990 00000100:00100000:1.0:1790771166.429034:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049eb480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0001_UUID:13785:1877759539748352:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.429043:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.429051:0:13785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429054:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888768 00000100:00100000:0.0:1790771166.429060:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888768 00000100:00100000:1.0:1790771166.429085:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539747968:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.429094:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1574 00010000:00010000:1.0:1790771166.429099:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429104:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11954:x1877759533888768:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.429120:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.429124:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2000, rc 0) 00000100:00100000:1.0:1790771166.429134:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891584 00000100:00100000:1.0:1790771166.429139:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891584 00000100:00100000:3.0:1790771166.429155:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759533882240:12345-192.168.204.50@tcp:101:ln.0 Request processed in 14111us (14220us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.429163:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.429177:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890048 00000100:00100000:1.0:1790771166.429182:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890048 00000100:00100000:2.0:1790771166.429194:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890432 00000100:00100000:2.0:1790771166.429202:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890432 00000100:00100000:3.0:1790771166.429208:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 988 00000100:00100000:0.0:1790771166.429209:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:11954:x1877759533888768:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (251us total) trans 4294969319 rc 0/0 00000100:00100000:1.0:1790771166.429213:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6014 00000100:00100000:0.0:1790771166.429223:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1574 00000100:00100000:1.0:1790771166.429229:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13998:x1877759533891584:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.429239:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.429248:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d212 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a0b expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.429249:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6015 00000100:00100000:2.0:1790771166.429267:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13261:x1877759533890048:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.429271:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.429283:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.429286:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429291:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890560 00010000:00010000:2.0:1790771166.429295:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d220 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a51 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.429296:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6016 00000100:00100000:0.0:1790771166.429297:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890560 00010000:00010000:1.0:1790771166.429309:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.429311:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14555:x1877759533890432:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771166.429323:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1575 00010000:00010000:1.0:1790771166.429331:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429335:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14608:x1877759533890560:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:3.0:1790771166.429339:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.429343:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.429355:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429358:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0945b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34520 expref: 133 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429361:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.429365:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429386:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429389:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:3.0:1790771166.429396:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.429400:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429411:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429423:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 123 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429424:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14608:x1877759533890560:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 91us (153us total) trans 4294969320 rc 0/0 00000100:00100000:0.0:1790771166.429443:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1575 00000100:00100000:2.0:1790771166.429444:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.429449:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 133 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.429454:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.429458:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429463:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890816 00010000:00010000:3.0:1790771166.429464:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 6/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429467:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890816 00010000:00010000:3.0:1790771166.429513:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.429519:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.429522:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429530:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1576 00010000:00010000:3.0:1790771166.429532:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 132 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429541:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429545:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+87:11696:x1877759533890816:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1790771166.429548:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04879500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539750784:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.429559:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429566:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429571:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.429575:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429580:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429594:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:1.0:1790771166.429597:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.429600:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429606:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d219 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.429613:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.429617:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.429619:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429628:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429635:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429640:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:11696:x1877759533890816:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 98us (199us total) trans 4294968718 rc 0/0 00010000:00010000:1.0:1790771166.429645:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.429649:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429650:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1576 00010000:00010000:1.0:1790771166.429658:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429685:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfc3600d000) 00010000:00010000:1.0:1790771166.429688:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.429688:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429693:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429711:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d22e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.429721:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0487a300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539750912:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.429751:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888640 00000100:00100000:1.0:1790771166.429756:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888640 00000100:00100000:2.0:1790771166.429761:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539747584:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.429776:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 133 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.429777:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539747712:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.429795:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539748096:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.429808:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889280 00010000:00010000:0.0:1790771166.429813:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d212 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a0b expref: 124 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.429813:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889280 00010000:00010000:2.0:1790771166.429817:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429827:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.429836:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:0.0:1790771166.429841:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.429846:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d212 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a0b expref: 125 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.429854:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1655 00010000:00010000:0.0:1790771166.429857:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594800, rc 0) 00000100:00100000:1.0:1790771166.429864:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533888640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.429867:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 124 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429874:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.429876:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.429885:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 133 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429887:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13998:x1877759533891584:12345-192.168.204.50@tcp:101:ls.0 Request processed in 662us (846us total) trans 4294969321 rc 301/301 00010000:00010000:3.0:1790771166.429891:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 124 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429904:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6014 00010000:00010000:1.0:1790771166.429915:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 133 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429929:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0bf65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35400 expref: 133 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429942:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771166.429949:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.429950:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.429959:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429964:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889536 00010000:00010000:1.0:1790771166.429966:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.429970:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889536 00010000:00010000:1.0:1790771166.429974:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.429976:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0487b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539751040:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.429981:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.429988:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 124 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.429990:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430008:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.430017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.430024:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.430026:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889792 00000100:00100000:0.0:1790771166.430029:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889792 00010000:00010000:1.0:1790771166.430034:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.430043:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 133 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.430044:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891072 00000100:00100000:3.0:1790771166.430048:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890304 00000100:00100000:2.0:1790771166.430052:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891072 00000100:00100000:3.0:1790771166.430055:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890304 00000100:00100000:1.0:1790771166.430062:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2397:x1877759533888640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 198us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.430068:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1655 00000100:00100000:0.0:1790771166.430083:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1656 00010000:00010000:3.0:1790771166.430083:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 125 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.430093:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1657 00000100:00100000:0.0:1790771166.430098:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2397:x1877759533889280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.430104:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6017 00010000:00010000:0.0:1790771166.430110:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.430111:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2397:x1877759533889536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.430122:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:13263:x1877759533891072:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.430123:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430123:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.430123:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1658 00010000:00010000:1.0:1790771166.430134:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 125 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430140:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.430141:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533889792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.430146:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430152:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a58 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430158:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.430163:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 125 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430169:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 133 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430180:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0ce7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35963 expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430199:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 134 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430200:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:1.0:1790771166.430200:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0cf4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a9 expref: 124 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430209:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430222:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430231:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0c58c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355a4 expref: 134 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430232:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430255:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:0.0:1790771166.430256:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.430256:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430265:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430275:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430277:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:0.0:1790771166.430280:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2397:x1877759533889280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (668us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.430284:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430298:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.430299:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1656 00010000:00010000:3.0:1790771166.430302:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430309:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430314:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430319:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1659 00010000:00010000:3.0:1790771166.430323:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430333:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2397:x1877759533890304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.430336:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2397:x1877759533889536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 224us (455us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.430336:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430348:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.430356:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430358:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 122 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.430360:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1657 00010000:00010000:3.0:1790771166.430363:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.430383:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 121 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.430389:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533889792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 251us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.430398:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1658 00010000:00010000:0.0:1790771166.430403:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0a342 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a83 expref: 121 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430414:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430417:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:0.0:1790771166.430428:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430428:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430430:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.430440:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.430453:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430455:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430464:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430469:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.430472:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430478:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430482:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.430519:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.430526:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430537:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533890304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 205us (557us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.430539:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430547:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430558:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1659 00010000:00010000:1.0:1790771166.430562:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.430563:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430570:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771166.430574:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430579:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533888896 00010000:00010000:1.0:1790771166.430581:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430584:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430585:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533888896 00010000:00010000:1.0:1790771166.430588:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430599:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.430603:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430609:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430612:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 23 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430613:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 2/0,0 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430620:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.430628:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.430631:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0cfdb lrc: 0/0,0 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430633:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430636:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430653:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430656:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889408 00000100:00100000:0.0:1790771166.430675:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889408 00010000:00010000:0.0:1790771166.430692:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 134 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.430697:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00000004:00200000:2.0:1790771166.430703:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.430704:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14145:x1877759533879552:12345-192.168.204.50@tcp:55:truncate.0 Request processed in 17291us (17357us total) trans 0 rc -22/-22 00010000:00010000:3.0:1790771166.430713:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.430715:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1660 00000004:00010000:2.0:1790771166.430718:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.430722:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5992 00000100:00100000:0.0:1790771166.430730:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533888896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.430736:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430742:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430744:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.430751:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.430754:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1661 00010000:00010000:2.0:1790771166.430758:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430759:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 23 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.430772:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759533889408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.430775:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430782:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430788:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.430794:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 23 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430799:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430801:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430803:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430826:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00030200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.430827:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430832:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000098e6d55/0xfa0c505d97f0c14f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e354af expref: 23 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430833:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430844:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430857:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430868:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(2 1) 00010000:00010000:0.0:1790771166.430874:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(2 1) 00010000:00010000:2.0:1790771166.430875:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.430879:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372800/0xfa0c505d97f07cad lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33d24 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430882:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.430887:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430889:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b0 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430896:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771166.430903:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d013 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430906:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430920:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430925:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b0 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430928:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430932:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.430941:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430951:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430957:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430973:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.430980:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.430984:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.430986:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008c5adbd7/0xfa0c505d97f0d021 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->36863) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b0 expref: 24 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.430989:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.430992:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.431008:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2397:x1877759533889408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 240us (490us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.431008:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc13395500) 00010000:00010000:2.0:1790771166.431016:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.431020:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.431029:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1661 00010000:00010000:3.0:1790771166.431030:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431040:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06190380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539751168:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.431043:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d028 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431046:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d083 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431053:0:13773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431068:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431085:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080e40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.431099:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0cffe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b7 expref: 120 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431112:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b7 expref: 120 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431118:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.431121:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.431124:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431125:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5c00, rc 0) 00000100:00100000:0.0:1790771166.431128:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.431142:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431142:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14905:x1877759533883008:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 15048us (15185us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771166.431155:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431156:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6000 00000100:00100000:2.0:1790771166.431159:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14676:x1877759533880064:12345-192.168.204.50@tcp:101:ln.0 Request processed in 17175us (17285us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.431171:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc029cbc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.431177:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431178:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892096 00000100:00100000:2.0:1790771166.431184:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5994 00000100:00100000:3.0:1790771166.431185:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892096 00010000:00010000:1.0:1790771166.431188:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431198:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00000100:00100000:0.0:1790771166.431200:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.431202:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.431207:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431212:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d059 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.431221:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6018 00000100:00100000:2.0:1790771166.431236:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:14522:x1877759533892096:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:3.0:1790771166.431241:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533889664 00000100:00100000:3.0:1790771166.431245:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533889664 00010000:00010000:2.0:1790771166.431248:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.431253:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14817:x1877759533881728:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 16341us (16437us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.431262:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5998 00010000:00010000:3.0:1790771166.431262:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 131 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431264:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d251 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a66 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431279:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.431294:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431302:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890176 00010000:00010000:1.0:1790771166.431305:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431306:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890176 00010000:00010000:2.0:1790771166.431315:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431325:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.431331:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1662 00010000:00010000:2.0:1790771166.431334:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431340:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2397:x1877759533889664:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00200000:1.0:1790771166.431345:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.431348:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.431353:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.431360:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.431365:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771166.431368:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431371:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 131 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431374:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431383:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891200 00010000:00010000:1.0:1790771166.431388:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431390:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891200 00010000:00010000:2.0:1790771166.431399:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431401:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431402:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 131 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.431415:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (524288->528383) req@ffff8bfb03d93480 x1877759533891200/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.431419:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431427:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431438:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0c6ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c7 expref: 131 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431449:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aa600 already unused, calling callback (ffffffffc18aa4f0) 00002000:00100000:0.0:1790771166.431453:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d93480 with x1877759533891200 ext(524288->528383) 00010000:00010000:1.0:1790771166.431456:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.431463:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d93480 00010000:00010000:1.0:1790771166.431465:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431467:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:3.0:1790771166.431474:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431481:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:0.0:1790771166.431501:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 412 00010000:00010000:3.0:1790771166.431509:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.431511:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa6:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.431513:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533891200:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.431514:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.431521:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431531:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431533:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0d1a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431556:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431556:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.431561:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431576:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2397:x1877759533889664:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 235us (379us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.431583:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431589:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431595:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1662 00010000:00010000:2.0:1790771166.431596:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431608:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431611:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c39a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.431612:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533890944 00000100:00100000:3.0:1790771166.431619:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533890944 00010000:00010000:1.0:1790771166.431621:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3ab400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.431621:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431625:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533891200:12345-192.168.204.50@tcp:3:cat.0 Request processed in 113us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.431629:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431642:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 802 00010000:00010000:2.0:1790771166.431645:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431648:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 412 00010000:00010000:1.0:1790771166.431654:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431656:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533890176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1790771166.431673:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (524288->528383) req@ffff8bfb03d93480 x1877759533891200/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.431683:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.431692:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.431693:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfc3600d400) 00010000:00010000:2.0:1790771166.431698:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431700:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1790771166.431704:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d93480 with x1877759533891200 ext(524288->528383) 00010000:00010000:1.0:1790771166.431704:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:0.0:1790771166.431713:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d93480 00010000:00010000:1.0:1790771166.431713:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431714:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d258 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431718:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d03d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359be expref: 120 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431741:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431742:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0d1a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.431748:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:3.0:1790771166.431758:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.431762:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431768:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431773:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.431776:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431784:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431791:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0d19b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.431792:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.431792:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759533890176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (512us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.431806:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03218b00) 00010000:00010000:2.0:1790771166.431812:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.431817:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431822:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0d25f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431824:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 119 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431836:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.431839:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.431842:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00010000:00010000:2.0:1790771166.431854:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d251 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a66 expref: 90 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.431861:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 802 00010000:00010000:2.0:1790771166.431863:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.431868:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771166.431869:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14784:x1877759533881856:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 12055us (12397us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.431875:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d251 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a66 expref: 90 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.431882:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6012 00010000:00010000:2.0:1790771166.431888:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00000100:00100000:3.0:1790771166.431888:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 803 00000100:00100000:1.0:1790771166.431913:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891328 00000100:00100000:1.0:1790771166.431917:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891328 00000100:00100000:2.0:1790771166.431928:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14522:x1877759533892096:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 697us (803us total) trans 4294968719 rc 301/301 00000100:00100000:3.0:1790771166.431936:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759533890944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.431942:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6018 00000100:00100000:1.0:1790771166.431947:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 994 00010000:00010000:3.0:1790771166.431953:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.431958:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533891328:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.431966:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.431969:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0d00c lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359ef expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.431977:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041a7879e/0xfa0c505d97f0d26d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a5f expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.431997:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.432005:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539751296:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.432005:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.432032:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.432033:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00000004:00200000:2.0:1790771166.432037:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.432038:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:2.0:1790771166.432054:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.432065:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b300 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.432082:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 130 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.432096:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.432103:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.432104:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.432105:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759533890944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 205us (783us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.432111:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.432116:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83c00, rc 0) 00000100:00100000:3.0:1790771166.432123:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 803 00010000:00010000:1.0:1790771166.432124:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.432157:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13263:x1877759533891072:12345-192.168.204.50@tcp:101:ls.0 Request processed in 2040us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.432166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6017 00010000:00010000:1.0:1790771166.432182:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.432188:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.432194:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.432194:0:13787:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb atime: 0 -> 1790771159 00010000:00010000:2.0:1790771166.432199:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.432206:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.432207:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539747328:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.432213:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.432215:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.432233:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.432242:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:1.0:1790771166.432244:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.432247:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.432248:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.432254:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0d07c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1f:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.432255:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.432265:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047331246/0xfa0c505d97f0d06e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359fd expref: 24 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.432271:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.432298:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047331246/0xfa0c505d97f0d06e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359fd expref: 24 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.432306:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14898:x1877759533882624:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 16363us (16449us total) trans 0 rc -61/-61 00010000:00010000:2.0:1790771166.432307:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d220 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a51 expref: 130 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.432312:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2200, rc 0) 00000100:00100000:1.0:1790771166.432328:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 5999 00010000:00010000:2.0:1790771166.432333:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a51 expref: 129 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.432341:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:3.0:1790771166.432342:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533881984:12345-192.168.204.50@tcp:101:cat.0 Request processed in 16977us (17046us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.432347:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.432352:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02800, rc 0) 00000100:00100000:3.0:1790771166.432356:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 989 00000100:00100000:2.0:1790771166.432385:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13261:x1877759533890048:12345-192.168.204.50@tcp:101:ls.0 Request processed in 3124us (3267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.432391:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6015 00000100:00100000:0.0:1790771166.433000:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.433040:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533893120 00000100:00100000:2.0:1790771166.433046:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533893120 00000100:00100000:2.0:1790771166.433077:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6019 00000100:00100000:2.0:1790771166.433085:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:12120:x1877759533893120:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.433092:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.433099:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0d274 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a6d expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433127:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433134:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433139:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433148:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433156:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433163:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.433209:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.433245:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433254:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 4/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433263:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433270:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433276:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.433279:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433284:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 5/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433291:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.433293:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.433296:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 3/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433304:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0d27b lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.433313:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.433318:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433323:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433329:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433333:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.433336:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.433344:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.433347:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.433354:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891456 00010000:00010000:2.0:1790771166.433355:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0xf7a5b27a (ffff8bfc4205d300) 00010000:00010000:2.0:1790771166.433359:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.433361:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891456 00010000:00010000:2.0:1790771166.433362:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433368:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0d282 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.433390:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533891840 00000100:00100000:3.0:1790771166.433395:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533891840 00000100:00100000:0.0:1790771166.433400:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.433407:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1577 00000100:00100000:2.0:1790771166.433421:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539748736:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.433422:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14096:x1877759533891456:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:3.0:1790771166.433433:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 995 00000100:00100000:3.0:1790771166.433443:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533891840:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:2.0:1790771166.433446:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 5 type: EXT [24576->40959] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 28 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433462:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02600, rc 0) 00000100:00100000:0.0:1790771166.433521:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.433528:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:14824:x1877759533884544:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 15286us (16194us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.433538:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 991 00002000:00010000:3.0:1790771166.433551:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13255 -> 13255 00002000:00010000:3.0:1790771166.433555:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.433558:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.433560:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.433562:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:2.0:1790771166.433585:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539748608:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.433593:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533891840:12345-192.168.204.50@tcp:2:chown.0 Request processed in 152us (252us total) trans 4294967611 rc 0/0 00000100:00100000:3.0:1790771166.433600:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 995 00010000:00010000:2.0:1790771166.433604:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.433620:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14096:x1877759533891456:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 202us (307us total) trans 4294969322 rc 0/0 00000100:00100000:1.0:1790771166.433628:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1577 00000100:00100000:2.0:1790771166.433631:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892352 00000100:00100000:2.0:1790771166.433637:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892352 00002000:00010000:1.0:1790771166.433682:0:13788:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size: 47456 -> 76520 00000100:00100000:2.0:1790771166.433683:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892480 00002000:00010000:1.0:1790771166.433689:0:13788:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime: 1790771164 -> 1790771166 00000100:00100000:2.0:1790771166.433689:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892480 00002000:00010000:1.0:1790771166.433697:0:13788:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime: 0 -> 1790771160 00000100:00100000:0.0:1790771166.433700:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:1.0:1790771166.433702:0:13788:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime: 1790771165 -> 1790771166 00000100:00100000:1.0:1790771166.433713:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539748992:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.433723:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6020 00000100:00100000:0.0:1790771166.433727:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892736 00000100:00100000:0.0:1790771166.433732:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892736 00000100:00100000:2.0:1790771166.433733:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14763:x1877759533892352:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:1.0:1790771166.433740:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c8a/0xfa0c505d97f0d15c lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a2e expref: 27 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433755:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.433756:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffc12c8a/0xfa0c505d97f0d15c lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a2e expref: 27 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.433763:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1578 00010000:00010000:2.0:1790771166.433772:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0ccbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35901 expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.433777:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5000, rc 0) 00000100:00100000:3.0:1790771166.433777:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0487b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539748864:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.433780:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+85:11823:x1877759533892736:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.433799:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:2.0:1790771166.433803:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.433807:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759533885184:12345-192.168.204.50@tcp:101:ln.0 Request processed in 14629us (15932us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771166.433813:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b653edf9/0xfa0c505d97f0d14e lrc: 1/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a27 expref: 26 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.433819:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 993 00010000:00010000:2.0:1790771166.433832:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433841:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.433843:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b653edf9/0xfa0c505d97f0d14e lrc: 0/0,0 mode: --/PR res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a27 expref: 25 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433854:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.433863:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a200, rc 0) 00000100:00100000:0.0:1790771166.433874:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:11823:x1877759533892736:12345-192.168.204.50@tcp:35:ls.0 Request processed in 99us (178us total) trans 4294968721 rc 0/0 00000100:00100000:0.0:1790771166.433882:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1578 00000100:00100000:1.0:1790771166.433883:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.433899:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759533884800:12345-192.168.204.50@tcp:101:ln.0 Request processed in 14850us (16053us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.433907:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 992 00000100:00100000:0.0:1790771166.433912:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892864 00000004:00010000:2.0:1790771166.433914:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ea5df27 reply state 00000000f15ec466 transno 4294969323 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.433916:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892864 00000100:00100000:1.0:1790771166.433922:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.433930:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.433936:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:2.0:1790771166.433938:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.433940:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.433953:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.433957:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6021 00000100:00100000:3.0:1790771166.433971:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6022 00000100:00100000:0.0:1790771166.433972:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:10887:x1877759533892480:12345-192.168.204.50@tcp:36:dir_create.sh.0 00000100:00100000:2.0:1790771166.433985:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14763:x1877759533892352:12345-192.168.204.50@tcp:36:cp.0 Request processed in 253us (586us total) trans 4294969323 rc 0/0 00000100:00100000:3.0:1790771166.433986:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13723:x1877759533892864:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:0.0:1790771166.433994:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.433996:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.434002:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6020 00010000:00010000:0.0:1790771166.434011:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0cef4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3597f expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434019:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.434025:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00000100:00100000:1.0:1790771166.434030:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.434030:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533893376 00010000:00010000:0.0:1790771166.434032:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.434037:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0c40b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35565 expref: 128 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434038:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533893376 00000100:00100000:1.0:1790771166.434052:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533894272 00010000:00010000:3.0:1790771166.434053:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00000100:00100000:1.0:1790771166.434058:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533894272 00010000:00010000:3.0:1790771166.434058:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.434072:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434081:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 996 00010000:00010000:3.0:1790771166.434082:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434092:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434098:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759533893376:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:1.0:1790771166.434099:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6023 00000100:00100000:1.0:1790771166.434116:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:11954:x1877759533894272:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.434117:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434117:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434128:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.434141:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d2ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a82 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434144:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434145:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434168:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434169:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 4/0,1 mode: --/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434181:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434185:0:13781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 3407872 -> 131072 00010000:00010000:3.0:1790771166.434193:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,1 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434194:0:13781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1790771166 -> 1790771165 00010000:00010000:1.0:1790771166.434198:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434203:0:13781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:0.0:1790771166.434204:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434211:0:13781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:3.0:1790771166.434212:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434221:0:13781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 256 -> 256 00010000:00010000:1.0:1790771166.434225:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434235:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 127 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434237:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.434253:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.434259:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.434259:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2399:x1877759533893376:12345-192.168.204.50@tcp:2:chown.0 Request processed in 165us (337us total) trans 4294967616 rc 0/0 00000100:00100000:0.0:1790771166.434260:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539751424:192.168.204.50@tcp:104: 00000004:00010000:1.0:1790771166.434274:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434277:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 996 00010000:00010000:3.0:1790771166.434283:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434290:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434295:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434301:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.434303:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d2ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434306:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434308:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533892224 00000100:00100000:0.0:1790771166.434310:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.434315:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533892224 00010000:00010000:3.0:1790771166.434325:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.434330:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533893632 00000100:00100000:0.0:1790771166.434335:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533893632 00010000:00010000:3.0:1790771166.434336:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00002000:00100000:2.0:1790771166.434338:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa:0x0] (45056->76519) req@ffff8bfb0562ed80 x1877759533892224/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.434341:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434342:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.434347:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 2/0,0 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434354:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 121 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434370:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d2ba lrc: 0/0,0 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.434373:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562ed80 with x1877759533892224 ext(45056->76519) 00010000:00010000:1.0:1790771166.434374:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.434384:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.434387:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 28 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434389:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5000, rc 0) 00010000:00010000:3.0:1790771166.434392:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.434401:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1663 00010000:00010000:3.0:1790771166.434412:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.434415:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 28 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.434418:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533893632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.434419:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11954:x1877759533894272:12345-192.168.204.50@tcp:101:ls.0 Request processed in 305us (391us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.434434:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.434437:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.434443:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6023 00010000:00010000:0.0:1790771166.434444:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 121 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.434444:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb0562ed80 00010000:00010000:3.0:1790771166.434454:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434462:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.434463:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 120 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434467:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434474:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 95 00010000:00010000:0.0:1790771166.434481:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0a182 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349cd expref: 120 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434517:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:3.0:1790771166.434518:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.434519:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533892224:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:0.0:1790771166.434525:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.434530:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.434542:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434542:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.434549:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.434555:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434556:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.434557:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533894400 00000100:00100000:1.0:1790771166.434564:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533894400 00010000:00010000:3.0:1790771166.434574:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d297 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.434586:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.434588:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434594:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434600:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.434607:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6024 00000100:00100000:0.0:1790771166.434608:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2396:x1877759533893632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 191us (613us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.434609:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.434616:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.434620:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1663 00000100:00100000:1.0:1790771166.434626:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14376:x1877759533894400:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771166.434629:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434640:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc1040f500) 00010000:00010000:1.0:1790771166.434641:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.434643:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.434645:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434647:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434654:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0d2c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a89 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.434680:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434683:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d2a5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434711:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434720:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434727:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.434731:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13723:x1877759533892864:12345-192.168.204.50@tcp:36:ln.0 Request processed in 748us (849us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771166.434742:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6022 00000004:00200000:1.0:1790771166.434750:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.434754:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.434764:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.434766:0:13770:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969325 00010000:00010000:1.0:1790771166.434784:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0d2c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 91 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.434790:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000029f3356e reply state 000000001fb7110e transno 4294969326 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.434799:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.434800:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 90 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.434807:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0d274 lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a6d expref: 85 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.434816:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:2.0:1790771166.434824:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.434828:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771166.434829:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.434835:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.434840:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4600, rc 0) 00010000:00010000:3.0:1790771166.434850:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.434856:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771166.434857:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14896:x1877759533885696:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 16965us (17168us total) trans 4294969326 rc 0/0 00010000:00010000:3.0:1790771166.434867:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0d274 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a6d expref: 85 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.434868:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:14376:x1877759533894400:12345-192.168.204.50@tcp:101:cat.0 Request processed in 244us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.434872:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6006 00000020:00080000:2.0:1790771166.434878:0:13770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790771166.434886:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6024 00010000:00010000:3.0:1790771166.434893:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8800, rc 0) 00000100:00100000:3.0:1790771166.434916:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:12120:x1877759533893120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1831us (1916us total) trans 4294968720 rc 301/301 00000100:00100000:3.0:1790771166.434922:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6019 00000100:00100000:1.0:1790771166.434932:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.434957:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.434967:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533894656 00000100:00100000:0.0:1790771166.434972:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533894656 00000100:00100000:0.0:1790771166.434984:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533894016 00000100:00100000:0.0:1790771166.434986:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533894016 00000100:00100000:0.0:1790771166.435016:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 804 00000100:00100000:0.0:1790771166.435024:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2396:x1877759533894016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.435030:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.435036:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.435043:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d1da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a3c expref: 129 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.435054:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:0.0:1790771166.435057:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.435065:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533894912 00000100:00100000:2.0:1790771166.435072:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533894912 00000100:00100000:0.0:1790771166.435077:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759533894016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.435084:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 804 00000100:00100000:1.0:1790771166.435094:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6025 00000100:00100000:1.0:1790771166.435106:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14410:x1877759533894656:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:2.0:1790771166.435120:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6026 00010000:00010000:1.0:1790771166.435128:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.435130:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:14277:x1877759533894912:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:2.0:1790771166.435141:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.435145:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0cd34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35924 expref: 119 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435153:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d2cf lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a90 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.435158:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:1.0:1790771166.435165:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.435185:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.435193:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.435201:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435202:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435218:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435228:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435246:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435255:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435264:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435308:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0d2eb lrc: 3/1,0 mode: --/PR res: [0x240000403:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435318:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0d2eb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435324:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0d2eb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.435332:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x14:0x0]: returning size 2 00000004:00010000:2.0:1790771166.435341:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0d2eb lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435347:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435352:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 2/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435357:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435361:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.435363:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435367:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 4/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435374:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.435376:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.435378:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435382:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d2dd lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435390:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435395:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435400:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435403:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05e85800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.435406:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435410:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771166.435412:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].40, 88 off11352 00010000:00010000:2.0:1790771166.435415:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x9537b590 (ffff8bfc4205de00) 00010000:00010000:2.0:1790771166.435418:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.435420:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435424:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d2e4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435443:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d2cf lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a90 expref: 92 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.435448:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bce71338 reply state 000000003556a12e transno 4294969327 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435452:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85400/0xfa0c505d97f0d2eb lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x14:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a90 expref: 91 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.435466:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.435472:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x14:0x0].0x0 (ffff8bfc4205dd00) 00010000:00010000:2.0:1790771166.435477:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.435481:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:2.0:1790771166.435481:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85400, rc 0) 00010000:00010000:1.0:1790771166.435510:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.435513:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.435531:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14277:x1877759533894912:12345-192.168.204.50@tcp:101:touch.0 Request processed in 403us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.435541:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6026 00000100:00100000:1.0:1790771166.435566:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14410:x1877759533894656:12345-192.168.204.50@tcp:36:chown.0 Request processed in 460us (632us total) trans 4294969327 rc 0/0 00000100:00100000:1.0:1790771166.435580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6025 00000100:00100000:1.0:1790771166.435971:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.436005:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895040 00000100:00100000:2.0:1790771166.436009:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895040 00000100:00100000:2.0:1790771166.436037:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6027 00000100:00100000:2.0:1790771166.436045:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:11864:x1877759533895040:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.436055:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.436064:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0d2f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a97 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436094:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436101:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436106:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.436121:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.436123:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.436130:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436145:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0d2f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a97 expref: 122 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436157:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a97 expref: 121 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436164:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.436167:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.436169:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84400, rc 0) 00000100:00100000:2.0:1790771166.436203:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11864:x1877759533895040:12345-192.168.204.50@tcp:101:ls.0 Request processed in 158us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.436209:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6027 00000100:00100000:3.0:1790771166.436684:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.436716:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895168 00000100:00100000:1.0:1790771166.436720:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895168 00000100:00100000:1.0:1790771166.436748:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6028 00000100:00100000:3.0:1790771166.436758:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.436759:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11011:x1877759533895168:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1790771166.436769:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.436779:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d300 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a9e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.436788:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895296 00000100:00100000:2.0:1790771166.436793:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895296 00000100:00100000:3.0:1790771166.436800:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.436809:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.436817:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.436823:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.436830:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895424 00010000:00010000:1.0:1790771166.436833:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.436834:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895424 00000100:00100000:0.0:1790771166.436843:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6029 00010000:00010000:1.0:1790771166.436847:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.436854:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.436856:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:11804:x1877759533895296:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.436866:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6030 00000100:00100000:3.0:1790771166.436867:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04879500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539750784:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.436869:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.436880:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12240:x1877759533895424:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.436882:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d315 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35aa5 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436889:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.436894:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436903:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d31c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35aac expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.436913:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d355500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539751552:0@lo:104: 00010000:00010000:0.0:1790771166.436914:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.436925:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.436931:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436937:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436946:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.436949:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.436954:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:0.0:1790771166.436956:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.436968:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.436969:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.436986:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.436990:0:7433:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1790771166.436999:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d315 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aa5 expref: 127 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.437000:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.437001:0:7433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539751552 00000004:00200000:2.0:1790771166.437008:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.437008:0:7433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539751552 00010000:00010000:0.0:1790771166.437022:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aa5 expref: 126 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.437023:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437042:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:3.0:1790771166.437046:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00010000:00010000:0.0:1790771166.437048:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.437052:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fc00, rc 0) 00010000:00010000:2.0:1790771166.437070:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d31c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aac expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437083:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11804:x1877759533895296:12345-192.168.204.50@tcp:101:ls.0 Request processed in 231us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.437092:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6029 00010000:00010000:2.0:1790771166.437093:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aac expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437101:0:7433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1877759539751552:12345-0@lo:104: 00010000:00010000:2.0:1790771166.437102:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.437109:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.437113:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00010000:00010000:3.0:1790771166.437117:0:7433:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437138:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:12240:x1877759533895424:12345-192.168.204.50@tcp:101:ls.0 Request processed in 262us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.437144:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6030 00000100:00100000:1.0:1790771166.437174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.437201:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896320 00000100:00100000:2.0:1790771166.437207:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896320 00000100:00100000:1.0:1790771166.437227:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d355500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539751552:0@lo:104: 00010000:00010000:2.0:1790771166.437227:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 128 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437242:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437268:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1664 00000100:00100000:1.0:1790771166.437275:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.437282:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759533896320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.437289:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896192 00000100:00100000:0.0:1790771166.437294:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896192 00010000:00010000:2.0:1790771166.437294:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.437302:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 128 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437312:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 128 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437315:0:7433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1790771166.437316:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 91 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437328:0:7433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6495:x1877759539751552:12345-0@lo:104: Request processed in 270us (376us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.437341:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0c8f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35676 expref: 128 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437348:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790771166.437352:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.437363:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1665 00010000:00010000:2.0:1790771166.437364:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.437369:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437376:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:2396:x1877759533896192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.437379:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437385:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.437386:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.437393:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 91 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437404:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 91 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437405:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771166.437414:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437418:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2396:x1877759533896320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 139us (244us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.437422:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0bb9f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3525c expref: 91 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437433:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18b6ee0) 00000100:00100000:2.0:1790771166.437438:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1664 00010000:00010000:3.0:1790771166.437441:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437442:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:0.0:1790771166.437450:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.437454:0:7903:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437458:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437468:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437476:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437499:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.437513:0:13785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437521:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437529:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:2396:x1877759533896192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 156us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.437536:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1665 00010000:00010000:3.0:1790771166.437575:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790771166.437594:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437595:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437603:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0487a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539751680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.437611:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437617:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e0400/0xfa0c505d97f0d1ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0d1f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437621:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437629:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.437633:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437642:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.437648:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437658:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600fd00) 00010000:00010000:1.0:1790771166.437677:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1790771166.437682:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.437683:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437690:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d0b4 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437706:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896704 00010000:00010000:1.0:1790771166.437708:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437710:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896704 00010000:00010000:1.0:1790771166.437717:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437723:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437727:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.437729:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437734:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.437740:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895552 00010000:00010000:1.0:1790771166.437743:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfb03218d00) 00000100:00100000:2.0:1790771166.437743:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895552 00010000:00010000:1.0:1790771166.437747:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771166.437750:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437759:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d0ad lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.437760:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6031 00010000:00010000:3.0:1790771166.437760:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.437767:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771166.437771:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6032 00010000:00010000:3.0:1790771166.437775:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771166.437776:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14613:x1877759533896704:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.437781:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437786:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.437786:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:11865:x1877759533895552:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.437793:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437797:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539751680 00010000:00010000:0.0:1790771166.437798:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d331 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358d0 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437802:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.437804:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437804:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539751680 00010000:00010000:2.0:1790771166.437814:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d338 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ab3 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437823:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.437825:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437829:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437845:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437847:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437855:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437863:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437871:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00010000:00010000:1.0:1790771166.437875:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.437877:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437884:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.437886:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.437887:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:3627:x1877759539751680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.437892:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437898:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.437903:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.437917:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d08a lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437918:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.437927:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.437934:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.437940:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437947:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.437948:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.437949:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437973:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437978:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d338 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ab3 expref: 127 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437988:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.437995:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.437998:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.437999:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ab3 expref: 126 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438014:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.438016:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000004:00200000:0.0:1790771166.438017:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.438025:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.438029:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc029cbc00, rc 0) 00010000:00010000:1.0:1790771166.438031:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfb03218100) 00010000:00010000:1.0:1790771166.438035:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.438038:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438042:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d098 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438058:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438062:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438063:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.438067:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11865:x1877759533895552:12345-192.168.204.50@tcp:101:ls.0 Request processed in 284us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.438090:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6032 00010000:00010000:0.0:1790771166.438091:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438091:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438111:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438111:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.438117:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438120:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438135:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.438138:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438140:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438151:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438153:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9b50d0cc (ffff8bfb03218400) 00010000:00010000:1.0:1790771166.438160:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.438163:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.438165:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438171:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.438172:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d0a6 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438176:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.438181:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438187:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d33f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438199:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438204:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438208:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438213:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.438217:0:13785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14619:x1877759533883776:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 21785us (21872us total) trans 0 rc -39/-39 00010000:00010000:0.0:1790771166.438219:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438231:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.438232:0:13785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 36 00010000:00010000:0.0:1790771166.438245:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfc3607a100) 00010000:00010000:0.0:1790771166.438247:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.438250:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438254:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d34d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.438269:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896960 00000100:00100000:1.0:1790771166.438273:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896960 00010000:00010000:0.0:1790771166.438278:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d331 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358d0 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438286:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.438288:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.438291:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d331 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358d0 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.438303:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533f600, rc 0) 00000100:00100000:1.0:1790771166.438309:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6033 00000100:00100000:1.0:1790771166.438324:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14733:x1877759533896960:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:0.0:1790771166.438336:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14613:x1877759533896704:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 564us (993us total) trans 4294969328 rc 301/301 00000100:00100000:0.0:1790771166.438343:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6031 00010000:00010000:1.0:1790771166.438412:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438420:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438426:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.438451:0:13773:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969329 00000004:00010000:1.0:1790771166.438469:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070f39171 reply state 00000000ea96f98c transno 4294969330 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438476:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.438481:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:1.0:1790771166.438505:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.438507:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.438560:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14733:x1877759533896960:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 240us (403us total) trans 4294969330 rc 0/0 00000100:00100000:1.0:1790771166.438569:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6033 00000020:00080000:1.0:1790771166.438574:0:13773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771166.438916:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0487a300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539750912:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.438926:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0487b800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539751040:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.438940:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.439341:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.439372:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897856 00000100:00100000:0.0:1790771166.439377:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897856 00000100:00100000:2.0:1790771166.439382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.439407:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533898112 00000100:00100000:0.0:1790771166.439411:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1579 00000100:00100000:0.0:1790771166.439418:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11374850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:11824:x1877759533897856:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.439444:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533898112 00000100:00100000:3.0:1790771166.439478:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6034 00000100:00100000:0.0:1790771166.439582:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11374850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:11824:x1877759533897856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 163us (240us total) trans 4294969331 rc 0/0 00000100:00100000:0.0:1790771166.439589:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1579 00000100:00100000:3.0:1790771166.439595:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14511:x1877759533898112:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1790771166.439617:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:2.0:1790771166.439634:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.439672:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533898368 00000100:00100000:0.0:1790771166.439676:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533898368 00010000:00010000:3.0:1790771166.439700:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0cfa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3599b expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.439711:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6035 00000100:00100000:0.0:1790771166.439721:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:13894:x1877759533898368:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1790771166.439727:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f00ee4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x61:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3160a expref: 128 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.439739:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.439746:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771166.439762:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0cf9c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35994 expref: 83 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.439770:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.439786:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ba64 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35312 expref: 82 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.439791:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897728 00000100:00100000:2.0:1790771166.439796:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897728 00010000:00010000:0.0:1790771166.439803:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0af51 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e5e expref: 81 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.439813:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439816:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:0.0:1790771166.439824:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.439835:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439843:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.439844:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897600 00000100:00100000:2.0:1790771166.439849:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897600 00010000:00010000:0.0:1790771166.439852:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439859:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x61:0x0].0x0 (ffff8bfb0321a500) 00010000:00010000:2.0:1790771166.439863:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 129 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439866:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439874:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.439876:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1667 00010000:00010000:0.0:1790771166.439886:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439891:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439892:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439911:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.439917:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2399:x1877759533897728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.439921:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1668 00010000:00010000:3.0:1790771166.439928:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.439935:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.439936:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2399:x1877759533897600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.439943:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.439945:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439946:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.439947:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.439957:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 129 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439964:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.439975:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 89 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.439978:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.439988:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440002:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440009:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 129 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440011:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 5/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440032:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f097e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3461c expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440044:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440044:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0c466 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3552d expref: 129 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440046:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:3.0:1790771166.440047:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440057:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440073:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440074:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440083:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440097:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440108:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.440109:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001_UUID:13767:1877759539751808:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.440122:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.440126:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.440135:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.440156:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2399:x1877759533897600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 221us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.440166:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2399:x1877759533897728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 252us (426us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.440167:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 89 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.440174:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1668 00000100:00100000:1.0:1790771166.440185:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1667 00010000:00010000:0.0:1790771166.440186:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 89 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.440197:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001_UUID:13767:1877759539751936:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.440225:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc0535a6c0 going to sleep for 11 seconds 00000040:00080000:3.0:1790771166.440231:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].41, 64 off11416 00010000:00010000:3.0:1790771166.440270:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440276:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440282:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440287:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440293:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440299:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440313:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.440321:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.440327:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440333:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.440335:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440340:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440347:0:8424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x61:0x0].0x0 (ffff8bfc1040f000) 00010000:00010000:2.0:1790771166.440349:0:8424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790771166.440351:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440356:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d38c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440360:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440364:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.440366:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.440369:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440370:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.440377:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440381:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.440383:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440387:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440395:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x61:0x0].0x0 (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.440397:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771166.440400:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440404:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d385 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440417:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440422:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440427:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440431:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440433:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.440435:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440439:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440443:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.440444:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.440446:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440450:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d370 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.440457:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000081d2653a reply state 0000000019b02bfc transno 4294969332 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440463:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440467:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xdcc87686 (ffff8bfc1040f500) 00010000:00010000:3.0:1790771166.440469:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.440471:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.440530:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14511:x1877759533898112:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1045us (1148us total) trans 4294969332 rc 0/0 00000100:00100000:3.0:1790771166.440537:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6034 00010000:00010000:0.0:1790771166.440543:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.440544:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969330 is committed 00010000:00010000:0.0:1790771166.440552:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440561:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.440565:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969328 is committed 00010000:00010000:3.0:1790771166.440568:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440574:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440579:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.440582:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440584:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440592:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.440595:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969318 is committed 00010000:00010000:2.0:1790771166.440610:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440615:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771166.440623:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000001:00080000:0.0:1790771166.440624:0:13761:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969333 00010000:00010000:2.0:1790771166.440625:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440626:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440646:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d290 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.440647:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000426e865c reply state 0000000001485bd2 transno 4294969334 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440648:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.440656:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440677:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d1f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfa0c505d97f0d1ef expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440683:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440686:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440688:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440707:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd6e9df9d (ffff8bfc3600d100) 00010000:00010000:3.0:1790771166.440708:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440713:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc1040fd00) 00010000:00010000:1.0:1790771166.440716:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440723:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.440726:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.440729:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.440735:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.440740:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.440741:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440752:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440753:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0d1b7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440755:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.440769:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14555:x1877759533890432:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 11459us (11606us total) trans 4294969334 rc 0/0 00000100:00100000:0.0:1790771166.440780:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6016 00000020:00080000:0.0:1790771166.440784:0:13761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.440785:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440790:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.440791:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440797:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440801:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.440805:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440809:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440819:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff8bfc1040fa00) 00010000:00010000:2.0:1790771166.440822:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.440825:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440829:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0d1d3 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.440838:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3627:x1877759539751680:12345-0@lo:103:ldlm_bl.0 Request processed in 2953us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.440845:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00010000:00010000:2.0:1790771166.440850:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.440855:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0487a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539751680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.440857:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440863:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440869:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.440872:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440876:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440877:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440888:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.440895:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440898:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:2.0:1790771166.440904:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.440908:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.440913:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.440914:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d10f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440960:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440969:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:3.0:1790771166.440971:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.440973:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.440978:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d2d6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.440986:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d354380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1877759539752064:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1790771166.441014:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.441020:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.441026:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.441031:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.441034:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd4600 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.441035:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.441040:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.441050:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539752064 00010000:00010000:3.0:1790771166.441050:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.441056:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539752064 00010000:00010000:3.0:1790771166.441059:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:3.0:1790771166.441062:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.441064:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.441068:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d35b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.441086:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1790771166.441092:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1877759539752064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790771166.441156:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1877759539752064:12345-0@lo:1000:mdt00_002.0 Request processed in 63us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.441164:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1790771166.441184:0:6495:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968686 gen 2 00000004:00080000:1.0:1790771166.441189:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968632 committed transno 4294968686 00000020:00080000:1.0:1790771166.441194:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb05e873c0 refcount 2 committed 0 result 0 batchid 47 00000020:00080000:1.0:1790771166.441197:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4cc00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05e87e40 00000020:00080000:1.0:1790771166.441199:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].37 00000020:00080000:1.0:1790771166.441201:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05762a00 00000020:00080000:1.0:1790771166.441203:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].37 00000004:00080000:1.0:1790771166.441220:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968655 committed transno 4294968686 00000020:00080000:1.0:1790771166.441223:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb05e896c0 refcount 2 committed 0 result 0 batchid 48 00000020:00080000:2.0:1790771166.441225:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 47 committed batchid 46 00000020:00080000:1.0:1790771166.441226:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb064e1d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05e89c00 00000020:00080000:1.0:1790771166.441232:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].38 00000020:00080000:1.0:1790771166.441234:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb064e1800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06b64600 00000020:00080000:1.0:1790771166.441236:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].38 00000004:00080000:1.0:1790771166.441245:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968686 committed transno 4294968686 00000020:00080000:1.0:1790771166.441248:0:6495:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc3fa63000 refcount 2 committed 0 result 0 batchid 50 00000020:00080000:1.0:1790771166.441250:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc3fa636c0 00000020:00080000:1.0:1790771166.441252:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].39 00000020:00080000:1.0:1790771166.441254:0:6495:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb060b7600 00000020:00080000:1.0:1790771166.441256:0:6495:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].39 00000020:00080000:2.0:1790771166.441260:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 50 committed batchid 46 00000100:00100000:1.0:1790771166.441269:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1877759539752064:0@lo:1000:mdt00_002.0 00000020:00080000:2.0:1790771166.441278:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 46 00010000:00010000:1.0:1790771166.441300:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0d393 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441312:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0d393 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441320:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0d393 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.441335:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0d393 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441346:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441351:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441356:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441359:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441363:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.441365:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441369:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441374:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc3600d000) 00010000:00010000:1.0:1790771166.441377:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.441379:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441383:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0d307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441390:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441394:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441398:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441401:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.441403:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441407:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441411:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd6e9df9d (ffff8bfc3600d100) 00010000:00010000:1.0:1790771166.441412:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.441414:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441417:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d30e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441433:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a9e expref: 113 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441447:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc0151fa00/0xfa0c505d97f0d393 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a9e expref: 112 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.441452:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0x0 (ffff8bfc36079300) 00010000:00010000:1.0:1790771166.441454:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.441455:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc0151fa00, rc 0) 00000100:00100000:1.0:1790771166.441480:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:11011:x1877759533895168:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 4726us (4799us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.441504:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6028 00000100:00100000:2.0:1790771166.444152:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.444197:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533898624 00000100:00100000:0.0:1790771166.444203:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533898624 00000100:00100000:0.0:1790771166.444231:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6036 00000100:00100000:0.0:1790771166.444237:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13266:x1877759533898624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.444246:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.444254:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d39a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358e5 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.444300:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0d3a1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.444308:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0d3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.444315:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0d3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.444321:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.444362:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0d39a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358e5 expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.444372:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0d3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358e5 expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.444378:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.444380:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.444382:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:0.0:1790771166.444408:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13266:x1877759533898624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 172us (259us total) trans 4294969335 rc 0/0 00000100:00100000:0.0:1790771166.444413:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6036 00000100:00100000:2.0:1790771166.445438:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.445455:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.445478:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.445479:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533898496 00000100:00100000:1.0:1790771166.445516:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895680 00000100:00100000:1.0:1790771166.445522:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895680 00000100:00100000:0.0:1790771166.445524:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06190380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:13783:1877759539751168:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.445536:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.445540:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.445557:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533898496 00000100:00100000:1.0:1790771166.445566:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533899136 00000100:00100000:1.0:1790771166.445572:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533899136 00000100:00100000:0.0:1790771166.445573:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533888896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 14847us (15138us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.445583:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1660 00000100:00100000:3.0:1790771166.445600:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 413 00000100:00100000:1.0:1790771166.445613:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895808 00000100:00100000:3.0:1790771166.445613:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759533898496:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771166.445619:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895808 00000100:00100000:2.0:1790771166.445619:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.445643:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6037 00000100:00100000:1.0:1790771166.445655:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6038 00000100:00100000:0.0:1790771166.445656:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12255:x1877759533895680:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.445678:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6039 00000100:00100000:1.0:1790771166.445683:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14745:x1877759533899136:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.445691:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.445694:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:11807:x1877759533895808:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.445703:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d3af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35aba expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.445705:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.445719:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d3b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ac1 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.445722:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.445743:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.445744:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.445759:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.445768:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.445768:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.445790:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.445792:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.445803:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.445807:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.445810:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb size from disk: 1621 -> 33196 00000004:00200000:0.0:1790771166.445813:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00002000:00010000:3.0:1790771166.445819:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00000004:00200000:0.0:1790771166.445821:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.445826:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 116 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.445827:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb atime from disk: 1790771160 -> 0 00000004:00010000:0.0:1790771166.445835:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.445836:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.445846:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0xf:0x0] updating lvb blocks from disk: 0 -> 24 00000004:00200000:2.0:1790771166.445858:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.445863:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d354380 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000_UUID:13769:1877759539752192:192.168.204.50@tcp:104: 00000004:00200000:2.0:1790771166.445864:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.445868:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d3af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aba expref: 117 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.445877:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.445883:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759533898496:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 272us (441us total) trans 4294967617 rc 0/0 00010000:00010000:0.0:1790771166.445886:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aba expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.445901:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.445902:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d3b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac1 expref: 117 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.445904:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 413 00010000:00010000:0.0:1790771166.445907:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.445912:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594800, rc 0) 00000100:00100000:1.0:1790771166.445915:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd4600 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.445928:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac1 expref: 116 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.445935:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.445938:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.445939:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533899520 00000100:00100000:0.0:1790771166.445944:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12255:x1877759533895680:12345-192.168.204.50@tcp:101:ls.0 Request processed in 289us (483us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.445944:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00000100:00100000:1.0:1790771166.445945:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533899520 00000100:00100000:0.0:1790771166.445954:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6037 00000100:00100000:2.0:1790771166.445976:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:11807:x1877759533895808:12345-192.168.204.50@tcp:101:ls.0 Request processed in 286us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.445990:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1580 00000100:00100000:2.0:1790771166.445990:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6039 00000100:00100000:1.0:1790771166.446005:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+90:14522:x1877759533899520:12345-192.168.204.50@tcp:35:mkdir.0 00000100:00100000:1.0:1790771166.446097:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14522:x1877759533899520:12345-192.168.204.50@tcp:35:mkdir.0 Request processed in 96us (488us total) trans 4294968722 rc 0/0 00000100:00100000:1.0:1790771166.446102:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1580 00000100:00100000:3.0:1790771166.454398:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.454419:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.454436:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533899648 00000100:00100000:2.0:1790771166.454443:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533899648 00000100:00100000:2.0:1790771166.454514:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6040 00000100:00100000:2.0:1790771166.454525:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13260:x1877759533899648:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.454539:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.454553:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d3d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358ec expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.454621:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d3d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.454622:0:8406:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb size: 0 -> 5 00002000:00010000:0.0:1790771166.454627:0:8406:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb atime: 0 -> 1790771161 00002000:00010000:0.0:1790771166.454633:0:8406:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:1.0:1790771166.454635:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900032 00000100:00100000:1.0:1790771166.454642:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900032 00000100:00100000:0.0:1790771166.454652:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539751296:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.454653:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.454681:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.454690:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6041 00000004:00200000:2.0:1790771166.454690:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.454695:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041a7879e/0xfa0c505d97f0d26d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a5f expref: 29 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.454706:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14139:x1877759533900032:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771166.454715:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.454717:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041a7879e/0xfa0c505d97f0d26d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a5f expref: 29 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454726:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d3e0 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b1c expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.454729:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594400, rc 0) 00000100:00100000:0.0:1790771166.454763:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759533891328:12345-192.168.204.50@tcp:101:cat.0 Request processed in 22808us (22977us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.454769:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 994 00000100:00100000:0.0:1790771166.454801:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539751424:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.454801:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454815:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.454818:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454840:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454856:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454865:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.454872:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.454882:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.454904:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900928 00000004:00200000:1.0:1790771166.454906:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00000100:00100000:3.0:1790771166.454909:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900928 00000100:00100000:0.0:1790771166.454915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.454921:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454929:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454934:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454940:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.454940:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533899776 00000100:00100000:2.0:1790771166.454947:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533899776 00010000:00010000:1.0:1790771166.454948:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.454953:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454959:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.454971:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00002000:00100000:2.0:1790771166.454972:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (528384->532479) req@ffff8bfc3fb4e300 x1877759533899776/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.454976:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.454981:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.454987:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb4e300 with x1877759533899776 ext(528384->532479) 00010000:00010000:1.0:1790771166.454991:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d3e7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.454994:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb4e300 00010000:00010000:1.0:1790771166.455008:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455017:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455026:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.455027:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6042 00010000:00010000:1.0:1790771166.455036:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.455041:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13264:x1877759533900928:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.455042:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.455054:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 414 00010000:00010000:1.0:1790771166.455058:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.455059:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.455069:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533899776:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.455070:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x59d92b11 (ffff8bfc36079600) 00010000:00010000:3.0:1790771166.455073:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d3fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358f3 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455079:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.455082:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900288 00010000:00010000:1.0:1790771166.455084:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455089:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900288 00010000:00010000:1.0:1790771166.455095:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d3ee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455120:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1581 00000100:00100000:0.0:1790771166.455128:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:11955:x1877759533900288:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.455133:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d403 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455135:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d3e0 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b1c expref: 92 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.455153:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455157:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.455164:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.455171:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d403 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455172:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d3e0 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b1c expref: 92 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.455195:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.455196:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1400, rc 0) 00000100:00100000:2.0:1790771166.455205:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533899776:12345-192.168.204.50@tcp:3:cat.0 Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.455215:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 414 00002000:00100000:2.0:1790771166.455221:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (528384->532479) req@ffff8bfc3fb4e300 x1877759533899776/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.455228:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb4e300 with x1877759533899776 ext(528384->532479) 00002000:00010000:2.0:1790771166.455232:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb4e300 00000100:00100000:1.0:1790771166.455236:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14139:x1877759533900032:12345-192.168.204.50@tcp:101:dd.0 Request processed in 531us (811us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.455240:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:11955:x1877759533900288:12345-192.168.204.50@tcp:35:ls.0 Request processed in 111us (188us total) trans 4294969336 rc 0/0 00000100:00100000:1.0:1790771166.455256:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6041 00000100:00100000:0.0:1790771166.455261:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1581 00010000:00010000:3.0:1790771166.455275:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d3fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358f3 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.455280:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533901696 00000100:00100000:1.0:1790771166.455287:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533901696 00010000:00010000:3.0:1790771166.455295:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d403 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358f3 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.455302:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.455304:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.455307:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a400, rc 0) 00000100:00100000:1.0:1790771166.455332:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6043 00000100:00100000:3.0:1790771166.455339:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13264:x1877759533900928:12345-192.168.204.50@tcp:101:ls.0 Request processed in 301us (468us total) trans 4294969337 rc 0/0 00000100:00100000:1.0:1790771166.455347:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13265:x1877759533901696:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.455352:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6042 00000100:00100000:0.0:1790771166.455359:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455362:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.455373:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d411 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e358fa expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455393:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900416 00000100:00100000:0.0:1790771166.455399:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900416 00000100:00100000:3.0:1790771166.455404:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455419:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d418 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455428:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d418 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.455438:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455442:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d418 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455451:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 997 00000004:00200000:1.0:1790771166.455453:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.455457:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896064 00000100:00100000:2.0:1790771166.455462:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896064 00000100:00100000:0.0:1790771166.455465:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533900416:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:3.0:1790771166.455477:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.455525:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6044 00000100:00100000:3.0:1790771166.455534:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455558:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d411 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358fa expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.455564:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.455567:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14828:x1877759533896064:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771166.455587:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1790771166.455588:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1790771166.455593:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d418 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358fa expref: 127 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.455595:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime from disk: 1790771166 -> 1674053537 00000100:00100000:3.0:1790771166.455597:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.455599:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0d426 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35acf expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.455603:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771166.455610:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.455617:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771166.455622:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:3.0:1790771166.455625:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.455630:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.455634:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00000100:00100000:0.0:1790771166.455648:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533900416:12345-192.168.204.50@tcp:2:cp.0 Request processed in 188us (294us total) trans 4294967618 rc 0/0 00000100:00100000:0.0:1790771166.455654:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 997 00010000:00010000:2.0:1790771166.455672:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0d426 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35acf expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.455680:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13265:x1877759533901696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 321us (649us total) trans 4294969338 rc 0/0 00000100:00100000:0.0:1790771166.455684:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533899008 00000100:00100000:3.0:1790771166.455690:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.455691:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533899008 00010000:00010000:2.0:1790771166.455693:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85a00/0xfa0c505d97f0d426 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35acf expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.455699:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6043 00010000:00010000:2.0:1790771166.455716:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771166.455719:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1790771166.455722:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902080 00010000:00010000:2.0:1790771166.455723:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85a00, rc 0) 00000100:00100000:1.0:1790771166.455724:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533901312 00000100:00100000:0.0:1790771166.455729:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 998 00000100:00100000:3.0:1790771166.455729:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902080 00000100:00100000:1.0:1790771166.455731:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533901312 00000100:00100000:0.0:1790771166.455743:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533899008:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.455750:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.455755:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14828:x1877759533896064:12345-192.168.204.50@tcp:101:chown.0 Request processed in 219us (321us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.455761:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b2ef188/0xfa0c505d97f0d42d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b0e expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.455762:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6044 00000100:00100000:1.0:1790771166.455773:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6045 00000100:00100000:3.0:1790771166.455783:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 999 00000100:00100000:1.0:1790771166.455784:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14858:x1877759533901312:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:2.0:1790771166.455792:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900544 00000100:00100000:2.0:1790771166.455797:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900544 00000100:00100000:3.0:1790771166.455801:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533902080:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:0.0:1790771166.455802:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539752320:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.455808:0:13773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.455816:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 127 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455824:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0d18d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e8 expref: 117 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.455835:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00000100:00100000:2.0:1790771166.455838:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533901184 00010000:00010000:1.0:1790771166.455839:0:13773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.455844:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533901184 00000100:00100000:0.0:1790771166.455851:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa636c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.455871:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.455871:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1669 00000100:00100000:0.0:1790771166.455877:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533901568 00000100:00100000:0.0:1790771166.455883:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533901568 00000100:00100000:2.0:1790771166.455884:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759533900544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1790771166.455893:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 37366 -> 37366 00010000:00010000:2.0:1790771166.455897:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790771166.455899:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1790771165 -> 0 00002000:00010000:3.0:1790771166.455904:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1790771165 -> 0 00010000:00010000:2.0:1790771166.455907:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.455908:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00010000:00010000:1.0:1790771166.455909:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455915:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533901952 00002000:00010000:3.0:1790771166.455916:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 32 -> 32 00000100:00100000:0.0:1790771166.455924:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533901952 00010000:00010000:1.0:1790771166.455936:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.455937:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.455950:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533902080:12345-192.168.204.50@tcp:2:chown.0 Request processed in 153us (264us total) trans 4294967614 rc 0/0 00000100:00100000:0.0:1790771166.455962:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1582 00000100:00100000:3.0:1790771166.455968:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 999 00010000:00010000:2.0:1790771166.455969:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97efbad6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f8ba expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.455979:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14376:x1877759533901568:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:2.0:1790771166.455984:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00010000:00010000:2.0:1790771166.455988:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.455995:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.455996:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1583 00010000:00010000:2.0:1790771166.456004:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.456010:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:12120:x1877759533901952:12345-192.168.204.50@tcp:35:ls.0 00000004:00010000:1.0:1790771166.456025:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000efdfc522 reply state 00000000a4dc7f88 transno 4294969339 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.456025:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.456036:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.456044:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:1.0:1790771166.456049:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.456049:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2396:x1877759533900544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 164us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.456052:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.456061:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1669 00000100:00100000:2.0:1790771166.456086:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 805 00000100:00100000:0.0:1790771166.456094:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+92:14376:x1877759533901568:12345-192.168.204.50@tcp:35:cat.0 Request processed in 118us (498us total) trans 4294968723 rc 0/0 00000100:00100000:1.0:1790771166.456101:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14858:x1877759533901312:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 316us (563us total) trans 4294969339 rc 0/0 00000100:00100000:2.0:1790771166.456102:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2399:x1877759533901184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.456113:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:12120:x1877759533901952:12345-192.168.204.50@tcp:35:ls.0 Request processed in 104us (490us total) trans 4294968724 rc 0/0 00010000:00010000:2.0:1790771166.456119:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.456120:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1582 00000100:00100000:1.0:1790771166.456125:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6045 00000100:00100000:3.0:1790771166.456131:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1583 00010000:00010000:2.0:1790771166.456137:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0d227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a51 expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.456150:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.456155:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.456181:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2399:x1877759533901184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.456190:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 805 00000100:00100000:3.0:1790771166.456229:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2399:x1877759533892224:12345-192.168.204.50@tcp:4:cat.0 Request processed in 21743us (22277us total) trans 4294967613 rc 0/0 00000100:00100000:3.0:1790771166.456239:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 95 00002000:00100000:3.0:1790771166.456246:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0xa:0x0] (45056->76519) req@ffff8bfb0562ed80 x1877759533892224/t4294967613(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.456254:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562ed80 with x1877759533892224 ext(45056->76519) 00010000:00010000:1.0:1790771166.456259:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.456261:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 29 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.456282:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.456288:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 29 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.456296:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb0562ed80 00010000:00010000:2.0:1790771166.456307:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0d3d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ec expref: 126 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.456321:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ec expref: 125 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.456327:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.456330:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.456332:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38800, rc 0) 00000001:00080000:1.0:1790771166.456338:0:7771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969324 00000100:00100000:2.0:1790771166.456363:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13260:x1877759533899648:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1843us (1966us total) trans 4294969340 rc 0/0 00000004:00010000:1.0:1790771166.456365:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8604b0c reply state 0000000098d7a168 transno 4294969341 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.456373:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6040 00010000:00010000:1.0:1790771166.456382:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.456392:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00010000:00010000:1.0:1790771166.456395:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.456397:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.456445:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:10887:x1877759533892480:12345-192.168.204.50@tcp:36:dir_create.sh.0 Request processed in 22481us (22927us total) trans 4294969341 rc 0/0 00000100:00100000:1.0:1790771166.456451:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6021 00000020:00080000:1.0:1790771166.456455:0:7771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790771166.457116:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.457147:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903104 00000100:00100000:3.0:1790771166.457152:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903104 00000100:00100000:3.0:1790771166.457180:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6046 00000100:00100000:3.0:1790771166.457186:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14070:x1877759533903104:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.457195:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.457203:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d43b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b54 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457231:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457239:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457244:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457254:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457259:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457263:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.457300:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.457326:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457331:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457335:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457338:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457342:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.457344:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457348:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457354:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.457356:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.457359:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457363:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d442 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457369:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457373:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457377:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457381:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.457383:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457387:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457391:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.457392:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.457394:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457397:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d449 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457414:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d43b lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b54 expref: 84 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457424:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.457426:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.457428:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d43b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b54 expref: 84 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.457433:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b800, rc 0) 00000100:00100000:3.0:1790771166.457459:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+83:14070:x1877759533903104:12345-192.168.204.50@tcp:101:ls.0 Request processed in 274us (344us total) trans 4294968725 rc 301/301 00000100:00100000:3.0:1790771166.457465:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6046 00000100:00100000:2.0:1790771166.458118:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.458162:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904000 00000100:00100000:2.0:1790771166.458169:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.458170:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904000 00000100:00100000:0.0:1790771166.458211:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904256 00000100:00100000:0.0:1790771166.458215:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904256 00000100:00100000:1.0:1790771166.458239:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6047 00000100:00100000:0.0:1790771166.458255:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6048 00000100:00100000:1.0:1790771166.458256:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:12014:x1877759533904000:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.458270:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.458275:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+84:14721:x1877759533904256:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771166.458281:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d457 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b69 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458288:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.458302:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d45e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b77 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458323:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458336:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458345:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458350:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458358:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458360:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458375:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458377:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458391:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458399:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458407:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458413:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458418:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d481 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458425:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458430:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d481 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458438:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458441:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458443:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458455:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458456:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458471:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.458472:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458475:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458515:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458523:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458527:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458529:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458533:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.458538:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458549:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458550:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.458556:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.458560:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458564:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.458569:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.458573:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d465 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458574:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458589:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0d46c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458596:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458599:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458609:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458611:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458627:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458628:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458645:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.458646:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.458652:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458653:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458678:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458681:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458685:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xea196397 (ffff8bfc3607a100) 00010000:00010000:0.0:1790771166.458690:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.458693:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458694:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc36079000) 00010000:00010000:1.0:1790771166.458701:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.458702:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0d47a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458707:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.458712:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.458722:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d473 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458736:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0d45e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b77 expref: 87 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458755:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d457 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b69 expref: 87 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.458755:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902336 00010000:00010000:0.0:1790771166.458756:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b77 expref: 87 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.458761:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902336 00000100:00100000:3.0:1790771166.458768:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.458781:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:0.0:1790771166.458785:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.458788:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d481 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b69 expref: 87 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458790:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533f600, rc 0) 00000100:00100000:2.0:1790771166.458798:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902464 00000100:00100000:2.0:1790771166.458803:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902464 00000100:00100000:3.0:1790771166.458809:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.458813:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:1.0:1790771166.458816:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.458818:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00000100:00100000:2.0:1790771166.458831:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902720 00000100:00100000:2.0:1790771166.458835:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902720 00000100:00100000:0.0:1790771166.458840:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:14721:x1877759533904256:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 569us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.458849:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:12014:x1877759533904000:12345-192.168.204.50@tcp:101:ls.0 Request processed in 598us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.458857:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6048 00000100:00100000:1.0:1790771166.458866:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6047 00000100:00100000:2.0:1790771166.458875:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6049 00000100:00100000:0.0:1790771166.458886:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6050 00000100:00100000:2.0:1790771166.458891:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14768:x1877759533902336:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:3.0:1790771166.458891:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.458901:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6051 00000100:00100000:0.0:1790771166.458902:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14786:x1877759533902464:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.458905:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.458917:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.458917:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14732:x1877759533902720:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:2.0:1790771166.458919:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d48f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b3f expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458931:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d496 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b46 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.458956:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.458959:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458961:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.458979:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.458979:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.458980:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459001:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.459006:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459007:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459016:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.459033:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459035:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459050:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.459058:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459058:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459079:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.459091:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459102:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459111:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.459119:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459128:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459129:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904512 00000100:00100000:3.0:1790771166.459135:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904512 00010000:00010000:2.0:1790771166.459138:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459155:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459164:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1000 00000004:00200000:2.0:1790771166.459166:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 17258 00010000:00010000:0.0:1790771166.459169:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.459173:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.459174:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:14733:x1877759533904512:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:3.0:1790771166.459188:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.459190:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.459192:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459198:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b85 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.459226:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 3407872 00010000:00010000:2.0:1790771166.459230:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.459233:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.459242:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459244:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.459246:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459258:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459271:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459271:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1790771166.459274:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459281:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771166.459294:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 4/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459295:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.459297:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459317:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459324:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459325:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459334:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459346:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459350:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.459357:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459364:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 28 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459372:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459372:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.459379:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.459379:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13782:1877759539752448:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.459385:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459389:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.459392:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d49d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459393:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.459399:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459408:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459409:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d4ab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459420:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffa80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.459429:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459434:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459436:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459450:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459451:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.459458:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459462:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.459469:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459472:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459480:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.459505:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfc4205de00) 00010000:00010000:2.0:1790771166.459508:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.459511:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459517:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459517:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d4b2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459533:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459546:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9537b590 (ffff8bfc3607a500) 00010000:00010000:0.0:1790771166.459548:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.459551:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459556:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d4b9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459562:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d48f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b3f expref: 91 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459581:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b3f expref: 91 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459586:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d496 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 91 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459592:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771166.459596:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.459599:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00010000:00010000:0.0:1790771166.459603:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 90 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459610:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.459612:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.459614:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533f000, rc 0) 00000100:00100000:2.0:1790771166.459631:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14768:x1877759533902336:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 747us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.459634:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904896 00000100:00100000:1.0:1790771166.459641:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904896 00000100:00100000:0.0:1790771166.459643:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14786:x1877759533902464:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 743us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.459649:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.459673:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6049 00000100:00100000:0.0:1790771166.459681:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6050 00000100:00100000:2.0:1790771166.459696:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902848 00000100:00100000:1.0:1790771166.459698:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 37 00000100:00100000:2.0:1790771166.459702:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902848 00000100:00100000:0.0:1790771166.459705:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903360 00000100:00100000:1.0:1790771166.459710:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14325:x1877759533904896:12345-192.168.204.50@tcp:36:mrename.0 00000100:00100000:0.0:1790771166.459712:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903360 00000100:00100000:2.0:1790771166.459732:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903872 00010000:00010000:1.0:1790771166.459735:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:2.0:1790771166.459736:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903872 00000100:00100000:0.0:1790771166.459747:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533895936 00000100:00100000:0.0:1790771166.459751:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533895936 00010000:00010000:1.0:1790771166.459751:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d194 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a19 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.459771:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6052 00010000:00010000:1.0:1790771166.459774:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0a3e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x85:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ab4 expref: 119 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459777:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903616 00000100:00100000:2.0:1790771166.459784:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:14827:x1877759533902848:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.459790:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771166.459793:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.459796:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6053 00010000:00010000:1.0:1790771166.459803:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0ced8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35971 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459805:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0d4d5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b4d expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.459810:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:13958:x1877759533903360:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771166.459826:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.459827:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.459832:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.459839:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d4dc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b5b expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459848:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.459849:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459864:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459872:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.459873:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459874:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459879:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903616 00010000:00010000:0.0:1790771166.459898:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.459902:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459904:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459907:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459912:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903232 00000100:00100000:3.0:1790771166.459917:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903232 00010000:00010000:2.0:1790771166.459927:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459935:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459941:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 806 00010000:00010000:0.0:1790771166.459942:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459952:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.459955:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759533903616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.459963:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459968:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.459969:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459979:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 2/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.459986:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d2f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a97 expref: 119 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.459987:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 4/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.459999:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460011:0:12128:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460015:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460016:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.460018:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460024:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460025:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.460038:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460041:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.460054:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759533903616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (1039us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.460059:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.460065:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.460066:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 806 00000100:00100000:2.0:1790771166.460071:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6054 00000004:00200000:0.0:1790771166.460072:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.460088:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460089:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.460090:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14649:x1877759533903872:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:3.0:1790771166.460091:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 807 00000100:00100000:3.0:1790771166.460106:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759533903232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.460107:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.460112:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460116:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460120:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.460122:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460122:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0d522 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b70 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460133:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d346 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ab3 expref: 117 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460147:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460158:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460160:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.460163:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.460166:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460171:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.460179:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460182:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460188:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:3.0:1790771166.460192:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759533903232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (1116us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.460195:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.460200:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460203:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.460204:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 807 00010000:00010000:0.0:1790771166.460220:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d4f1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460224:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460234:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460239:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460240:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460243:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.460255:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6055 00010000:00010000:0.0:1790771166.460264:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.460271:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:12237:x1877759533895936:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.460273:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 124 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460284:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460287:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cafe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.460288:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.460294:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460298:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d53e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ac8 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460303:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460304:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460315:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460334:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc3607a400) 00010000:00010000:0.0:1790771166.460336:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.460338:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460342:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d4ff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460351:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460352:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 124 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460359:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460364:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d4dc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 95 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460378:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.460386:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 124 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460386:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.460396:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 94 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460402:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460411:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.460422:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539752576:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.460426:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.460433:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.460435:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cae600, rc 0) 00000004:00200000:3.0:1790771166.460441:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.460445:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:2.0:1790771166.460449:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.460452:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.460457:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.460465:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:13958:x1877759533903360:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 658us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.460466:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b3c0 going to sleep for 11 seconds 00000004:00010000:2.0:1790771166.460466:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.460480:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6053 00010000:00010000:3.0:1790771166.460480:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d53e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 117 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460482:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460533:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460540:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 116 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460545:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.460551:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.460557:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.460560:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.460562:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001_UUID:13767:1877759539751808:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.460562:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00010000:00010000:2.0:1790771166.460568:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460579:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460589:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:3.0:1790771166.460591:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12237:x1877759533895936:12345-192.168.204.50@tcp:101:ls.0 Request processed in 324us (948us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.460593:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.460600:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.460604:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6055 00010000:00010000:2.0:1790771166.460614:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d529 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460632:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460641:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460649:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460654:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.460657:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460675:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460685:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc4205d900) 00010000:00010000:2.0:1790771166.460688:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.460691:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460698:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0d537 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460719:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0d522 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 94 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460727:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 93 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.460732:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:2.0:1790771166.460734:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.460735:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00030200, rc 0) 00000100:00100000:2.0:1790771166.460761:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14649:x1877759533903872:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 679us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.460765:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6054 00010000:00010000:1.0:1790771166.461091:0:7423:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.461101:0:7423:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461107:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461115:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461123:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.461126:0:7423:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461128:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.461132:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461146:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.461161:0:7423:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790771166.461164:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0xc8b04d25 (ffff8bfc22108b00) 00010000:00010000:3.0:1790771166.461167:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.461171:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461176:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0cc46 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x3b:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.461192:0:7423:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb063e1c00/0xfa0c505d97f0cc4d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0cca1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461192:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.461209:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539752704:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1790771166.461211:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461222:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461226:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3000 already unused, calling callback (ffffffffc18aa4f0) 00000001:00080000:1.0:1790771166.461228:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968726 is committed 00010000:00010000:3.0:1790771166.461228:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461240:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.461248:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.461249:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xbc0ca3a9 (ffff8bfc1040fe00) 00010000:00010000:3.0:1790771166.461252:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.461254:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.461257:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968723 is committed 00010000:00010000:3.0:1790771166.461259:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ce22 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461277:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461283:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461287:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461291:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461298:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461303:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461307:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.461311:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.461313:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461315:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.461317:0:7423:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8bfc07829300 refcount 2 committed 0 result 0 batchid 19 00010000:00010000:0.0:1790771166.461323:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.461329:0:7423:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb064e1c00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc06b14b40 00010000:00010000:3.0:1790771166.461333:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.461340:0:7423:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].18 00000020:00080000:1.0:1790771166.461344:0:7423:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb064e1300 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05dd3600 00010000:00010000:0.0:1790771166.461345:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfb03218b00) 00000020:00080000:1.0:1790771166.461347:0:7423:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].18 00010000:00010000:3.0:1790771166.461347:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.461350:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.461355:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.461357:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461359:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461368:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d0e5 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461370:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0cf48 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.461380:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 19 committed batchid 18 00010000:00010000:0.0:1790771166.461392:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461398:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461403:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.461409:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539752704 00000020:00080000:2.0:1790771166.461411:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 18 00010000:00010000:0.0:1790771166.461413:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.461416:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539752704 00010000:00010000:0.0:1790771166.461418:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461425:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461434:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:0.0:1790771166.461436:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:3.0:1790771166.461436:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a2a9268 reply state 000000007b37601a transno 4294968726 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461439:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.461456:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00010000:00010000:3.0:1790771166.461457:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461458:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d108 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.461472:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3624:x1877759539752704:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1790771166.461479:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc36079600) 00010000:00010000:3.0:1790771166.461482:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.461505:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771166.461510:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.461516:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.461522:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461529:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.461533:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0cca1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0cc4d expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461536:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461551:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.461555:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461561:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.461563:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff8bfc3607dd00) 00010000:00010000:1.0:1790771166.461574:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.461578:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0x0 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.461581:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.461583:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.461587:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d1fd lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1790771166.461589:0:13770:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771166.461610:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14732:x1877759533902720:12345-192.168.204.50@tcp:36:chown.0 Request processed in 2695us (2803us total) trans 4294968726 rc 0/0 00010000:00010000:3.0:1790771166.461611:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.461620:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1877759539752704:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.461631:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6051 00010000:00010000:3.0:1790771166.461632:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.461638:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00010000:00010000:3.0:1790771166.461645:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461650:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.461653:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461658:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461684:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc36079600) 00010000:00010000:3.0:1790771166.461687:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.461689:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539752704:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1790771166.461695:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.461705:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d4a4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x35:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.463812:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.463841:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906176 00000100:00100000:3.0:1790771166.463848:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906176 00000100:00100000:3.0:1790771166.463886:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6056 00000100:00100000:3.0:1790771166.463896:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc34323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13270:x1877759533906176:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.463909:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.463919:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d553 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35908 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.463976:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d55a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.463988:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d55a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.463998:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d55a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.464007:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.464065:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d553 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35908 expref: 128 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.464082:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d55a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35908 expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.464092:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.464095:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.464098:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b200, rc 0) 00000100:00100000:3.0:1790771166.464138:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc34323c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13270:x1877759533906176:12345-192.168.204.50@tcp:101:ls.0 Request processed in 243us (324us total) trans 4294969342 rc 0/0 00000100:00100000:3.0:1790771166.464149:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6056 00000100:00100000:3.0:1790771166.465835:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.465863:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906944 00000100:00100000:0.0:1790771166.465868:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906944 00000100:00100000:0.0:1790771166.465897:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6057 00000100:00100000:0.0:1790771166.465904:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13262:x1877759533906944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.465912:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.465921:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0d568 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3591d expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.465960:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0d56f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.465967:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0d56f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.465973:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0d56f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.465979:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.466018:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0d568 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3591d expref: 130 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.466032:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0d56f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3591d expref: 129 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.466037:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.466039:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.466041:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72000, rc 0) 00000100:00100000:0.0:1790771166.466067:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13262:x1877759533906944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 164us (233us total) trans 4294969343 rc 0/0 00000100:00100000:0.0:1790771166.466073:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6057 00000100:00100000:0.0:1790771166.469613:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.469630:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0001_UUID:13767:1877759539751936:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.469642:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.469677:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.469686:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905408 00000100:00100000:3.0:1790771166.469690:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905664 00000100:00100000:1.0:1790771166.469694:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905408 00000100:00100000:0.0:1790771166.469695:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.469698:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905664 00000100:00100000:2.0:1790771166.469721:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905920 00000100:00100000:2.0:1790771166.469727:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905920 00000100:00100000:0.0:1790771166.469728:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.469743:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905792 00000100:00100000:1.0:1790771166.469748:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905792 00010000:00010000:2.0:1790771166.469754:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 117 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.469766:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.469767:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 83 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.469774:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1584 00000100:00100000:3.0:1790771166.469791:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:6623:x1877759533905664:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790771166.469793:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906048 00000100:00100000:2.0:1790771166.469798:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906048 00000100:00100000:1.0:1790771166.469804:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1670 00000100:00100000:0.0:1790771166.469805:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.469824:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533905920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.469832:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897216 00010000:00010000:1.0:1790771166.469833:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.469837:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1671 00000100:00100000:0.0:1790771166.469839:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897216 00010000:00010000:1.0:1790771166.469843:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 118 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.469851:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:2396:x1877759533905792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.469861:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 119 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.469863:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.469872:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 84 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.469876:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6058 00010000:00010000:1.0:1790771166.469879:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:1.0:1790771166.469888:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.469889:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13998:x1877759533897216:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.469892:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 84 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.469905:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.469912:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:6623:x1877759533905664:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 125us (298us total) trans 4294968727 rc 0/0 00010000:00010000:1.0:1790771166.469916:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.469918:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d57d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35aeb expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.469923:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab600/0xfa0c505d97f02645 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x40:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31e06 expref: 84 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.469923:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1584 00010000:00010000:1.0:1790771166.469940:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.469949:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 809 00010000:00010000:2.0:1790771166.469952:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:2.0:1790771166.469959:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.469961:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533905408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.469973:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.469974:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.469976:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.469988:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.469993:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0d323 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aa5 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.470003:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2396:x1877759533905920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (311us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.470005:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470007:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.470014:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.470017:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1670 00000100:00100000:2.0:1790771166.470017:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+82:2396:x1877759533905792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.470036:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1671 00010000:00010000:0.0:1790771166.470040:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.470046:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 810 00000100:00100000:3.0:1790771166.470049:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533905408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.470061:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533906048:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.470064:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.470070:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 809 00010000:00010000:1.0:1790771166.470071:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.470086:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d32a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aac expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.470094:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771166.470096:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.470098:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000004:00200000:0.0:1790771166.470103:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.470104:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1790771166.470121:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.470128:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2396:x1877759533906048:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.470138:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 810 00010000:00010000:3.0:1790771166.470151:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d101 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359e1 expref: 116 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.470155:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d57d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aeb expref: 116 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.470167:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.470187:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aeb expref: 114 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.470190:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354380 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000_UUID:13769:1877759539752192:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.470201:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:0.0:1790771166.470205:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.470207:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73200, rc 0) 00010000:00010000:3.0:1790771166.470214:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470223:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470228:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.470234:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13998:x1877759533897216:12345-192.168.204.50@tcp:101:ls.0 Request processed in 347us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.470241:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6058 00000100:00100000:1.0:1790771166.470248:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906816 00000100:00100000:1.0:1790771166.470253:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906816 00000100:00100000:0.0:1790771166.470274:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906432 00000100:00100000:0.0:1790771166.470281:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906432 00000100:00100000:1.0:1790771166.470285:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6059 00000100:00100000:1.0:1790771166.470301:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+82:14522:x1877759533906816:12345-192.168.204.50@tcp:36:mkdir.0 00002000:00100000:0.0:1790771166.470313:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (532480->536575) req@ffff8bfb069e8000 x1877759533906432/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000004:00010000:3.0:1790771166.470318:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000171d5685 reply state 000000008378b1d1 transno 4294969344 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470338:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.470339:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8000 with x1877759533906432 ext(532480->536575) 00002000:00010000:0.0:1790771166.470350:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8000 00010000:00010000:3.0:1790771166.470352:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:3.0:1790771166.470356:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.470359:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.470362:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 3/0,1 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470371:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470379:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.470380:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 415 00000100:00100000:0.0:1790771166.470393:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533906432:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.470394:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470403:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470413:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.470431:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14745:x1877759533899136:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 24753us (24952us total) trans 4294969344 rc 0/0 00000100:00100000:2.0:1790771166.470437:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6038 00000100:00100000:0.0:1790771166.470549:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533906432:12345-192.168.204.50@tcp:3:cat.0 Request processed in 159us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.470556:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 415 00002000:00100000:0.0:1790771166.470562:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (532480->536575) req@ffff8bfb069e8000 x1877759533906432/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.470568:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8000 with x1877759533906432 ext(532480->536575) 00002000:00010000:0.0:1790771166.470571:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8000 00000100:00100000:0.0:1790771166.470607:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.470634:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.470658:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533907328 00000100:00100000:0.0:1790771166.470674:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.470678:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533907328 00000100:00100000:0.0:1790771166.470704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.470715:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896832 00000100:00100000:2.0:1790771166.470718:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896832 00000100:00100000:2.0:1790771166.470735:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897088 00000100:00100000:2.0:1790771166.470737:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897088 00000100:00100000:2.0:1790771166.470764:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533907456 00000100:00100000:2.0:1790771166.470767:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533907456 00000100:00100000:0.0:1790771166.470770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6060 00000100:00100000:0.0:1790771166.470781:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+83:14617:x1877759533907328:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771166.470787:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6061 00000100:00100000:2.0:1790771166.470809:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6062 00000100:00100000:2.0:1790771166.470817:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12242:x1877759533897088:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.470823:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.470826:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.470834:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.470840:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d5a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ae4 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470841:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.470849:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12252:x1877759533896832:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.470858:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:14617:x1877759533907328:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 77us (246us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.470866:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6060 00000004:00010000:1.0:1790771166.470868:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051766797 reply state 000000001b6bb0a9 transno 4294968728 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470870:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.470878:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.470884:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6063 00010000:00010000:1.0:1790771166.470886:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x0 (ffff8bfc3600d300) 00010000:00010000:3.0:1790771166.470887:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d5a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35add expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.470888:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470893:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.470896:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14527:x1877759533907456:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:1.0:1790771166.470897:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790771166.470902:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa8:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.470912:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.470915:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470921:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.470925:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.470941:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0c730 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355d5 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470945:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.470945:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.470946:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470969:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.470980:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00000004:00200000:2.0:1790771166.470984:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.470987:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.470991:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81000 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771166.470992:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.470994:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.470998:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.471006:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.471012:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.471015:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.471028:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d5a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.471037:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3600dc00) 00010000:00010000:1.0:1790771166.471040:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.471043:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 3/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.471046:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 118 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.471053:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d58b lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.471053:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.471058:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000004:00200000:3.0:1790771166.471062:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.471066:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.471071:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.471071:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996a00, rc 0) 00000004:00010000:1.0:1790771166.471081:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051766797 reply state 000000001b6bb0a9 transno 4294968728 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.471081:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.471086:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 129 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.471098:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:12242:x1877759533897088:12345-192.168.204.50@tcp:101:ls.0 Request processed in 279us (435us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.471106:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.471111:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.471119:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6062 00010000:00010000:1.0:1790771166.471121:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x510a92c1 (ffff8bfc3600d400) 00010000:00010000:3.0:1790771166.471122:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d5a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.471128:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.471131:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1790771166.471143:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 129 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.471150:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.471158:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 129 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.471168:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:14522:x1877759533906816:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 873us (1006us total) trans 4294968728 rc 0/0 00010000:00010000:3.0:1790771166.471171:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.471181:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:0.0:1790771166.471182:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539752832:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.471186:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6059 00010000:00010000:3.0:1790771166.471188:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a800, rc 0) 00000100:00100000:3.0:1790771166.471225:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:12252:x1877759533896832:12345-192.168.204.50@tcp:101:ls.0 Request processed in 427us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.471235:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6061 00000100:00100000:1.0:1790771166.471242:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.471246:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.471278:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.471295:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.471326:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533907840 00000100:00100000:2.0:1790771166.471332:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533907840 00000100:00100000:1.0:1790771166.471337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.471352:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908352 00000100:00100000:0.0:1790771166.471357:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908352 00000100:00100000:1.0:1790771166.471366:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.471370:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6064 00000100:00100000:2.0:1790771166.471379:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+84:11011:x1877759533907840:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1790771166.471388:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.471389:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908480 00000100:00100000:0.0:1790771166.471393:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908480 00000100:00100000:1.0:1790771166.471400:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.471403:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d5c3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bbd expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.471406:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1585 00000100:00100000:1.0:1790771166.471419:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533907968 00000100:00100000:1.0:1790771166.471425:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533907968 00000100:00100000:3.0:1790771166.471425:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11377c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13266:x1877759533908352:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.471432:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1586 00010000:00010000:2.0:1790771166.471442:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d5ca lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.471447:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:11955:x1877759533908480:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771166.471454:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533907712 00000100:00100000:1.0:1790771166.471458:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533907712 00010000:00010000:2.0:1790771166.471460:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d5ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.471468:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d5ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.471482:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 811 00000004:00200000:2.0:1790771166.471521:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa5:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.471524:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2399:x1877759533907968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00200000:2.0:1790771166.471526:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.471538:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.471549:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0d3c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aba expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.471554:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11377c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13266:x1877759533908352:12345-192.168.204.50@tcp:35:ls.0 Request processed in 133us (273us total) trans 4294969346 rc 0/0 00010000:00010000:2.0:1790771166.471559:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d5c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bbd expref: 86 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.471571:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.471579:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.471584:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1585 00010000:00010000:2.0:1790771166.471597:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e85800/0xfa0c505d97f0d5ca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa5:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bbd expref: 85 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.471606:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2399:x1877759533907968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.471607:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0x0 (ffff8bfc4205d900) 00010000:00010000:2.0:1790771166.471615:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00000100:00100000:1.0:1790771166.471619:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 811 00010000:00010000:2.0:1790771166.471620:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85800, rc 0) 00000100:00100000:3.0:1790771166.471626:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897344 00000100:00100000:3.0:1790771166.471631:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897344 00000100:00100000:1.0:1790771166.471639:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 812 00000100:00100000:1.0:1790771166.471652:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2399:x1877759533907712:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.471652:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:11011:x1877759533907840:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 271us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.471677:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6065 00010000:00010000:1.0:1790771166.471679:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.471686:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6064 00010000:00010000:1.0:1790771166.471692:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d3cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac1 expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.471693:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:12239:x1877759533897344:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.471708:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.471709:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.471713:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.471721:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d5d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35af2 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.471733:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2399:x1877759533907712:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.471740:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 812 00010000:00010000:3.0:1790771166.471750:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.471762:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.471764:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.471773:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.471788:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.471790:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.471800:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.471813:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.471817:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0d5d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.471830:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 117 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.471841:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:1.0:1790771166.471844:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908992 00010000:00010000:3.0:1790771166.471845:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.471850:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908992 00010000:00010000:3.0:1790771166.471850:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60200, rc 0) 00000100:00100000:1.0:1790771166.471881:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1587 00000100:00100000:1.0:1790771166.471890:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:12238:x1877759533908992:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.471920:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:12239:x1877759533897344:12345-192.168.204.50@tcp:101:ls.0 Request processed in 233us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.471926:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6065 00000100:00100000:3.0:1790771166.471942:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908736 00000100:00100000:3.0:1790771166.471945:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908736 00000100:00100000:2.0:1790771166.471982:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6066 00000100:00100000:1.0:1790771166.471987:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:12238:x1877759533908992:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (174us total) trans 4294969347 rc 0/0 00000100:00100000:2.0:1790771166.471993:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14760:x1877759533908736:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.471995:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1587 00010000:00010000:2.0:1790771166.472027:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472037:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 130 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472045:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472052:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 119 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.472059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.472067:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472072:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472078:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 119 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472084:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 9/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.472088:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908864 00000100:00100000:0.0:1790771166.472093:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908864 00010000:00010000:2.0:1790771166.472104:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 119 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472115:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 119 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.472128:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 813 00000100:00100000:0.0:1790771166.472139:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2396:x1877759533908864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.472144:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539752960:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.472148:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.472160:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d403 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358f3 expref: 131 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472170:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.472173:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.472182:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.472194:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2396:x1877759533908864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.472200:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 813 00010000:00010000:2.0:1790771166.472213:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472225:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 119 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.472237:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533897984 00000100:00100000:2.0:1790771166.472238:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753088:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.472242:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533897984 00000100:00100000:0.0:1790771166.472273:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6067 00000100:00100000:1.0:1790771166.472275:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.472284:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:12253:x1877759533897984:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.472292:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.472294:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 120 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472302:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0d5e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b00 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472311:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 120 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.472323:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533909248 00000100:00100000:2.0:1790771166.472327:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753216:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.472329:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533909248 00010000:00010000:0.0:1790771166.472331:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472342:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 6/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472348:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 4/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472357:0:13761:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 7/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.472364:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472377:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 121 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472387:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 121 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.472393:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1001 00000100:00100000:2.0:1790771166.472399:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753344:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.472405:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:14199:x1877759533909248:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771166.472413:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.472424:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.472425:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bcb expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472452:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 121 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.472461:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.472461:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753472:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.472474:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x11:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1790771166.472478:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.472482:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bcb expref: 30 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472523:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 129 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.472532:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.472534:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 129 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.472553:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 26 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.472559:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753600:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.472566:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539753728:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.472598:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.472607:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b780 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.474172:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.474196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.474212:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908224 00000100:00100000:2.0:1790771166.474218:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908224 00000100:00100000:3.0:1790771166.474229:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533909760 00000100:00100000:3.0:1790771166.474235:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533909760 00000100:00100000:2.0:1790771166.474261:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6068 00000100:00100000:3.0:1790771166.474271:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6069 00000100:00100000:2.0:1790771166.474277:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14478:x1877759533908224:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:3.0:1790771166.474286:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14717:x1877759533909760:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.474291:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.474296:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.474311:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d5fb lrc: 2/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35940 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474312:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d602 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35986 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474374:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d609 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474385:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474386:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d609 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474406:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d609 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474408:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.474435:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.474437:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474449:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474454:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474459:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474523:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d602 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35986 expref: 135 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474535:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669600/0xfa0c505d97f0d609 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35986 expref: 134 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.474541:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.474543:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.474545:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669600, rc 0) 00000100:00100000:3.0:1790771166.474574:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14717:x1877759533909760:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 293us (376us total) trans 4294969348 rc 0/0 00000100:00100000:3.0:1790771166.474579:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6069 00000004:00080000:2.0:1790771166.474693:0:13769:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x26:0x0], index 0: 0 00010000:00010000:2.0:1790771166.474767:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0d625 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474774:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0d625 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474779:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0d625 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474794:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474798:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474802:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474806:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474811:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.474813:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474817:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474823:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfc4205de00) 00010000:00010000:2.0:1790771166.474824:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.474827:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474830:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d610 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.474836:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008b30bb3d reply state 0000000024054b42 transno 4294969349 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474842:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474847:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0xdcc87686 (ffff8bfc4205d200) 00010000:00010000:2.0:1790771166.474848:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.474850:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.474862:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d5fb lrc: 0/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35940 expref: 135 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474872:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0d625 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35940 expref: 134 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.474881:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff8bfc4205d100) 00010000:00010000:2.0:1790771166.474882:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.474884:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ee00, rc 0) 00000100:00100000:2.0:1790771166.474911:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14478:x1877759533908224:12345-192.168.204.50@tcp:101:dd.0 Request processed in 643us (742us total) trans 4294969349 rc 0/0 00000100:00100000:2.0:1790771166.474916:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6068 00000100:00100000:1.0:1790771166.483392:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.483449:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533911168 00000100:00100000:2.0:1790771166.483458:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533911168 00000100:00100000:0.0:1790771166.483525:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.483525:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6070 00000100:00100000:2.0:1790771166.483541:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14072:x1877759533911168:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.483560:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.483563:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533898880 00000100:00100000:0.0:1790771166.483568:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.483570:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533898880 00010000:00010000:2.0:1790771166.483577:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d633 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35be7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.483599:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533912064 00000100:00100000:1.0:1790771166.483602:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533912064 00000100:00100000:0.0:1790771166.483615:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6071 00000100:00100000:0.0:1790771166.483625:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14864:x1877759533898880:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:1.0:1790771166.483634:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6072 00010000:00010000:2.0:1790771166.483634:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483639:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.483648:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:13887:x1877759533912064:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.483650:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483656:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d641 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b07 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.483671:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.483674:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.483683:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d648 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bfc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483705:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483711:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d656 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483714:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483732:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483734:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.483746:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.483748:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d656 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.483748:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.483787:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.483803:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.483823:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d648 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bfc expref: 69 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.483829:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.483843:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d641 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b07 expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.483844:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.483851:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.483852:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.483853:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910272 00010000:00010000:1.0:1790771166.483861:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0d648 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bfc expref: 70 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483872:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.483876:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81000, rc 0) 00010000:00010000:0.0:1790771166.483879:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d656 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b07 expref: 123 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483890:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483895:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.483900:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.483901:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.483907:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72e00, rc 0) 00000100:00100000:1.0:1790771166.483913:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:13887:x1877759533912064:12345-192.168.204.50@tcp:101:ls.0 Request processed in 266us (345us total) trans 4294968729 rc 301/301 00010000:00010000:2.0:1790771166.483914:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.483922:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6072 00010000:00010000:2.0:1790771166.483922:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483936:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.483945:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14864:x1877759533898880:12345-192.168.204.50@tcp:101:chown.0 Request processed in 322us (427us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.483949:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.483954:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6071 00010000:00010000:2.0:1790771166.483955:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.483960:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.483961:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910272 00010000:00010000:2.0:1790771166.483968:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d63a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.483973:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.483987:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483993:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.483998:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484002:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.484005:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484009:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.484012:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533896448 00000100:00100000:0.0:1790771166.484016:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539752320:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.484016:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc4205de00) 00000100:00100000:1.0:1790771166.484018:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533896448 00010000:00010000:2.0:1790771166.484024:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.484028:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484033:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d64f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.484047:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6073 00010000:00010000:0.0:1790771166.484052:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b2ef188/0xfa0c505d97f0d42d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b0e expref: 26 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.484057:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6074 00000100:00100000:3.0:1790771166.484062:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14657:x1877759533910272:12345-192.168.204.50@tcp:36:touch.0 00010000:00010000:2.0:1790771166.484069:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d633 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be7 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.484074:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12256:x1877759533896448:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.484082:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b2ef188/0xfa0c505d97f0d42d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b0e expref: 26 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484088:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.484090:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.484091:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.484092:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594a00, rc 0) 00010000:00010000:3.0:1790771166.484096:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.484099:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d633 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be7 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484101:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0d66b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ad6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.484114:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0cf5d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357cd expref: 135 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484117:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759533899008:12345-192.168.204.50@tcp:101:ln.0 Request processed in 28375us (28553us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.484118:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00000100:00100000:0.0:1790771166.484133:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 998 00010000:00010000:3.0:1790771166.484139:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff8bfb03218e00) 00010000:00010000:3.0:1790771166.484151:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.484152:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484153:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533909504 00000100:00100000:0.0:1790771166.484158:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533909504 00000100:00100000:2.0:1790771166.484161:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14072:x1877759533911168:12345-192.168.204.50@tcp:101:ls.0 Request processed in 619us (767us total) trans 4294968730 rc 301/301 00010000:00010000:1.0:1790771166.484170:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.484175:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6070 00000100:00100000:0.0:1790771166.484184:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533909888 00010000:00010000:1.0:1790771166.484185:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.484187:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484188:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533909888 00010000:00010000:3.0:1790771166.484208:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484217:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1002 00010000:00010000:3.0:1790771166.484218:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484229:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759533909504:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:2.0:1790771166.484235:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1003 00000100:00100000:2.0:1790771166.484250:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3db7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759533909888:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:1.0:1790771166.484278:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.484298:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533916928 00000100:00100000:1.0:1790771166.484301:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533916928 00002000:00010000:0.0:1790771166.484323:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790771166.484328:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:1.0:1790771166.484329:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6075 00002000:00010000:0.0:1790771166.484334:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.484340:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00000100:00100000:1.0:1790771166.484340:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+85:11011:x1877759533916928:12345-192.168.204.50@tcp:101:dir_create.sh.0 00002000:00010000:0.0:1790771166.484349:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x24:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771166.484354:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.484367:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0d680 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c7a expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484385:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2396:x1877759533909504:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 148us (637us total) trans 4294967615 rc 0/0 00000100:00100000:0.0:1790771166.484392:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1002 00010000:00010000:1.0:1790771166.484411:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,1 mode: --/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484420:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484427:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484445:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.484445:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000b8faadc reply state 00000000064949f5 transno 4294969350 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484462:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.484466:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484473:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484477:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.484482:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff8bfc1040fe00) 00010000:00010000:3.0:1790771166.484542:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.484544:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.484561:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.484592:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14657:x1877759533910272:12345-192.168.204.50@tcp:36:touch.0 Request processed in 536us (770us total) trans 4294969350 rc 0/0 00000100:00100000:2.0:1790771166.484604:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.484604:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6073 00000100:00100000:3.0:1790771166.484621:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918976 00000100:00100000:3.0:1790771166.484625:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918976 00000100:00100000:3.0:1790771166.484674:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6076 00000100:00100000:2.0:1790771166.484679:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.484700:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904384 00000100:00100000:2.0:1790771166.484705:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904384 00000100:00100000:2.0:1790771166.484735:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6077 00000100:00100000:0.0:1790771166.484739:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.484747:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14816:x1877759533904384:12345-192.168.204.50@tcp:101:ln.0 00000004:00080000:1.0:1790771166.484750:0:13763:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x18:0x0], index 1: 0 00000100:00100000:0.0:1790771166.484764:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.484785:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.484806:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.484814:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14320:x1877759533918976:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1790771166.484817:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.484825:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904640 00010000:00010000:3.0:1790771166.484826:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.484828:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0d695 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b7e expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484830:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904640 00010000:00010000:3.0:1790771166.484839:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0d69c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a7b expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484848:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d6a3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xaa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484856:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d6a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484857:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6078 00010000:00010000:2.0:1790771166.484867:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484868:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d6a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.484875:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14871:x1877759533904640:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771166.484890:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d6b1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484892:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.484896:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.484905:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.484914:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.484915:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d6bf lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b8c expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484916:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484917:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.484939:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484942:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484950:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.484953:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x9a:0x0]: returning size 5 00010000:00010000:1.0:1790771166.484955:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.484961:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.484965:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.484969:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484969:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484995:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0x0 (ffff8bfc4205d900) 00010000:00010000:2.0:1790771166.484998:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.484999:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.484999:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.485005:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0d69c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a7b expref: 139 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485006:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485026:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485028:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d687 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485036:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a7b expref: 138 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485051:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfc20109f00) 00010000:00010000:3.0:1790771166.485053:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000004:00010000:1.0:1790771166.485057:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb948625 reply state 0000000060dfb24d transno 4294968731 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485058:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485058:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669400, rc 0) 00010000:00010000:0.0:1790771166.485059:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485081:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485085:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.485089:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:14320:x1877759533918976:12345-192.168.204.50@tcp:101:cat.0 Request processed in 403us (525us total) trans 4294969351 rc 0/0 00010000:00010000:0.0:1790771166.485093:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485104:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0xd6e9df9d (ffff8bfc3600dc00) 00000100:00100000:3.0:1790771166.485110:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6076 00010000:00010000:1.0:1790771166.485113:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.485113:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485115:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485118:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.485124:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533904768 00000100:00100000:3.0:1790771166.485130:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533904768 00010000:00010000:1.0:1790771166.485139:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0d680 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c7a expref: 88 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.485154:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910656 00010000:00010000:1.0:1790771166.485155:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57800/0xfa0c505d97f0d6a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xaa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c7a expref: 87 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.485158:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910656 00000004:00200000:2.0:1790771166.485160:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790771166.485164:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.485169:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.485170:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xaa:0x0].0x0 (ffff8bfc3600d600) 00010000:00010000:0.0:1790771166.485176:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485177:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771166.485180:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6079 00010000:00010000:1.0:1790771166.485181:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57800, rc 0) 00000004:00010000:2.0:1790771166.485188:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485191:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.485196:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14780:x1877759533904768:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771166.485209:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485210:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:11011:x1877759533916928:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 871us (931us total) trans 4294968731 rc 0/0 00010000:00010000:3.0:1790771166.485211:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.485221:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d6f0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b93 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.485226:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa1:0x0]: returning size 0 00000100:00100000:1.0:1790771166.485228:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6075 00000004:00200000:0.0:1790771166.485234:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.485235:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485248:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.485251:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485251:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6080 00010000:00010000:3.0:1790771166.485262:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485265:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14070:x1877759533910656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.485272:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485274:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485281:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.485293:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d6fe lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35be0 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485295:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485297:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485318:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485320:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485332:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485340:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485342:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485353:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485364:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485365:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485365:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.485368:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485372:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485385:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.485397:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.485398:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.485404:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.485406:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.485413:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.485419:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485419:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.485426:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.485432:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485432:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485433:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d713 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485442:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d6fe lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 75 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485457:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d6aa lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485458:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d713 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485461:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.485465:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 74 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485471:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.485477:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485478:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485479:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d713 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485503:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:0.0:1790771166.485511:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0d6cd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485512:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.485517:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56200, rc 0) 00010000:00010000:2.0:1790771166.485524:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.485530:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x45:0x0]: returning size 5 00010000:00010000:2.0:1790771166.485531:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485534:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.485543:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d713 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485545:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14070:x1877759533910656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 282us (736us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.485554:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.485555:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485564:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485566:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6080 00010000:00010000:0.0:1790771166.485578:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485585:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485589:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485590:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910784 00010000:00010000:0.0:1790771166.485594:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.485596:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910784 00010000:00010000:0.0:1790771166.485600:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485605:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485620:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910912 00010000:00010000:0.0:1790771166.485621:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485625:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910912 00010000:00010000:3.0:1790771166.485626:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485639:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa5ec40c9 (ffff8bfc29009f00) 00010000:00010000:3.0:1790771166.485643:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485644:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533911296 00010000:00010000:2.0:1790771166.485645:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.485650:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533911296 00010000:00010000:2.0:1790771166.485652:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485678:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.485680:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d6c6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485683:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc3607aa00) 00010000:00010000:1.0:1790771166.485684:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485685:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485694:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.485701:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485707:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485717:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0d695 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 74 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485719:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0d6e2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485725:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.485728:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1672 00010000:00010000:3.0:1790771166.485733:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.485739:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.485743:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2398:x1877759533911296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.485748:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 73 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485752:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0d6f7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485758:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.485763:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0d6bf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.485770:0:8425:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 72 -> 136 00010000:00010000:2.0:1790771166.485773:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:3.0:1790771166.485775:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485781:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.485783:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485786:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996400, rc 0) 00010000:00010000:3.0:1790771166.485795:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.485796:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 73 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485808:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485815:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.485816:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14816:x1877759533904384:12345-192.168.204.50@tcp:101:ln.0 Request processed in 1068us (1157us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.485822:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:0.0:1790771166.485830:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.485835:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00010000:00010000:3.0:1790771166.485838:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.485839:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6077 00010000:00010000:3.0:1790771166.485842:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485848:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485850:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b68747c/0xfa0c505d97f0c4dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3564c expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485861:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x18618557 (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.485866:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.485868:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:14871:x1877759533904640:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 995us (1100us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.485869:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485870:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(5 8) 00000100:00100000:2.0:1790771166.485874:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 814 00010000:00010000:1.0:1790771166.485880:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(5 8) 00000100:00100000:2.0:1790771166.485891:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2399:x1877759533910784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.485892:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6078 00010000:00010000:3.0:1790771166.485892:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0d70c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.485895:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 27 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485905:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.485916:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 27 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485923:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d418 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358fa expref: 139 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485935:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0d6f0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b93 expref: 72 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.485936:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.485945:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.485946:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 27 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485957:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc029cbc00/0xfa0c505d97f0d713 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x45:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b93 expref: 71 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.485965:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x45:0x0].0x0 (ffff8bfb0321ad00) 00000100:00100000:1.0:1790771166.485966:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539753856:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.485969:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1790771166.485973:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:2399:x1877759533910784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (1496us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.485975:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc029cbc00, rc 0) 00000100:00100000:2.0:1790771166.485986:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 814 00000100:00100000:3.0:1790771166.486005:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14780:x1877759533904768:12345-192.168.204.50@tcp:101:ln.0 Request processed in 814us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.486013:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 815 00000100:00100000:3.0:1790771166.486021:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6079 00000100:00100000:1.0:1790771166.486030:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.486031:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2396:x1877759533910912:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.486034:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486047:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.486056:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533911552 00000100:00100000:1.0:1790771166.486061:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533911552 00010000:00010000:2.0:1790771166.486066:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0d3d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ec expref: 137 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486067:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:13782:1877759539752448:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.486080:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486094:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:1.0:1790771166.486095:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533913472 00000100:00100000:1.0:1790771166.486099:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533913472 00010000:00010000:2.0:1790771166.486101:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.486103:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 3/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486113:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.486124:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668c00, rc 0) 00000100:00100000:0.0:1790771166.486138:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.486139:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1673 00000100:00100000:2.0:1790771166.486140:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:2396:x1877759533910912:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 110us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.486151:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2397:x1877759533913472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.486156:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 815 00000100:00100000:3.0:1790771166.486161:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:14733:x1877759533904512:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 26985us (27050us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.486166:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.486174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.486180:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1000 00010000:00010000:1.0:1790771166.486181:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.486182:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533913600 00000100:00100000:2.0:1790771166.486190:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533913600 00010000:00010000:1.0:1790771166.486196:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486213:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ea595e3/0xfa0c505d97f0a197 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e349e9 expref: 31 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486215:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 136 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486221:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533911808 00000100:00100000:3.0:1790771166.486229:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533911808 00010000:00010000:1.0:1790771166.486230:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.486235:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.486240:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.486253:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1674 00010000:00010000:1.0:1790771166.486256:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.486268:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:2398:x1877759533913600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.486276:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 816 00010000:00010000:2.0:1790771166.486278:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.486279:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486289:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 136 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486291:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+72:2397:x1877759533911552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.486297:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539753984:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.486311:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.486325:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 136 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486329:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080180 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.486330:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0d488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b77 expref: 72 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486353:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 817 00010000:00010000:3.0:1790771166.486354:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:2.0:1790771166.486356:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771166.486359:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.486362:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486364:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533911808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.486378:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486379:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.486387:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759533911552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (356us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.486390:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486396:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d481 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b69 expref: 71 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486398:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 816 00010000:00010000:2.0:1790771166.486414:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.486416:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:1.0:1790771166.486421:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.486441:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:2398:x1877759533913600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 176us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.486447:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2397:x1877759533911808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.486454:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1674 00000100:00100000:1.0:1790771166.486463:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 817 00000100:00100000:2.0:1790771166.486546:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.486551:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0c8f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3567d expref: 135 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486565:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354a80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0000_UUID:6508:1877759539752576:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.486578:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533900672 00010000:00010000:1.0:1790771166.486583:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.486584:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533900672 00010000:00010000:1.0:1790771166.486593:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486598:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486617:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.486625:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6081 00010000:00010000:1.0:1790771166.486630:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.486636:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486638:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.486642:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:11954:x1877759533900672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.486654:0:6508:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 4/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486673:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.486675:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486686:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b2a expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.486688:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915392 00000100:00100000:3.0:1790771166.486693:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915392 00010000:00010000:2.0:1790771166.486710:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 126 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486721:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 126 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486728:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.486730:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.486732:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aec00, rc 0) 00000100:00100000:1.0:1790771166.486736:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.486746:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1588 00000100:00100000:2.0:1790771166.486756:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11954:x1877759533900672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 118us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.486757:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13998:x1877759533915392:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771166.486761:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905152 00000100:00100000:1.0:1790771166.486766:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905152 00000100:00100000:2.0:1790771166.486768:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6081 00000100:00100000:2.0:1790771166.486787:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6082 00000100:00100000:2.0:1790771166.486795:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14769:x1877759533905152:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:2.0:1790771166.486802:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.486811:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0d728 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ba1 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486820:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.486841:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486846:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486854:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486861:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486867:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486884:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.486896:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486907:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486918:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.486921:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:11955:x1877759533908480:12345-192.168.204.50@tcp:37:ls.0 Request processed in 15478us (15582us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.486929:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.486939:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1586 00000100:00100000:1.0:1790771166.486951:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.486966:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533902208 00000100:00100000:0.0:1790771166.486971:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533902208 00000100:00100000:1.0:1790771166.486975:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.486976:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486985:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.486993:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.486997:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915776 00000100:00100000:1.0:1790771166.487002:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.487003:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915776 00000004:00200000:2.0:1790771166.487019:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.487024:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.487027:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915648 00000100:00100000:0.0:1790771166.487031:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915648 00000004:00010000:2.0:1790771166.487039:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487049:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.487052:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487053:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533916032 00000100:00100000:0.0:1790771166.487058:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533916032 00010000:00010000:2.0:1790771166.487067:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.487081:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6083 00010000:00010000:2.0:1790771166.487083:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487091:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:11865:x1877759533902208:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.487094:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533916544 00010000:00010000:2.0:1790771166.487096:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487099:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533916544 00010000:00010000:0.0:1790771166.487101:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.487115:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b38 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487115:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aea00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.487124:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487128:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6084 00010000:00010000:0.0:1790771166.487136:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 126 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487141:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14530:x1877759533915776:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1790771166.487141:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.487158:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 126 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487162:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.487169:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.487169:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.487173:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.487173:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.487178:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594e00, rc 0) 00010000:00010000:2.0:1790771166.487184:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0d72f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487194:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487196:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11865:x1877759533902208:12345-192.168.204.50@tcp:101:ls.0 Request processed in 108us (380us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.487202:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487207:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487217:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.487218:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14530:x1877759533915776:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 79us (375us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771166.487223:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487226:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6083 00000100:00100000:1.0:1790771166.487236:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6084 00010000:00010000:2.0:1790771166.487236:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487248:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6085 00010000:00010000:2.0:1790771166.487252:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9b50d0cc (ffff8bfc29009500) 00010000:00010000:2.0:1790771166.487255:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.487258:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487263:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6086 00000100:00100000:0.0:1790771166.487264:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:14616:x1877759533915648:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:2.0:1790771166.487268:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0d736 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487279:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:14617:x1877759533916032:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771166.487288:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.487297:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d74b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c6c expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487307:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af000/0xfa0c505d97f0d728 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba1 expref: 71 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487323:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba1 expref: 70 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487329:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487332:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc29009200) 00010000:00010000:2.0:1790771166.487341:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.487342:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487344:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af400, rc 0) 00010000:00010000:1.0:1790771166.487354:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487368:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.487370:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14769:x1877759533905152:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 575us (634us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.487373:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.487378:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6087 00010000:00010000:1.0:1790771166.487383:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.487394:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6082 00000100:00100000:3.0:1790771166.487395:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14718:x1877759533916544:12345-192.168.204.50@tcp:55:truncate.0 00010000:00010000:0.0:1790771166.487397:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487400:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.487419:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.487426:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915264 00000100:00100000:2.0:1790771166.487430:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915264 00010000:00010000:3.0:1790771166.487432:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.487444:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 138 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487446:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.487452:0:13770:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969352 00000100:00100000:2.0:1790771166.487455:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915136 00000100:00100000:2.0:1790771166.487460:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915136 00010000:00010000:3.0:1790771166.487461:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 126 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487464:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.487473:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fc5b9245 reply state 00000000e8f593be transno 4294969353 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487475:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.487476:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487481:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.487516:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00010000:00010000:0.0:1790771166.487527:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.487531:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.487547:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.487550:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.487551:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 127 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.487552:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.487552:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915520 00000100:00100000:0.0:1790771166.487556:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.487560:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915520 00010000:00010000:1.0:1790771166.487569:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.487575:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 127 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487578:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487595:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487597:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14616:x1877759533915648:12345-192.168.204.50@tcp:36:cp.0 Request processed in 339us (732us total) trans 4294969353 rc 0/0 00000100:00100000:2.0:1790771166.487597:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533916288 00000100:00100000:3.0:1790771166.487600:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539754112:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.487604:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533916288 00010000:00010000:1.0:1790771166.487614:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339c00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.487618:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6085 00010000:00010000:1.0:1790771166.487619:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771166.487623:0:13770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.487626:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487629:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 142 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487638:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.487642:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.487645:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487651:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d752 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.487670:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487677:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.487679:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1675 00010000:00010000:3.0:1790771166.487683:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.487693:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539752832:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.487695:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.487695:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2398:x1877759533915136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.487711:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487714:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.487714:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539754240:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.487718:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487721:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.487726:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487728:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.487738:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffa80 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.487748:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487753:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 127 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487761:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x59d92b11 (ffff8bfb03218800) 00000100:00100000:3.0:1790771166.487761:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533915904 00010000:00010000:1.0:1790771166.487768:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.487768:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:3.0:1790771166.487768:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533915904 00010000:00010000:1.0:1790771166.487773:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487776:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487785:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d759 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487788:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.487794:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (536576->540671) req@ffff8bfb05c36300 x1877759533915904/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.487798:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487810:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d74b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c6c expref: 90 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.487816:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.487820:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c36300 with x1877759533915904 ext(536576->540671) 00002000:00010000:3.0:1790771166.487829:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c36300 00010000:00010000:2.0:1790771166.487837:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.487841:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c6c expref: 89 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.487847:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:1.0:1790771166.487850:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.487852:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00000100:00100000:3.0:1790771166.487857:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 416 00000100:00100000:2.0:1790771166.487863:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2398:x1877759533915136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.487867:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.487871:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533915904:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771166.487877:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:14617:x1877759533916032:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 601us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.487885:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1675 00000100:00100000:1.0:1790771166.487890:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6086 00000100:00100000:2.0:1790771166.487922:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1676 00000100:00100000:1.0:1790771166.487923:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917184 00000100:00100000:1.0:1790771166.487929:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917184 00000100:00100000:2.0:1790771166.487935:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2396:x1877759533916288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.487946:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.487951:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 142 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487959:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1589 00010000:00010000:2.0:1790771166.487964:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 142 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.487972:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13264:x1877759533917184:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.487980:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0d09f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x85:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a12 expref: 142 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.487985:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533915904:12345-192.168.204.50@tcp:3:cat.0 Request processed in 115us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.487998:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 416 00010000:00010000:2.0:1790771166.487999:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:2.0:1790771166.488004:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.488006:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (536576->540671) req@ffff8bfb05c36300 x1877759533915904/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.488010:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.488019:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488024:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488029:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488035:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488045:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.488059:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.488060:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13264:x1877759533917184:12345-192.168.204.50@tcp:35:ls.0 Request processed in 89us (193us total) trans 4294969354 rc 0/0 00002000:00100000:3.0:1790771166.488063:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c36300 with x1877759533915904 ext(536576->540671) 00002000:00010000:3.0:1790771166.488070:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c36300 00000100:00100000:1.0:1790771166.488073:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1589 00000100:00100000:2.0:1790771166.488084:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2396:x1877759533916288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 149us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.488092:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1676 00000100:00100000:1.0:1790771166.488105:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917952 00000100:00100000:1.0:1790771166.488109:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917952 00000100:00100000:2.0:1790771166.488113:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917696 00000100:00100000:2.0:1790771166.488119:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917696 00000100:00100000:3.0:1790771166.488129:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 818 00000100:00100000:0.0:1790771166.488134:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.488140:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.488141:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6088 00000100:00100000:3.0:1790771166.488146:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2398:x1877759533915264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.488157:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14358:x1877759533917952:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:3.0:1790771166.488161:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.488167:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.488176:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917440 00010000:00010000:3.0:1790771166.488177:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0d55a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35908 expref: 140 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488180:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917440 00010000:00010000:1.0:1790771166.488183:0:13763:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.488201:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.488202:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 128 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488203:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f064e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e333c3 expref: 128 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488206:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.488210:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.488232:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2398:x1877759533915264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (1306us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.488235:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8bfc1ae7ff00) 00000100:00100000:2.0:1790771166.488237:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917824 00010000:00010000:1.0:1790771166.488242:0:13763:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.488242:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917824 00010000:00010000:1.0:1790771166.488257:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488257:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 818 00010000:00010000:2.0:1790771166.488261:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 128 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488280:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 138 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488288:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 138 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488290:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918080 00000100:00100000:2.0:1790771166.488296:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918080 00010000:00010000:1.0:1790771166.488301:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 138 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488302:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1677 00000100:00100000:0.0:1790771166.488310:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.488320:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+89:2396:x1877759533917696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.488322:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 129 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488323:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 138 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488328:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.488346:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 138 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488347:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.488358:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488359:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918208 00000100:00100000:2.0:1790771166.488364:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918208 00010000:00010000:1.0:1790771166.488367:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 129 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488370:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918336 00000100:00100000:0.0:1790771166.488376:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918336 00010000:00010000:1.0:1790771166.488377:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 10/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488381:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 131 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488401:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 131 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488408:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1590 00000100:00100000:2.0:1790771166.488410:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1678 00010000:00010000:1.0:1790771166.488422:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 131 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488423:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11374450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14376:x1877759533918336:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1790771166.488427:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2398:x1877759533917440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.488443:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.488446:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754368:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.488451:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 131 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488461:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 131 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488471:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488473:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.488480:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488482:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488515:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 131 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488517:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.488536:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35880 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754496:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.488537:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488542:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488557:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488566:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.488567:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f07384 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x40:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33774 expref: 89 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488574:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11374450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14376:x1877759533918336:12345-192.168.204.50@tcp:35:cat.0 Request processed in 152us (231us total) trans 4294969355 rc 0/0 00010000:00010000:1.0:1790771166.488575:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 138 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488587:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00000100:00100000:0.0:1790771166.488594:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1590 00000100:00100000:2.0:1790771166.488594:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533917440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (460us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.488596:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488601:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 138 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488618:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1678 00010000:00010000:3.0:1790771166.488618:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.488626:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c37800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754624:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.488631:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488649:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1679 00010000:00010000:3.0:1790771166.488655:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.488656:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 138 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488677:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2398:x1877759533917824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.488684:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.488691:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:2396:x1877759533917696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 375us (683us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.488695:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 138 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488695:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.488706:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 130 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488708:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1677 00000100:00100000:1.0:1790771166.488720:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c34380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754752:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.488725:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 130 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488735:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1680 00010000:00010000:2.0:1790771166.488738:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.488745:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488746:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533918080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.488749:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.488753:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 138 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488761:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.488766:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488769:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533903488 00010000:00010000:3.0:1790771166.488771:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 130 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488774:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 138 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488776:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533903488 00010000:00010000:2.0:1790771166.488784:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488795:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905024 00000100:00100000:0.0:1790771166.488801:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905024 00010000:00010000:2.0:1790771166.488803:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.488804:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c37100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.488815:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.488816:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6089 00010000:00010000:3.0:1790771166.488820:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 132 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.488829:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:11864:x1877759533903488:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.488835:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 138 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488835:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:2.0:1790771166.488838:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533917824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 178us (674us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.488840:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.488844:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.488852:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b62 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488859:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1679 00010000:00010000:1.0:1790771166.488864:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 138 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.488867:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.488887:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1681 00010000:00010000:3.0:1790771166.488888:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.488891:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.488893:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539755008:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.488905:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533918208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.488908:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.488915:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 4/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.488923:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.488925:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.488930:0:13783:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0d5ae) 00010000:00010000:2.0:1790771166.488933:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.488938:0:13770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.488945:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 138 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488947:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759533918080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 204us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.488955:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533918208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 54us (647us total) trans 0 rc 116/116 00010000:00010000:1.0:1790771166.488967:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 138 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.488968:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1680 00000100:00100000:2.0:1790771166.488978:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1681 00000100:00100000:3.0:1790771166.488989:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 819 00000100:00100000:1.0:1790771166.488996:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c36680 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539755136:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.488997:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489003:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:2398:x1877759533915520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.489016:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6090 00010000:00010000:3.0:1790771166.489017:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.489018:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:1.0:1790771166.489020:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060803c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.489025:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.489029:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:11804:x1877759533905024:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.489030:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489031:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0d56f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3591d expref: 138 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489045:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.489051:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687200, rc 0) 00000100:00100000:1.0:1790771166.489057:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.489059:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.489060:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b9a expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489066:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.489073:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11864:x1877759533903488:12345-192.168.204.50@tcp:101:ls.0 Request processed in 247us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.489080:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6089 00010000:00010000:2.0:1790771166.489084:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 131 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489089:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2398:x1877759533915520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 89us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.489097:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533905280 00000100:00100000:0.0:1790771166.489101:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533905280 00010000:00010000:2.0:1790771166.489103:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 130 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489105:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 819 00000100:00100000:1.0:1790771166.489115:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d355c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539753728:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.489118:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.489124:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.489128:0:13762:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.489136:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6091 00010000:00010000:1.0:1790771166.489139:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bcb expref: 30 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489139:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af600, rc 0) 00000100:00100000:0.0:1790771166.489149:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:12240:x1877759533905280:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.489158:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80e00, rc 0) 00010000:00010000:0.0:1790771166.489159:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.489168:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11804:x1877759533905024:12345-192.168.204.50@tcp:101:ls.0 Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.489178:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6090 00010000:00010000:0.0:1790771166.489181:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ba8 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.489182:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:14199:x1877759533909248:12345-192.168.204.50@tcp:101:cat.0 Request processed in 16779us (16910us total) trans 0 rc 0/0 00000001:00080000:3.0:1790771166.489191:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967618 is committed 00000100:00100000:1.0:1790771166.489200:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1001 00000001:00080000:3.0:1790771166.489202:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967616 is committed 00010000:00010000:0.0:1790771166.489212:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 131 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489218:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489223:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 131 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489231:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489235:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.489241:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.489244:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.489246:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489252:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687400, rc 0) 00000100:00100000:0.0:1790771166.489274:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:12240:x1877759533905280:12345-192.168.204.50@tcp:101:ls.0 Request processed in 129us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.489280:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6091 00000100:00100000:1.0:1790771166.489301:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.489308:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539752960:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.489328:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0d5b5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35add expref: 130 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489346:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069eaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753088:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.489359:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2396:x1877759533909888:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 5114us (5571us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.489368:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1003 00010000:00010000:3.0:1790771166.489368:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0d5ae lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ae4 expref: 129 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489389:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753216:192.168.204.50@tcp:104: 00000004:00200000:2.0:1790771166.489407:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x40:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.489416:0:13764:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000077c9ee6a x1877759539753344) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489420:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489434:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489436:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d545 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ac8 expref: 128 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489446:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489453:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.489457:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489458:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753344:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.489469:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489482:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x40:0x0].0x0 (ffff8bfb0321eb00) 00010000:00010000:3.0:1790771166.489482:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0d2b3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a82 expref: 127 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489506:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771166.489509:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 2/0,0 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489525:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0d37e lrc: 0/0,0 mode: --/EX res: [0x240000402:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489535:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753472:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.489554:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539753600:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.489560:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489576:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489583:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489588:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489596:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.489601:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489602:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489602:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.489611:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489620:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489628:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489632:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489650:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489654:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.489655:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489674:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.489679:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489680:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.489681:0:6493:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969345 00010000:00010000:2.0:1790771166.489695:0:13767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489703:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 4/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.489705:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000079ea7155 reply state 00000000878b1450 transno 4294969356 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489715:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918464 00010000:00010000:1.0:1790771166.489721:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489721:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918464 00010000:00010000:2.0:1790771166.489727:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489729:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771166.489737:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.489741:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 138 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489742:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0d362 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489743:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489765:0:6493:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489770:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.489773:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009b622c07 reply state 00000000f73d29b4 transno 4294968732 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489774:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.489785:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.489794:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489797:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489798:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.489816:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489817:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc3607a700) 00000004:00200000:0.0:1790771166.489822:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.489825:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:0.0:1790771166.489828:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.489829:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1790771166.489845:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489851:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918720 00010000:00010000:0.0:1790771166.489854:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489859:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489874:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.489877:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13894:x1877759533898368:12345-192.168.204.50@tcp:36:rm.0 Request processed in 50157us (50245us total) trans 4294968732 rc 0/0 00010000:00010000:0.0:1790771166.489880:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.489886:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489888:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918720 00000100:00100000:2.0:1790771166.489894:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6035 00010000:00010000:0.0:1790771166.489896:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489905:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 127 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489908:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.489916:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.489920:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489925:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0d4e3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.489933:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1682 00010000:00010000:0.0:1790771166.489935:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489943:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1683 00000100:00100000:2.0:1790771166.489945:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:2396:x1877759533918464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.489947:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489959:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.489960:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2396:x1877759533918720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.489961:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.489968:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.489972:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 138 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.489973:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489977:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.489990:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.489990:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 127 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.489996:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 138 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.490013:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xf7a5b27a (ffff8bfc4205d300) 00000040:00080000:1.0:1790771166.490017:0:6508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].42, 64 off11480 00010000:00010000:0.0:1790771166.490020:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.490025:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490028:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 127 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.490033:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0d4f8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490062:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0cf25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35978 expref: 138 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490069:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0d5d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af2 expref: 128 pid: 12030 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.490074:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0d4d5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b4d expref: 71 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490078:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490083:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.490094:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490103:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490108:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.490111:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b4d expref: 70 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490115:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490129:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490137:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.490140:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:0.0:1790771166.490145:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.490147:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490148:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.490149:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00010000:00010000:2.0:1790771166.490168:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490169:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.490183:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14827:x1877759533902848:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 30399us (31296us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.490185:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490192:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771166.490202:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1790771166.490203:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6052 00010000:00010000:3.0:1790771166.490204:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.490207:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490211:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490225:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d71a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x85:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490226:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490244:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490250:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1790771166.490251:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be4957c5 reply state 000000000c7c612a transno 4294969357 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490262:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490263:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.490271:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2396:x1877759533918720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 316us (969us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.490275:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.490279:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1790771166.490280:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1683 00000100:00100000:1.0:1790771166.490284:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.490292:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.490298:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:2396:x1877759533918464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 354us (1054us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.490304:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490314:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.490314:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1682 00010000:00010000:1.0:1790771166.490324:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.490329:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490336:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490349:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.490352:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.490356:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490361:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490365:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d4ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490379:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.490389:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be4957c5 reply state 000000000c7c612a transno 4294969357 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490398:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490403:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc3600d100) 00010000:00010000:1.0:1790771166.490406:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.490408:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1790771166.490411:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be4957c5 reply state 000000000c7c612a transno 4294969357 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490418:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490423:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc3600d000) 00010000:00010000:1.0:1790771166.490425:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.490427:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1790771166.490438:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490445:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490452:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490458:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010080000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490458:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.490470:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14527:x1877759533907456:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 19576us (19762us total) trans 4294969356 rc -2/-2 00010000:00010000:1.0:1790771166.490480:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490480:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490517:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490523:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.490528:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490541:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.490547:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6063 00010000:00010000:1.0:1790771166.490548:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x50010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.490555:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.490568:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.490573:0:6508:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.490574:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.490580:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490588:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490594:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490603:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490611:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.490612:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14325:x1877759533904896:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 30905us (31154us total) trans 4294969357 rc 0/0 00000100:00100000:1.0:1790771166.490628:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 37 00010000:00010000:2.0:1790771166.490628:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490656:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.490678:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490679:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 2/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490692:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5000 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.490695:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d5df lrc: 0/0,0 mode: --/EX res: [0x200000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490697:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490710:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490723:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:1.0:1790771166.490725:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771166.490728:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490733:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d791 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x85:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490738:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490745:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490747:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.490748:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.490752:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.490756:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.490758:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.490762:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.490766:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.490777:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.490794:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0d5e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b00 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.490807:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.490809:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b00 expref: 127 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.490812:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.490819:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.490822:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.490824:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caee00, rc 0) 00000004:00010000:3.0:1790771166.490825:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490845:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0d66b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ad6 expref: 128 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.490862:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:12253:x1877759533897984:12345-192.168.204.50@tcp:101:ls.0 Request processed in 18576us (18677us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.490862:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ad6 expref: 127 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.490879:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771166.490884:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1790771166.490885:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6067 00010000:00010000:3.0:1790771166.490889:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00000100:00100000:3.0:1790771166.490915:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:12256:x1877759533896448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 6846us (6945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.490921:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6074 00000100:00100000:2.0:1790771166.490942:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14760:x1877759533908736:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 18949us (19184us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771166.490952:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6066 00000100:00100000:3.0:1790771166.491342:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.491376:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533919232 00000100:00100000:2.0:1790771166.491381:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533919232 00002000:00100000:2.0:1790771166.491399:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (0->4) req@ffff8bfc3d8aaa00 x1877759533919232/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 496/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dir_create.sh.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.491406:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aaa00 with x1877759533919232 ext(0->4) 00010000:00010000:2.0:1790771166.491412:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.491420:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 27 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.491425:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3d8aaa00 00000100:00100000:2.0:1790771166.491443:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 96 00000100:00100000:2.0:1790771166.491448:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2398:x1877759533919232:12345-192.168.204.50@tcp:4:dir_create.sh.0 00000100:00100000:2.0:1790771166.491857:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2398:x1877759533919232:12345-192.168.204.50@tcp:4:dir_create.sh.0 Request processed in 406us (512us total) trans 4294967616 rc 0/0 00000100:00100000:2.0:1790771166.491866:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 96 00002000:00100000:2.0:1790771166.491874:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x11:0x0] (0->4) req@ffff8bfc3d8aaa00 x1877759533919232/t4294967616(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:267/0 lens 496/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:H/600/0 rc 0/0 job:'dir_create.sh.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.491884:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d8aaa00 with x1877759533919232 ext(0->4) 00010000:00010000:2.0:1790771166.491892:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 29 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.491910:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 29 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.491917:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3d8aaa00 00000100:00100000:1.0:1790771166.492164:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.492204:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533912320 00000100:00100000:2.0:1790771166.492210:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533912320 00000100:00100000:3.0:1790771166.492233:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.492254:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533919360 00000100:00100000:2.0:1790771166.492260:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533919360 00000100:00100000:0.0:1790771166.492275:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6092 00000100:00100000:1.0:1790771166.492286:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6093 00000100:00100000:0.0:1790771166.492293:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13883:x1877759533912320:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.492299:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14694:x1877759533919360:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.492311:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.492324:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d798 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c03 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492326:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.492341:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0cd50 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35932 expref: 72 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492351:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.492354:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.492363:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.492372:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.492373:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 87 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492383:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 71 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492393:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 5/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492411:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 72 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.492418:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 72 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.492423:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d798 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c03 expref: 72 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.492432:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539755264:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.492447:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.492449:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.492454:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d798 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c03 expref: 72 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.492462:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687000, rc 0) 00010000:00010000:1.0:1790771166.492504:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 87 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.492517:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13883:x1877759533912320:12345-192.168.204.50@tcp:101:ls.0 Request processed in 227us (349us total) trans 4294968733 rc 301/301 00010000:00010000:1.0:1790771166.492517:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 87 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.492534:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539755392:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.492549:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6092 00000100:00100000:1.0:1790771166.492575:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.495298:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.495365:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533912576 00000100:00100000:0.0:1790771166.495371:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533912576 00000100:00100000:0.0:1790771166.495404:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6094 00000100:00100000:0.0:1790771166.495411:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13888:x1877759533912576:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.495420:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.495427:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d7ad lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c0a expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.495467:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d7b4 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.495475:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d7b4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.495481:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d7b4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.495517:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.495566:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0d7ad lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c0a expref: 74 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.495577:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d7b4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c0a expref: 73 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.495582:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.495584:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.495586:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00000100:00100000:0.0:1790771166.495613:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:13888:x1877759533912576:12345-192.168.204.50@tcp:101:ls.0 Request processed in 203us (317us total) trans 4294968734 rc 0/0 00000100:00100000:0.0:1790771166.495618:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6094 00000100:00100000:2.0:1790771166.496388:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.496423:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.496444:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.496459:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533906304 00000100:00100000:0.0:1790771166.496465:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533906304 00000100:00100000:2.0:1790771166.496470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.496516:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533919616 00000100:00100000:1.0:1790771166.496522:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533919616 00000100:00100000:0.0:1790771166.496528:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920128 00000100:00100000:0.0:1790771166.496532:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920128 00000100:00100000:0.0:1790771166.496559:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6095 00000100:00100000:1.0:1790771166.496564:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533919872 00000100:00100000:0.0:1790771166.496569:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:11807:x1877759533906304:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.496569:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533919872 00010000:00010000:0.0:1790771166.496580:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.496591:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35baf expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.496601:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1591 00010000:00010000:0.0:1790771166.496614:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.496614:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14554:x1877759533919616:12345-192.168.204.50@tcp:49:setfattr.0 00000100:00100000:2.0:1790771166.496614:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1592 00010000:00010000:0.0:1790771166.496631:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.496635:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14072:x1877759533919872:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.496649:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.496652:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.496654:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.496676:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687600, rc 0) 00000100:00100000:1.0:1790771166.496692:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14554:x1877759533919616:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 83us (266us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.496699:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1591 00000100:00100000:0.0:1790771166.496707:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11807:x1877759533906304:12345-192.168.204.50@tcp:101:ls.0 Request processed in 138us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.496714:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6095 00000100:00100000:0.0:1790771166.496737:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6096 00000100:00100000:0.0:1790771166.496746:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14786:x1877759533920128:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:2.0:1790771166.496772:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+75:14072:x1877759533919872:12345-192.168.204.50@tcp:35:ls.0 Request processed in 143us (325us total) trans 4294968735 rc 0/0 00000100:00100000:2.0:1790771166.496779:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1592 00000100:00100000:0.0:1790771166.496831:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14786:x1877759533920128:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 87us (362us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.496838:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6096 00000100:00100000:2.0:1790771166.497142:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13998:x1877759533915392:12345-192.168.204.50@tcp:37:ls.0 Request processed in 10389us (10524us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.497148:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1588 00000100:00100000:1.0:1790771166.498133:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.498155:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.498171:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.498184:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920256 00000100:00100000:3.0:1790771166.498191:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920256 00000100:00100000:1.0:1790771166.498196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.498198:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920384 00000100:00100000:2.0:1790771166.498205:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920384 00000100:00100000:0.0:1790771166.498217:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920512 00000100:00100000:0.0:1790771166.498224:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920512 00000100:00100000:1.0:1790771166.498224:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.498243:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920640 00000100:00100000:2.0:1790771166.498248:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920640 00000100:00100000:3.0:1790771166.498251:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1004 00000100:00100000:0.0:1790771166.498263:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6097 00000100:00100000:3.0:1790771166.498268:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2398:x1877759533920256:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:0.0:1790771166.498277:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:14908:x1877759533920384:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.498281:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.498286:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.498297:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533912704 00010000:00010000:3.0:1790771166.498297:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0d7c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c96 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.498304:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533912704 00010000:00010000:0.0:1790771166.498315:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.498326:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.498333:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.498334:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d356a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539753856:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.498345:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6098 00000100:00100000:3.0:1790771166.498348:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539755520:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.498352:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.498359:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:14657:x1877759533920512:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:2.0:1790771166.498370:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.498382:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0d7d7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x9f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c9d expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.498383:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:2398:x1877759533911296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 12642us (13648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.498400:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1672 00000100:00100000:3.0:1790771166.498404:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc078de000 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.498428:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6099 00000004:00010000:0.0:1790771166.498431:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000001edbfdd reply state 00000000c789548a transno 4294969358 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.498433:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0d7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c9d expref: 141 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.498441:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14944:x1877759533920640:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.498453:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.498456:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.498464:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af000/0xfa0c505d97f0d7d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x9f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c9d expref: 141 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.498465:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771166.498469:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d7de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ca4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.498471:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.498475:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.498516:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6100 00010000:00010000:2.0:1790771166.498521:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff8bfc1040fe00) 00000100:00100000:1.0:1790771166.498526:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:14768:x1877759533912704:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.498529:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771166.498534:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af000, rc 0) 00010000:00010000:1.0:1790771166.498535:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.498540:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:14908:x1877759533920384:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 266us (382us total) trans 4294969358 rc 0/0 00000100:00100000:0.0:1790771166.498547:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6097 00010000:00010000:1.0:1790771166.498548:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d7e5 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c11 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.498568:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:14657:x1877759533920512:12345-192.168.204.50@tcp:101:touch.0 Request processed in 212us (393us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.498569:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.498581:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ca4 expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.498588:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.498589:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6098 00010000:00010000:1.0:1790771166.498606:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.498610:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d7de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ca4 expref: 141 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.498633:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771166.498635:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920768 00010000:00010000:3.0:1790771166.498637:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.498640:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920768 00000100:00100000:0.0:1790771166.498682:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1593 00010000:00010000:3.0:1790771166.498685:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c38c00, rc 0) 00000100:00100000:0.0:1790771166.498690:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14070:x1877759533920768:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771166.498708:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d7e5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 77 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.498722:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 76 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.498728:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.498731:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771166.498733:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5600, rc 0) 00000100:00100000:2.0:1790771166.498755:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14944:x1877759533920640:12345-192.168.204.50@tcp:101:ln.0 Request processed in 317us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.498763:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6099 00000100:00100000:1.0:1790771166.498768:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:14768:x1877759533912704:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 240us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.498775:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6100 00000100:00100000:2.0:1790771166.499555:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.499590:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533912960 00000100:00100000:1.0:1790771166.499596:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533912960 00000100:00100000:1.0:1790771166.499624:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6101 00000100:00100000:1.0:1790771166.499631:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:13886:x1877759533912960:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.499640:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.499648:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d7f3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c18 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.499707:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d7fa lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.499715:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d7fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.499721:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d7fa lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.499728:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.499770:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d7f3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c18 expref: 80 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.499780:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d7fa lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c18 expref: 79 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.499785:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.499787:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.499789:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5800, rc 0) 00000100:00100000:1.0:1790771166.499816:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:13886:x1877759533912960:12345-192.168.204.50@tcp:101:ls.0 Request processed in 186us (266us total) trans 4294968736 rc 0/0 00000100:00100000:1.0:1790771166.499821:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6101 00000100:00100000:2.0:1790771166.500188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.500218:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917312 00000100:00100000:0.0:1790771166.500223:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917312 00000100:00100000:0.0:1790771166.500248:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6102 00000100:00100000:0.0:1790771166.500253:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14068:x1877759533917312:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.500261:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.500269:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0d808 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c1f expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.500305:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0d80f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.500316:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0d80f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.500322:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0d80f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.500327:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.500364:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0d808 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c1f expref: 82 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.500374:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0d80f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c1f expref: 81 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.500379:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.500381:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.500383:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687a00, rc 0) 00000100:00100000:0.0:1790771166.500408:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+81:14068:x1877759533917312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 155us (220us total) trans 4294968737 rc 0/0 00000100:00100000:0.0:1790771166.500412:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6102 00000100:00100000:0.0:1790771166.500540:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.500558:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.500574:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533920896 00000100:00100000:2.0:1790771166.500581:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533920896 00000100:00100000:1.0:1790771166.500593:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533921024 00000100:00100000:1.0:1790771166.500600:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533921024 00000100:00100000:0.0:1790771166.500617:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.500630:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1005 00000100:00100000:1.0:1790771166.500638:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6103 00000100:00100000:2.0:1790771166.500645:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:11011:x1877759533920896:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:3.0:1790771166.500650:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539753984:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771166.500652:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14660:x1877759533921024:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:2.0:1790771166.500673:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.500687:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000218ce2eb/0xfa0c505d97f0d81d lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cab expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.500689:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.500697:0:13770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1790771166.500705:0:12031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790771166.500714:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0cd73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e356fb expref: 141 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.500718:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=166s v=(0 0) 00010000:00010000:2.0:1790771166.500726:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771166.500731:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:3.0:1790771166.500733:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759533913472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 14580us (14653us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.500736:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000218ce2eb/0xfa0c505d97f0d81d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cab expref: 22 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.500738:0:13770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.500750:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.500756:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1673 00010000:00010000:2.0:1790771166.500758:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000218ce2eb/0xfa0c505d97f0d81d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cab expref: 22 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.500783:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af800, rc 0) 00010000:00010000:1.0:1790771166.500784:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 123 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.500793:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.500798:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.500809:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d805880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:11011:x1877759533920896:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 169us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.500817:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1005 00010000:00010000:1.0:1790771166.500820:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.500821:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533921536 00000100:00100000:3.0:1790771166.500827:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533921536 00010000:00010000:1.0:1790771166.500833:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 140 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.500843:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539755648:192.168.204.50@tcp:104: 00002000:00010000:3.0:1790771166.500848:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/35 (28314->18446744073709551615) 00002000:00100000:3.0:1790771166.500853:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d804a80 with x1877759533921536 ext(28314->18446744073709551615) 00002000:00010000:3.0:1790771166.500860:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d804a80. 00000100:00100000:2.0:1790771166.500869:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.500887:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 417 00000100:00100000:3.0:1790771166.500897:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759533921536:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:1.0:1790771166.500902:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 123 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.500911:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 123 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.500919:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539755776:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.500941:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080180 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.500947:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.500991:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533921152 00000100:00100000:1.0:1790771166.500995:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533921152 00000100:00100000:1.0:1790771166.501029:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 418 00000100:00100000:1.0:1790771166.501037:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2398:x1877759533921152:12345-192.168.204.50@tcp:22:fallocate.0 00002000:00010000:3.0:1790771166.501135:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 37366 -> 28314 00002000:00010000:3.0:1790771166.501138:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 0 -> 1790771166 00002000:00010000:3.0:1790771166.501141:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.501143:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.501145:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 32 -> 8 00000100:00100000:3.0:1790771166.501181:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2396:x1877759533921536:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 286us (564us total) trans 4294967617 rc 0/0 00000100:00100000:3.0:1790771166.501188:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 417 00002000:00010000:3.0:1790771166.501191:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/35 (28314->18446744073709551615) 00002000:00010000:1.0:1790771166.501192:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 76520 -> 76520 00002000:00100000:3.0:1790771166.501197:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3d804a80 with x1877759533921536 ext(28314->18446744073709551615) 00002000:00010000:1.0:1790771166.501198:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:1.0:1790771166.501204:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 1790771160 -> 0 00002000:00010000:1.0:1790771166.501206:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.501207:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3d804a80. 00002000:00010000:1.0:1790771166.501209:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 136 -> 120 00000100:00100000:1.0:1790771166.501237:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2398:x1877759533921152:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 201us (292us total) trans 4294967618 rc 0/0 00000100:00100000:1.0:1790771166.501244:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 418 00000100:00100000:3.0:1790771166.501246:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533921280 00000100:00100000:3.0:1790771166.501253:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533921280 00000100:00100000:0.0:1790771166.501269:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:14070:x1877759533920768:12345-192.168.204.50@tcp:37:ls.0 Request processed in 2578us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.501276:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1593 00000100:00100000:3.0:1790771166.501376:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 820 00000100:00100000:3.0:1790771166.501386:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2398:x1877759533921280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.501396:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.501408:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669400/0xfa0c505d97f0d6b1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a7b expref: 141 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.501419:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfc20109f00) 00010000:00010000:3.0:1790771166.501422:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.501445:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2398:x1877759533921280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 62us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.501450:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 820 00000100:00100000:2.0:1790771166.502181:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.502232:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.502251:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533909120 00000100:00100000:2.0:1790771166.502252:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.502258:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533909120 00000100:00100000:3.0:1790771166.502284:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533921408 00000100:00100000:2.0:1790771166.502289:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.502291:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533921408 00000100:00100000:0.0:1790771166.502294:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533908096 00000100:00100000:1.0:1790771166.502298:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6104 00000100:00100000:0.0:1790771166.502300:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533908096 00000100:00100000:1.0:1790771166.502310:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:12241:x1877759533909120:12345-192.168.204.50@tcp:101:ls.0 00002000:00100000:3.0:1790771166.502320:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->4095) req@ffff8bfb0627d500 x1877759533921408/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.502321:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1790771166.502330:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0627d500 with x1877759533921408 ext(0->4095) 00010000:00010000:1.0:1790771166.502332:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d82b lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35a74 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.502335:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0627d500 00000100:00100000:0.0:1790771166.502340:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6105 00000100:00100000:0.0:1790771166.502353:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:12255:x1877759533908096:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.502362:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 419 00010000:00010000:0.0:1790771166.502363:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.502376:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759533921408:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771166.502377:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bc4 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.502386:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.502397:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.502406:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.502412:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.502414:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.502416:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.502422:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686400, rc 0) 00010000:00010000:1.0:1790771166.502431:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d82b lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a74 expref: 128 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.502442:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771166.502445:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.502448:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d82b lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a74 expref: 128 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.502454:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12255:x1877759533908096:12345-192.168.204.50@tcp:101:ls.0 Request processed in 102us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.502469:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6105 00010000:00010000:1.0:1790771166.502475:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0c00, rc 0) 00000100:00100000:3.0:1790771166.502480:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759533921408:12345-192.168.204.50@tcp:3:cat.0 Request processed in 105us (243us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1790771166.502510:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 419 00002000:00100000:3.0:1790771166.502517:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->4095) req@ffff8bfb0627d500 x1877759533921408/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.502524:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0627d500 with x1877759533921408 ext(0->4095) 00000100:00100000:0.0:1790771166.502528:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922048 00002000:00010000:3.0:1790771166.502528:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0627d500 00000100:00100000:1.0:1790771166.502529:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:12241:x1877759533909120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 222us (346us total) trans 4294969359 rc 301/301 00000100:00100000:0.0:1790771166.502535:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922048 00000100:00100000:1.0:1790771166.502540:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6104 00000100:00100000:0.0:1790771166.502572:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1594 00000100:00100000:0.0:1790771166.502582:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11865:x1877759533922048:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771166.510078:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.510112:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539754112:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.510120:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922176 00000100:00100000:2.0:1790771166.510124:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.510129:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922176 00000100:00100000:0.0:1790771166.510173:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1006 00000100:00100000:0.0:1790771166.510181:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:14616:x1877759533922176:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.510194:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.510206:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cb2 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.510211:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922304 00000100:00100000:1.0:1790771166.510218:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922304 00010000:00010000:0.0:1790771166.510231:0:13786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.510238:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(1 6) 00010000:00010000:1.0:1790771166.510242:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 128 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.510243:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(2 6) 00010000:00010000:0.0:1790771166.510254:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 21 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.510260:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539754240:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.510281:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1684 00010000:00010000:0.0:1790771166.510287:0:13786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.510288:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.510295:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759533922304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.510308:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.510315:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.510317:0:13786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 21 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.510323:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 128 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.510335:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d807800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539755904:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.510340:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 128 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.510353:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922688 00010000:00010000:1.0:1790771166.510357:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0992b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34693 expref: 128 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.510358:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922688 00010000:00010000:1.0:1790771166.510372:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.510377:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.510384:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.510389:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.510397:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.510419:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2396:x1877759533922304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.510426:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1684 00000100:00100000:2.0:1790771166.510431:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6106 00000100:00100000:2.0:1790771166.510442:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:12186:x1877759533922688:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.510452:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.510464:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d847 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bb6 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510536:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510546:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510553:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510563:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510568:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510573:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.510652:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.510722:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510728:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510733:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510738:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.510742:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510747:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510755:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.510757:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.510760:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510768:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510772:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d84e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510781:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510787:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510791:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510795:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.510798:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510806:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510812:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfc29009100) 00010000:00010000:2.0:1790771166.510814:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.510817:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510820:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d855 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510847:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d847 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bb6 expref: 142 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510853:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.510855:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.510858:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d847 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bb6 expref: 142 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.510865:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00000100:00100000:2.0:1790771166.510894:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:12186:x1877759533922688:12345-192.168.204.50@tcp:101:ls.0 Request processed in 455us (594us total) trans 4294969360 rc 301/301 00000100:00100000:2.0:1790771166.510901:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6106 00000100:00100000:0.0:1790771166.511323:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:11865:x1877759533922048:12345-192.168.204.50@tcp:37:ls.0 Request processed in 8743us (9037us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.511330:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1594 00000100:00100000:3.0:1790771166.572342:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.572431:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924352 00000100:00100000:2.0:1790771166.572442:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924352 00000100:00100000:2.0:1790771166.572529:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6107 00000100:00100000:2.0:1790771166.572540:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+88:13673:x1877759533924352:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.572560:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.572571:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.572590:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d863 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cea expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.572597:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910016 00000100:00100000:0.0:1790771166.572604:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910016 00000100:00100000:0.0:1790771166.572639:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6108 00000100:00100000:0.0:1790771166.572647:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14000:x1877759533910016:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.572668:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.572683:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0d86a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35af9 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572693:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572708:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572718:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572724:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572733:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572735:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572747:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572750:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572756:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.572765:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.572768:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.572779:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.572782:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572790:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.572790:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910528 00000100:00100000:1.0:1790771166.572796:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910528 00000100:00100000:1.0:1790771166.572825:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6109 00000100:00100000:1.0:1790771166.572834:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14784:x1877759533910528:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.572850:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1790771166.572859:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.572863:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d88d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b15 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.572870:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.572877:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922560 00000100:00100000:2.0:1790771166.572882:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922560 00000100:00100000:3.0:1790771166.572884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.572905:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.572928:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1685 00000100:00100000:2.0:1790771166.572937:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2398:x1877759533922560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.572938:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.572939:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d89b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572957:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.572960:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.572962:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d89b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572965:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572976:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.572985:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d89b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.572996:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.572997:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.573001:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.573013:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.573017:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.573022:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573029:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573034:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f07632 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ab5 expref: 141 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573041:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:0.0:1790771166.573048:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.573052:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573057:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0d878 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573059:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.573065:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0d88d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b15 expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573067:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573068:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573089:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573094:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573095:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573097:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1400/0xfa0c505d97f0d89b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b15 expref: 130 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.573107:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.573119:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cafe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.573120:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573128:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573129:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.573137:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.573142:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1400, rc 0) 00010000:00010000:0.0:1790771166.573155:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573158:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.573170:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.573174:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.573178:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.573179:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.573188:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0d886 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573195:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14784:x1877759533910528:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 361us (433us total) trans 4294969362 rc 0/0 00000100:00100000:2.0:1790771166.573199:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:2398:x1877759533922560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 263us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.573207:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6109 00000100:00100000:2.0:1790771166.573211:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1685 00010000:00010000:0.0:1790771166.573226:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0d86a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af9 expref: 129 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573232:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533919104 00010000:00010000:0.0:1790771166.573235:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00000100:00100000:1.0:1790771166.573235:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533919104 00010000:00010000:0.0:1790771166.573240:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771166.573244:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533922816 00010000:00010000:0.0:1790771166.573245:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0d86a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35af9 expref: 130 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.573249:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533922816 00010000:00010000:0.0:1790771166.573260:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00000100:00100000:1.0:1790771166.573262:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931008 00000100:00100000:1.0:1790771166.573266:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931008 00000100:00100000:2.0:1790771166.573286:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923072 00000100:00100000:0.0:1790771166.573288:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14000:x1877759533910016:12345-192.168.204.50@tcp:101:ls.0 Request processed in 641us (727us total) trans 4294969361 rc 301/301 00000100:00100000:2.0:1790771166.573292:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923072 00000100:00100000:1.0:1790771166.573297:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6110 00000100:00100000:1.0:1790771166.573306:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14414:x1877759533919104:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771166.573313:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6108 00010000:00010000:1.0:1790771166.573319:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.573329:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d8a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b23 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.573346:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6111 00000100:00100000:0.0:1790771166.573356:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6112 00000100:00100000:2.0:1790771166.573358:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+91:14787:x1877759533922816:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.573368:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.573370:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:12014:x1877759533931008:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.573373:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d8b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573380:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0d8b7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cb9 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573386:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d8b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x73:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573387:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.573400:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d8b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x73:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573401:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0d8be lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bf5 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573416:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.573419:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00010000:00010000:2.0:1790771166.573428:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573435:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573450:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.573451:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.573457:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.573458:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.573468:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573511:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0d8a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b23 expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573523:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573534:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5000/0xfa0c505d97f0d8b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x73:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b23 expref: 130 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573534:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573546:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0d8be lrc: 1/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bf5 expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573557:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573559:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771166.573566:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790771166.573573:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.573573:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5000, rc 0) 00010000:00010000:0.0:1790771166.573581:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.573586:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0d8be lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bf5 expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.573593:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573597:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104000, rc 0) 00000100:00100000:1.0:1790771166.573603:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14414:x1877759533919104:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 296us (718us total) trans 4294969363 rc 0/0 00000100:00100000:1.0:1790771166.573611:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6110 00010000:00010000:2.0:1790771166.573613:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573624:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573626:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931648 00000100:00100000:0.0:1790771166.573632:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:12014:x1877759533931008:12345-192.168.204.50@tcp:101:ls.0 Request processed in 263us (585us total) trans 4294969364 rc 301/301 00000100:00100000:1.0:1790771166.573632:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931648 00010000:00010000:2.0:1790771166.573641:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.573643:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6112 00000100:00100000:3.0:1790771166.573654:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.573671:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.573676:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573681:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923328 00010000:00010000:2.0:1790771166.573682:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573685:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923328 00000100:00100000:0.0:1790771166.573687:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6113 00010000:00010000:2.0:1790771166.573699:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.573701:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14890:x1877759533923072:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:2.0:1790771166.573703:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.573709:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573713:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.573715:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0d8c5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573721:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6114 00010000:00010000:0.0:1790771166.573724:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0d8e8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cc0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573730:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.573735:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+79:13889:x1877759533931648:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.573737:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.573749:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573755:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573756:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.573760:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573761:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.573766:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573769:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d8f6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c26 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573773:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573777:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573796:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573798:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc29009a00) 00010000:00010000:2.0:1790771166.573804:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.573808:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573814:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0d8d3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573815:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573825:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573832:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573842:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0d8b7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb9 expref: 95 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573846:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d904 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573857:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573858:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb9 expref: 94 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.573864:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d904 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573878:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573884:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:2.0:1790771166.573889:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.573890:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d904 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.573892:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fe00, rc 0) 00010000:00010000:0.0:1790771166.573893:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.573917:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00010000:0.0:1790771166.573918:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.573927:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14787:x1877759533922816:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 569us (916us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.573929:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573944:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573951:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.573952:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6111 00010000:00010000:0.0:1790771166.573961:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573969:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.573972:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0d8f6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c26 expref: 82 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.573974:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.573978:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931776 00000100:00100000:2.0:1790771166.573984:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931776 00010000:00010000:0.0:1790771166.573993:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574001:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d904 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c26 expref: 82 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574003:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:2.0:1790771166.574010:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6115 00010000:00010000:0.0:1790771166.574011:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.574013:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.574017:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.574018:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574022:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.574028:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339c00, rc 0) 00000100:00100000:2.0:1790771166.574029:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14823:x1877759533923328:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:0.0:1790771166.574030:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0d8ef lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574047:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574048:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.574055:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:13889:x1877759533931648:12345-192.168.204.50@tcp:101:ls.0 Request processed in 323us (603us total) trans 4294968738 rc 0/0 00010000:00010000:0.0:1790771166.574057:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574063:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0d919 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cc7 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574064:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.574074:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6114 00010000:00010000:0.0:1790771166.574079:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574089:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.574093:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574094:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923584 00000100:00100000:3.0:1790771166.574095:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.574099:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923584 00010000:00010000:0.0:1790771166.574106:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574119:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xea196397 (ffff8bfc3607a500) 00010000:00010000:2.0:1790771166.574119:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574120:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931904 00010000:00010000:0.0:1790771166.574126:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.574126:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931904 00010000:00010000:0.0:1790771166.574132:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574135:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574138:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0d8fd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574144:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923712 00000100:00100000:1.0:1790771166.574148:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923712 00010000:00010000:2.0:1790771166.574150:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574165:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574172:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0d8e8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc0 expref: 97 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574172:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6116 00010000:00010000:2.0:1790771166.574174:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574186:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+82:14730:x1877759533931776:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771166.574197:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574199:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.574202:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc0 expref: 96 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574211:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d92e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c2d expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574214:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:0.0:1790771166.574221:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.574226:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105e00, rc 0) 00000100:00100000:3.0:1790771166.574226:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.574239:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574250:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574252:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574256:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14890:x1877759533923072:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 556us (1118us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.574266:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574275:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6113 00010000:00010000:1.0:1790771166.574290:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574294:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932032 00010000:00010000:1.0:1790771166.574298:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574301:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932032 00000004:00200000:2.0:1790771166.574302:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.574308:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.574321:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.574321:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574336:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574337:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6117 00010000:00010000:1.0:1790771166.574345:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574347:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574354:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14825:x1877759533923584:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771166.574368:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574371:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574373:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487e600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.574377:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.574379:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574383:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.574392:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574399:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f06648 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e334fe expref: 95 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574401:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.574407:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.574412:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574427:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487e600/0xfa0c505d97f0d920 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574428:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771166.574436:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.574443:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574444:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d94a lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574448:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574461:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574468:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d94a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574475:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 84 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574477:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574514:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d94a lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574518:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 94 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574523:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.574532:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.574534:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 38336 00010000:00010000:0.0:1790771166.574535:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 5/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574539:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.574554:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.574568:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc29009b00) 00010000:00010000:1.0:1790771166.574574:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574574:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.574576:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 94 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574581:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574589:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.574598:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574605:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0d927 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574607:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 94 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574610:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.574619:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574633:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574638:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539756032:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.574640:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.574645:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574651:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0d919 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 95 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574653:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574692:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.574693:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:1.0:1790771166.574697:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.574700:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 94 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574702:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 3/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574722:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:1.0:1790771166.574723:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0d93c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574724:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 85 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.574727:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.574732:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00010000:00010000:1.0:1790771166.574752:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.574753:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 85 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.574765:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14823:x1877759533923328:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 739us (1112us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.574772:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.574784:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6115 00010000:00010000:1.0:1790771166.574794:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.574801:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d807b80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539756160:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.574801:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.574805:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923840 00010000:00010000:1.0:1790771166.574807:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.574810:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923840 00010000:00010000:1.0:1790771166.574818:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574827:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0xcdd6ff3 (ffff8bfb03218800) 00010000:00010000:1.0:1790771166.574829:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.574831:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffe40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.574831:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932160 00010000:00010000:1.0:1790771166.574832:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.574836:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932160 00010000:00010000:1.0:1790771166.574842:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0d943 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574845:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923200 00000100:00100000:3.0:1790771166.574851:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923200 00000100:00100000:2.0:1790771166.574859:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533923968 00000100:00100000:2.0:1790771166.574863:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533923968 00000100:00100000:0.0:1790771166.574871:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932288 00000100:00100000:0.0:1790771166.574876:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932288 00000100:00100000:2.0:1790771166.574884:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924096 00000100:00100000:2.0:1790771166.574889:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924096 00010000:00010000:1.0:1790771166.574890:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0d92e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c2d expref: 87 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.574890:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 821 00000100:00100000:0.0:1790771166.574901:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932928 00000100:00100000:3.0:1790771166.574905:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533923200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.574906:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932928 00010000:00010000:1.0:1790771166.574914:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d94a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c2d expref: 86 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.574918:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.574919:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6118 00010000:00010000:1.0:1790771166.574929:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771166.574933:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1790771166.574935:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:13882:x1877759533931904:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.574936:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0d76e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c6c expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.574937:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0400, rc 0) 00000100:00100000:0.0:1790771166.574941:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6119 00010000:00010000:2.0:1790771166.574952:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.574956:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14912:x1877759533923712:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.574959:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:2.0:1790771166.574964:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d95f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c34 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.574964:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.574965:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.574970:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:14730:x1877759533931776:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 785us (1239us total) trans 4294968739 rc 0/0 00010000:00010000:0.0:1790771166.574977:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0d966 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cce expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.574985:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6116 00000100:00100000:3.0:1790771166.574993:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533923200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.575000:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 821 00010000:00010000:0.0:1790771166.575005:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0d966 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cce expref: 97 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575009:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6120 00010000:00010000:2.0:1790771166.575015:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d96d lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575023:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+86:13885:x1877759533932032:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.575024:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0d966 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cce expref: 96 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575024:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d96d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575036:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.575047:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0d974 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c3b expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575048:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d96d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575048:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.575049:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.575057:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.575062:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105600, rc 0) 00000004:00200000:2.0:1790771166.575071:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.575080:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.575092:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14912:x1877759533923712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 138us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.575099:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6119 00010000:00010000:1.0:1790771166.575108:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d982 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575117:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d982 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.575123:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6121 00010000:00010000:1.0:1790771166.575128:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d982 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.575136:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.575137:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14915:x1877759533923840:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.575137:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0d95f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c34 expref: 89 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575146:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.575154:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.575163:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d96d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c34 expref: 88 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575167:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0d990 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cd5 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575172:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:3.0:1790771166.575176:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.575181:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.575186:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00010000:00010000:0.0:1790771166.575197:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0d990 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cd5 expref: 96 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575213:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0d990 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cd5 expref: 96 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575213:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0d974 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c3b expref: 90 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.575214:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:13882:x1877759533931904:12345-192.168.204.50@tcp:101:ls.0 Request processed in 282us (1154us total) trans 4294968740 rc 0/0 00000100:00100000:2.0:1790771166.575237:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6118 00010000:00010000:0.0:1790771166.575238:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.575243:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.575247:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105a00, rc 0) 00010000:00010000:1.0:1790771166.575248:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d982 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c3b expref: 89 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575253:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.575260:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927040 00010000:00010000:1.0:1790771166.575261:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.575265:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000100:00100000:2.0:1790771166.575267:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927040 00010000:00010000:1.0:1790771166.575268:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:0.0:1790771166.575274:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14915:x1877759533923840:12345-192.168.204.50@tcp:101:ls.0 Request processed in 141us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.575281:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6121 00000100:00100000:2.0:1790771166.575297:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533910400 00000100:00100000:1.0:1790771166.575301:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+88:13885:x1877759533932032:12345-192.168.204.50@tcp:101:ls.0 Request processed in 279us (1080us total) trans 4294968741 rc 0/0 00000100:00100000:2.0:1790771166.575302:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533910400 00000100:00100000:0.0:1790771166.575310:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6122 00000100:00100000:1.0:1790771166.575320:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6120 00000100:00100000:0.0:1790771166.575326:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14721:x1877759533932160:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.575338:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.575339:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6123 00002000:00010000:3.0:1790771166.575345:0:13796:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1790771165 00000100:00100000:1.0:1790771166.575351:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6124 00000100:00100000:2.0:1790771166.575352:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14919:x1877759533923968:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.575354:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0d997 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bee expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575362:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539755520:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771166.575366:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.575370:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+87:14066:x1877759533932288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.575377:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d99e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cdc expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575382:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.575390:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0d7c9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c96 expref: 29 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575394:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0d9a5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c42 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575398:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d99e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cdc expref: 96 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.575419:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efb7ed33/0xfa0c505d97f0d7c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c96 expref: 29 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575426:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d99e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cdc expref: 96 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.575443:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.575447:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00010000:00010000:2.0:1790771166.575449:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.575452:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.575455:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83e00, rc 0) 00010000:00010000:0.0:1790771166.575463:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0d997 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bee expref: 144 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575468:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2398:x1877759533920256:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 77206us (77334us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.575469:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0d9ac lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.575478:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14919:x1877759533923968:12345-192.168.204.50@tcp:101:ls.0 Request processed in 128us (910us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.575507:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3607a100) 00000100:00100000:3.0:1790771166.575507:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1004 00010000:00010000:1.0:1790771166.575512:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0d9ac lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575515:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771166.575523:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6123 00010000:00010000:0.0:1790771166.575524:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0d997 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bee expref: 144 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.575527:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0d9ac lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.575541:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.575546:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6125 00010000:00010000:0.0:1790771166.575548:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105000, rc 0) 00000100:00100000:3.0:1790771166.575553:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.575561:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14920:x1877759533924096:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.575562:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926016 00000100:00100000:1.0:1790771166.575568:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926016 00010000:00010000:2.0:1790771166.575572:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.575574:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14721:x1877759533932160:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 254us (1101us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771166.575576:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927296 00000100:00100000:3.0:1790771166.575581:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927296 00010000:00010000:2.0:1790771166.575584:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d9b3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ce3 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.575587:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6122 00000100:00100000:1.0:1790771166.575604:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928192 00010000:00010000:2.0:1790771166.575607:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d9b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ce3 expref: 97 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575609:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928192 00000100:00100000:0.0:1790771166.575617:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6126 00000100:00100000:3.0:1790771166.575619:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1595 00010000:00010000:2.0:1790771166.575625:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d9b3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ce3 expref: 97 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.575632:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14942:x1877759533932928:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:3.0:1790771166.575634:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14385:x1877759533926016:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:1.0:1790771166.575641:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1596 00010000:00010000:2.0:1790771166.575648:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.575651:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.575653:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.575654:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83800, rc 0) 00000100:00100000:1.0:1790771166.575671:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14320:x1877759533927296:12345-192.168.204.50@tcp:35:cat.0 00010000:00010000:0.0:1790771166.575682:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0d9ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35b31 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.575694:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14920:x1877759533924096:12345-192.168.204.50@tcp:101:ls.0 Request processed in 136us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.575700:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6125 00000100:00100000:2.0:1790771166.575715:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6127 00010000:00010000:0.0:1790771166.575717:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.575725:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:14572:x1877759533927040:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.575729:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575736:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575747:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575753:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575758:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575759:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575775:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575784:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575826:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d9d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575827:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:14320:x1877759533927296:12345-192.168.204.50@tcp:35:cat.0 Request processed in 173us (654us total) trans 4294969365 rc 0/0 00000100:00100000:3.0:1790771166.575834:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11377850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14385:x1877759533926016:12345-192.168.204.50@tcp:35:cat.0 Request processed in 203us (750us total) trans 4294968742 rc 0/0 00010000:00010000:2.0:1790771166.575843:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575847:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575848:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1596 00000100:00100000:3.0:1790771166.575860:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1595 00010000:00010000:2.0:1790771166.575865:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575869:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d9d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575872:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575876:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1597 00010000:00010000:2.0:1790771166.575889:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4aa00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:0.0:1790771166.575890:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 5844 00000100:00100000:1.0:1790771166.575897:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14827:x1877759533928192:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771166.575898:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575911:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.575919:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.575920:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.575924:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.575927:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575931:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.575932:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0d9cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.575945:0:13775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.575948:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.575953:0:13775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.575956:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.575963:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575969:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.575973:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.575975:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14572:x1877759533927040:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 253us (835us total) trans 0 rc -61/-61 00010000:00010000:0.0:1790771166.575977:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.575986:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6127 00010000:00010000:0.0:1790771166.575987:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.575991:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14827:x1877759533928192:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.576001:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.576002:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533916672 00000100:00100000:2.0:1790771166.576007:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533916672 00010000:00010000:0.0:1790771166.576008:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.576011:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1597 00010000:00010000:0.0:1790771166.576014:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.576018:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576023:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0d9c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576032:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533918592 00000100:00100000:1.0:1790771166.576033:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533930112 00010000:00010000:0.0:1790771166.576035:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576037:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533918592 00000100:00100000:1.0:1790771166.576038:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533930112 00010000:00010000:0.0:1790771166.576045:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576051:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576056:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.576059:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576065:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6128 00010000:00010000:0.0:1790771166.576069:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.576076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.576080:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:10887:x1877759533910400:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1790771166.576083:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1598 00010000:00010000:0.0:1790771166.576087:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfc3607af00) 00010000:00010000:0.0:1790771166.576090:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.576090:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.576093:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.576096:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14805:x1877759533930112:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771166.576102:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d9e4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bd9 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576105:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0d9c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.576118:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.576136:0:13775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.576142:0:13775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.576143:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.576146:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bd9 expref: 133 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576150:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0d9ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b31 expref: 146 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.576165:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.576166:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b000/0xfa0c505d97f0d9e4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bd9 expref: 133 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.576182:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14805:x1877759533930112:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 85us (185us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.576191:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d9d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b31 expref: 145 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.576192:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.576194:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00000100:00100000:1.0:1790771166.576202:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1598 00010000:00010000:2.0:1790771166.576203:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771166.576208:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b000, rc 0) 00000100:00100000:3.0:1790771166.576209:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932672 00010000:00010000:0.0:1790771166.576210:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:0.0:1790771166.576215:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771166.576215:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932672 00010000:00010000:0.0:1790771166.576218:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391c00, rc 0) 00000100:00100000:1.0:1790771166.576233:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533930752 00000100:00100000:1.0:1790771166.576238:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533930752 00000100:00100000:0.0:1790771166.576243:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+145:14942:x1877759533932928:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 617us (1552us total) trans 4294969366 rc 0/0 00000100:00100000:2.0:1790771166.576243:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:10887:x1877759533910400:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 164us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.576252:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1599 00000100:00100000:0.0:1790771166.576259:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6126 00000100:00100000:1.0:1790771166.576259:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533914496 00000100:00100000:1.0:1790771166.576264:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533914496 00000100:00100000:3.0:1790771166.576265:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+89:14068:x1877759533932672:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.576270:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6128 00000100:00100000:0.0:1790771166.576279:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931392 00000100:00100000:0.0:1790771166.576284:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931392 00000100:00100000:1.0:1790771166.576287:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533917568 00000100:00100000:1.0:1790771166.576291:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533917568 00000100:00100000:2.0:1790771166.576300:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6129 00000100:00100000:2.0:1790771166.576312:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:12242:x1877759533916672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.576320:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.576324:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6130 00010000:00010000:2.0:1790771166.576332:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c73 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.576340:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6131 00000100:00100000:0.0:1790771166.576342:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:12239:x1877759533918592:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.576348:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14068:x1877759533932672:12345-192.168.204.50@tcp:35:ls.0 Request processed in 83us (158us total) trans 4294968743 rc 0/0 00010000:00010000:0.0:1790771166.576360:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.576360:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 137 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.576360:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1599 00000100:00100000:1.0:1790771166.576361:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14840:x1877759533930752:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.576372:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c88 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576382:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 137 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576389:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.576391:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.576394:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576401:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a200, rc 0) 00010000:00010000:1.0:1790771166.576403:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576407:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 138 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576420:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:12242:x1877759533916672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 111us (502us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.576423:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 138 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576427:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576435:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6129 00010000:00010000:0.0:1790771166.576437:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771166.576439:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.576445:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.576449:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576451:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576460:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391200, rc 0) 00000100:00100000:2.0:1790771166.576461:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6132 00000100:00100000:2.0:1790771166.576474:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12237:x1877759533914496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.576481:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.576501:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12239:x1877759533918592:12345-192.168.204.50@tcp:101:ls.0 Request processed in 150us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.576509:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6130 00000100:00100000:2.0:1790771166.576523:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533925376 00000100:00100000:2.0:1790771166.576527:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533925376 00000100:00100000:0.0:1790771166.576533:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6133 00000100:00100000:0.0:1790771166.576544:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14763:x1877759533931392:12345-192.168.204.50@tcp:55:cp.0 00002000:00100000:2.0:1790771166.576557:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (540672->544767) req@ffff8bfb05797480 x1877759533925376/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.576560:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576571:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576580:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.576582:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05797480 with x1877759533925376 ext(540672->544767) 00010000:00010000:0.0:1790771166.576593:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 144 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.576593:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05797480 00010000:00010000:1.0:1790771166.576594:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576612:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.576616:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 137 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576617:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576630:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 420 00010000:00010000:0.0:1790771166.576636:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 5/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576637:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576649:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533925376:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:1.0:1790771166.576671:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:1.0:1790771166.576675:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.576678:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576683:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0d9f9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576684:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 137 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576700:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 137 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.576709:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539756288:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.576727:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14840:x1877759533930752:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 373us (658us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.576734:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6131 00000100:00100000:1.0:1790771166.576756:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6134 00000100:00100000:1.0:1790771166.576762:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:12252:x1877759533917568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.576768:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 144 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.576769:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.576782:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c81 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.576783:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 144 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576803:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533925376:12345-192.168.204.50@tcp:3:cat.0 Request processed in 160us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.576809:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d804700 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539756416:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.576812:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 137 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.576816:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 420 00002000:00100000:2.0:1790771166.576827:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (540672->544767) req@ffff8bfb05797480 x1877759533925376/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.576831:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 137 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.576837:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63480 going to sleep for 11 seconds 00002000:00100000:2.0:1790771166.576845:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05797480 with x1877759533925376 ext(540672->544767) 00010000:00010000:1.0:1790771166.576847:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00002000:00010000:2.0:1790771166.576850:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05797480 00010000:00010000:1.0:1790771166.576851:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.576858:0:13773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.576862:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933184 00000100:00100000:0.0:1790771166.576867:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933184 00010000:00010000:1.0:1790771166.576870:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81000, rc 0) 00010000:00010000:2.0:1790771166.576888:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576896:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.576904:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1600 00000100:00100000:1.0:1790771166.576905:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12252:x1877759533917568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 138us (740us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.576913:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.576914:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11376450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:11011:x1877759533933184:12345-192.168.204.50@tcp:35:dir_create.sh.0 00000100:00100000:1.0:1790771166.576919:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6134 00010000:00010000:2.0:1790771166.576928:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576934:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576939:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05e84400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.576942:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576947:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.576954:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:2.0:1790771166.576957:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790771166.576960:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.576966:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539755264:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.576966:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0d767 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.576986:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539755392:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.577008:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.577015:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:14718:x1877759533916544:12345-192.168.204.50@tcp:55:truncate.0 Request processed in 89624us (89939us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790771166.577023:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6087 00000100:00100000:0.0:1790771166.577043:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11376450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:11011:x1877759533933184:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 130us (611us total) trans 4294968744 rc 0/0 00000100:00100000:1.0:1790771166.577047:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754368:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.577057:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1600 00000100:00100000:1.0:1790771166.577061:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35880 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754496:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.577074:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c50 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.577075:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c37800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754624:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.577092:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c34380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754752:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.577098:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 137 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.577103:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c37100 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539754880:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.577115:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 137 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.577119:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539755008:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.577129:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.577133:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.577133:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.577137:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c36680 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539755136:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.577139:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577153:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.577154:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4ae00, rc 0) 00010000:00010000:3.0:1790771166.577163:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577169:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577176:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.577177:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0d9a5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c42 expref: 91 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.577177:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.577181:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12237:x1877759533914496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 707us (1066us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.577183:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.577205:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6132 00010000:00010000:3.0:1790771166.577208:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.577215:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0d9ac lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c42 expref: 90 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577219:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.577222:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.577223:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.577227:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.577229:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.577231:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80600, rc 0) 00010000:00010000:3.0:1790771166.577239:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0d871 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577251:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577256:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.577261:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:14066:x1877759533932288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1897us (2675us total) trans 4294968746 rc 0/0 00010000:00010000:3.0:1790771166.577266:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577280:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.577281:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6124 00010000:00010000:3.0:1790771166.577286:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577292:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577298:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc29009100) 00010000:00010000:3.0:1790771166.577300:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.577302:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577307:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0d87f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577333:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d863 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cea expref: 98 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577377:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.577378:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.577381:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0d863 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cea expref: 98 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.577388:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00000100:00100000:3.0:1790771166.577414:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:13673:x1877759533924352:12345-192.168.204.50@tcp:101:ls.0 Request processed in 4878us (5082us total) trans 4294968745 rc 301/301 00000100:00100000:3.0:1790771166.577419:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6107 00000100:00100000:2.0:1790771166.584765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.584809:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533935104 00000100:00100000:0.0:1790771166.584814:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533935104 00000100:00100000:0.0:1790771166.584842:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6135 00000100:00100000:0.0:1790771166.584848:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:13884:x1877759533935104:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.584858:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.584868:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0da23 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c49 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.584915:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0da2a lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.584924:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0da2a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.584930:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0da2a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.584936:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.584984:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0da23 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c49 expref: 93 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.584996:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0da2a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c49 expref: 92 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585002:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.585004:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.585006:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00000100:00100000:0.0:1790771166.585044:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:13884:x1877759533935104:12345-192.168.204.50@tcp:101:ls.0 Request processed in 196us (282us total) trans 4294968747 rc 0/0 00000100:00100000:0.0:1790771166.585051:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6135 00000100:00100000:2.0:1790771166.585060:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539755648:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.585074:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539755776:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.585096:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.585097:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d807800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539755904:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.585131:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 21 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585149:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686a00, rc 0) 00000100:00100000:3.0:1790771166.585203:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.585214:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:14616:x1877759533922176:12345-192.168.204.50@tcp:101:cp.0 Request processed in 75031us (75139us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.585222:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1006 00000100:00100000:1.0:1790771166.585248:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927424 00000100:00100000:1.0:1790771166.585254:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927424 00010000:00010000:1.0:1790771166.585273:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 144 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.585304:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1686 00000100:00100000:1.0:1790771166.585313:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:2399:x1877759533927424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.585321:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.585326:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 144 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585335:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 144 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585347:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0c99f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3571e expref: 144 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.585357:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.585363:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.585366:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585372:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.585387:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.585398:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927680 00000100:00100000:1.0:1790771166.585404:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:2399:x1877759533927424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.585406:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927680 00000100:00100000:1.0:1790771166.585414:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1686 00010000:00010000:0.0:1790771166.585433:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 143 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.585433:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928064 00000100:00100000:1.0:1790771166.585438:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928064 00010000:00010000:1.0:1790771166.585455:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 144 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.585467:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.585475:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1687 00000100:00100000:1.0:1790771166.585482:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1688 00000100:00100000:0.0:1790771166.585511:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:2399:x1877759533927680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.585523:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.585529:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+144:2399:x1877759533928064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.585530:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 144 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585543:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.585545:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 144 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585552:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 144 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.585553:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936640 00000100:00100000:2.0:1790771166.585559:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936640 00010000:00010000:0.0:1790771166.585562:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0cb3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35733 expref: 144 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585568:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 144 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585585:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.585585:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0caa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3572c expref: 143 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585592:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.585598:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6136 00010000:00010000:0.0:1790771166.585604:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.585606:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:3.0:1790771166.585608:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.585615:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.585615:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:14064:x1877759533936640:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.585628:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.585630:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.585633:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:2399:x1877759533927680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 149us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.585641:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1687 00010000:00010000:2.0:1790771166.585645:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0da38 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c57 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.585654:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533928064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 130us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.585675:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1688 00010000:00010000:2.0:1790771166.585711:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0da3f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.585720:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928704 00000100:00100000:0.0:1790771166.585725:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928704 00010000:00010000:2.0:1790771166.585726:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0da3f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.585736:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0da3f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.585742:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.585747:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 97 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.585772:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1689 00000100:00100000:0.0:1790771166.585782:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2399:x1877759533928704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.585789:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.585794:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 97 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.585799:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0da38 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c57 expref: 95 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585805:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 97 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.585821:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0da3f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c57 expref: 94 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585823:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0b4ec lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35144 expref: 97 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.585837:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.585843:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.585847:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.585849:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.585849:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00010000:00010000:0.0:1790771166.585856:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585862:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.585867:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.585879:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932416 00000100:00100000:3.0:1790771166.585880:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.585886:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932416 00000100:00100000:2.0:1790771166.585887:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14064:x1877759533936640:12345-192.168.204.50@tcp:101:ls.0 Request processed in 277us (420us total) trans 4294968748 rc 0/0 00000100:00100000:0.0:1790771166.585894:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:2399:x1877759533928704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 112us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.585901:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6136 00000100:00100000:3.0:1790771166.585904:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933312 00000100:00100000:0.0:1790771166.585905:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1689 00000100:00100000:3.0:1790771166.585911:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933312 00000100:00100000:0.0:1790771166.585932:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 822 00010000:00010000:3.0:1790771166.585934:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 141 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.585944:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2399:x1877759533932416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.585952:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.585960:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.585965:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0d7b4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c0a expref: 94 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.585969:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1690 00000100:00100000:3.0:1790771166.585971:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933568 00000100:00100000:3.0:1790771166.585976:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933568 00010000:00010000:0.0:1790771166.585984:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771166.585985:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533933312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.585989:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.585996:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 22 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.585998:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.586001:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.586009:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 141 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586011:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:2399:x1877759533932416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.586016:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927552 00000100:00100000:2.0:1790771166.586023:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927552 00000100:00100000:0.0:1790771166.586030:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 822 00010000:00010000:1.0:1790771166.586036:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 142 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586041:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 142 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.586041:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1691 00000100:00100000:3.0:1790771166.586057:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2399:x1877759533933568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.586064:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0d24a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a58 expref: 142 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586067:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.586077:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 22 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586080:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:2.0:1790771166.586087:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1692 00010000:00010000:1.0:1790771166.586089:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586092:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 22 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.586102:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533927552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.586104:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586116:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.586117:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.586120:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fea640f/0xfa0c505d97f057a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->28671) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32fa9 expref: 22 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586126:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 141 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.586137:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2399:x1877759533933312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 154us (256us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.586137:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(2 6) 00010000:00010000:2.0:1790771166.586143:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 141 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586146:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(2 6) 00000100:00100000:1.0:1790771166.586156:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1690 00010000:00010000:3.0:1790771166.586159:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 20 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586171:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 20 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586175:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0c975 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35709 expref: 140 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586191:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.586194:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586201:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 20 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586202:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.586213:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539756544:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.586230:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2399:x1877759533927552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.586239:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1692 00000100:00100000:3.0:1790771166.586252:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08545c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.586342:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.586376:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533927936 00000100:00100000:1.0:1790771166.586380:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533927936 00010000:00010000:1.0:1790771166.586397:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.586409:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.586433:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.586441:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928320 00000100:00100000:1.0:1790771166.586445:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928320 00010000:00010000:1.0:1790771166.586460:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 93 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586461:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929088 00000100:00100000:0.0:1790771166.586468:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929088 00000100:00100000:3.0:1790771166.586469:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1693 00000100:00100000:2.0:1790771166.586471:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.586509:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:2399:x1877759533927936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.586519:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533932544 00010000:00010000:3.0:1790771166.586519:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.586526:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533932544 00010000:00010000:3.0:1790771166.586530:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586535:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1694 00000100:00100000:2.0:1790771166.586537:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.586551:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2399:x1877759533928320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.586552:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.586557:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933440 00000100:00100000:1.0:1790771166.586562:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933440 00010000:00010000:0.0:1790771166.586563:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.586571:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 94 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586575:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0c96e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e356ed expref: 139 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586579:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 138 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.586582:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 823 00010000:00010000:0.0:1790771166.586596:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 94 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.586601:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2399:x1877759533929088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.586604:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.586613:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.586617:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1695 00010000:00010000:2.0:1790771166.586619:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.586628:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.586629:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0d4c7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b46 expref: 94 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.586635:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2399:x1877759533933440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.586638:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0d672 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ad6 expref: 138 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586651:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.586655:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000100:00100000:3.0:1790771166.586656:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:2399:x1877759533927936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 171us (313us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.586672:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.586674:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586677:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 137 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586680:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.586696:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1693 00010000:00010000:0.0:1790771166.586698:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586703:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 137 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.586706:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2399:x1877759533929088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (269us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.586716:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.586722:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 824 00000100:00100000:2.0:1790771166.586736:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 823 00010000:00010000:1.0:1790771166.586737:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0d1b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e359f6 expref: 137 pid: 13763 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.586737:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:2399:x1877759533932544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.586743:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.586753:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.586756:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.586761:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586769:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0d7fa lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c18 expref: 93 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586770:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586771:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:2399:x1877759533928320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.586783:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.586793:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1694 00010000:00010000:1.0:1790771166.586796:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586801:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:2.0:1790771166.586806:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933696 00010000:00010000:3.0:1790771166.586806:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.586811:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933696 00010000:00010000:1.0:1790771166.586816:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.586828:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 136 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.586833:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:2399:x1877759533932544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 97us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.586845:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2399:x1877759533933440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 214us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.586853:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 824 00000100:00100000:0.0:1790771166.586864:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.586865:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1695 00000100:00100000:2.0:1790771166.586874:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1696 00000100:00100000:2.0:1790771166.586886:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2399:x1877759533933696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.586889:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929984 00010000:00010000:2.0:1790771166.586893:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.586894:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929984 00010000:00010000:2.0:1790771166.586902:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.586903:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586907:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586920:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586924:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1007 00010000:00010000:1.0:1790771166.586927:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.586928:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.586937:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759533929984:12345-192.168.204.50@tcp:2:touch.0 00010000:00010000:2.0:1790771166.586955:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0d721 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b2a expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586965:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.586968:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.586974:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.586992:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2399:x1877759533933696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.586998:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1696 00000004:00010000:1.0:1790771166.587031:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000026db2133 reply state 00000000e91a175a transno 4294968749 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587041:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587048:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.587050:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771166.587053:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.587074:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.587075:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759533929984:12345-192.168.204.50@tcp:2:touch.0 Request processed in 138us (213us total) trans 4294967619 rc 0/0 00000100:00100000:0.0:1790771166.587086:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1007 00000100:00100000:1.0:1790771166.587092:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:14694:x1877759533919360:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 94795us (94859us total) trans 4294968749 rc 0/0 00000100:00100000:3.0:1790771166.587099:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933952 00000100:00100000:1.0:1790771166.587103:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6093 00000100:00100000:3.0:1790771166.587105:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933952 00000100:00100000:2.0:1790771166.587126:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.587142:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1601 00000100:00100000:3.0:1790771166.587152:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:11954:x1877759533933952:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:0.0:1790771166.587156:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533933824 00000100:00100000:0.0:1790771166.587161:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533933824 00010000:00010000:0.0:1790771166.587177:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 135 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.587205:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1697 00000100:00100000:1.0:1790771166.587206:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.587216:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759533933824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.587223:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.587227:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 135 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587236:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533934080 00010000:00010000:0.0:1790771166.587237:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 135 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587240:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533934080 00010000:00010000:0.0:1790771166.587253:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0d744 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b38 expref: 135 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587260:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 31 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.587264:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.587271:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.587278:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40290400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.587283:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x40290400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587291:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1698 00010000:00010000:0.0:1790771166.587296:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 134 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587303:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:2399:x1877759533934080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.587315:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.587323:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1790771166.587325:0:13791:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x11:0x0] updating lvb blocks from disk: 1 -> 8 00010000:00010000:1.0:1790771166.587331:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 31 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.587338:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587343:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 31 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.587351:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2396:x1877759533933824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (222us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.587351:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587363:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbc53148/0xfa0c505d97efc6d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fc79 expref: 31 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.587369:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1697 00010000:00010000:2.0:1790771166.587378:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587382:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.587389:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790771166.587391:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587397:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bcb expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.587401:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587410:0:13791:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bcb expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.587424:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.587426:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.587435:0:13791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000310af5d0/0xfa0c505d97f0d5f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bcb expref: 27 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.587437:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 137 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.587457:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587460:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:13791:1877759539756672:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.587517:0:13763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 137 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587524:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080180 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.587528:0:13763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 137 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.587544:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539756800:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.587548:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.587585:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.587592:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533934464 00000100:00100000:0.0:1790771166.587598:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533934464 00000100:00100000:0.0:1790771166.587631:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1602 00000100:00100000:0.0:1790771166.587639:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14596:x1877759533934464:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:1.0:1790771166.587647:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.587695:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533934848 00000100:00100000:2.0:1790771166.587700:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533934848 00000100:00100000:1.0:1790771166.587720:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.587733:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1008 00000100:00100000:2.0:1790771166.587743:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:14017:x1877759533934848:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771166.587750:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.587764:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032c407e7/0xfa0c505d97f0da5b lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dbc expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.587770:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.587784:0:13787:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1790771166.587791:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14596:x1877759533934464:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 149us (244us total) trans 4294969367 rc 0/0 00010000:00010000:2.0:1790771166.587796:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=166s v=(0 0) 00010000:00010000:2.0:1790771166.587800:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x17:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1790771166.587803:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1602 00010000:00010000:2.0:1790771166.587809:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032c407e7/0xfa0c505d97f0da5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dbc expref: 23 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.587820:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000032c407e7/0xfa0c505d97f0da5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->65535) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dbc expref: 23 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.587827:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533934976 00000100:00100000:0.0:1790771166.587834:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533934976 00010000:00010000:2.0:1790771166.587835:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487e600, rc 0) 00000100:00100000:1.0:1790771166.587865:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.587870:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:14017:x1877759533934848:12345-192.168.204.50@tcp:101:dd.0 Request processed in 127us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.587872:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1603 00000100:00100000:2.0:1790771166.587881:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1008 00000100:00100000:0.0:1790771166.587888:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:14944:x1877759533934976:12345-192.168.204.50@tcp:37:ln.0 00000100:00100000:2.0:1790771166.587904:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533934336 00000100:00100000:2.0:1790771166.587908:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533934336 00000100:00100000:1.0:1790771166.587924:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.587930:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533935488 00000100:00100000:2.0:1790771166.587933:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533935488 00000100:00100000:2.0:1790771166.587957:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6137 00000100:00100000:2.0:1790771166.587964:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14824:x1877759533934336:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:1.0:1790771166.587971:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.587988:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533935232 00000100:00100000:1.0:1790771166.587991:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533935232 00000100:00100000:1.0:1790771166.588020:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533935616 00000100:00100000:2.0:1790771166.588021:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14824:x1877759533934336:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 57us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.588023:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533935616 00000100:00100000:2.0:1790771166.588032:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6137 00000100:00100000:1.0:1790771166.588046:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533935744 00000100:00100000:1.0:1790771166.588049:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533935744 00000100:00100000:2.0:1790771166.588056:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 825 00010000:00010000:1.0:1790771166.588061:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 97 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.588068:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+92:2399:x1877759533935232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.588077:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.588086:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1699 00010000:00010000:2.0:1790771166.588090:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0d904 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c26 expref: 92 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588098:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2399:x1877759533935744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.588104:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.588107:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.588109:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.588114:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 97 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588123:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 97 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.588129:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:2399:x1877759533935232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.588145:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 825 00010000:00010000:1.0:1790771166.588152:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:1.0:1790771166.588157:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588163:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.588163:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 826 00010000:00010000:1.0:1790771166.588171:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.588174:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2396:x1877759533935616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.588183:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.588195:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2399:x1877759533935744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.588196:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0d90b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc0 expref: 97 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588211:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1699 00010000:00010000:2.0:1790771166.588215:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:2.0:1790771166.588221:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.588249:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.588249:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:2396:x1877759533935616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.588263:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 826 00000100:00100000:1.0:1790771166.588294:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.588302:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928448 00000100:00100000:2.0:1790771166.588308:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928448 00000100:00100000:3.0:1790771166.588351:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533925120 00000100:00100000:1.0:1790771166.588356:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6138 00000100:00100000:3.0:1790771166.588357:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533925120 00000100:00100000:2.0:1790771166.588366:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6139 00000100:00100000:1.0:1790771166.588367:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14890:x1877759533935488:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:2.0:1790771166.588380:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14553:x1877759533928448:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771166.588381:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.588390:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6140 00010000:00010000:2.0:1790771166.588393:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.588397:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0da62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dc3 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.588402:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14400:x1877759533925120:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.588406:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0da69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d53 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588418:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.588430:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0da70 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d0d expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588438:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588445:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588447:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588464:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588465:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588468:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588513:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0ca01 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357f7 expref: 96 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588514:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588522:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.588544:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d806a00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539756032:192.168.204.50@tcp:104: 00000004:00200000:1.0:1790771166.588550:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.588555:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1790771166.588559:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d807b80 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539756160:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.588565:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588576:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588579:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0da62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 140 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588579:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588603:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588605:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588610:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.588626:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.588631:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:1.0:1790771166.588634:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.588636:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00010000:00010000:2.0:1790771166.588640:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588648:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588653:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588677:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14890:x1877759533935488:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 296us (891us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.588677:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.588683:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588684:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588691:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6138 00000100:00100000:0.0:1790771166.588698:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.588707:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588711:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533925632 00010000:00010000:3.0:1790771166.588711:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588717:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533925632 00010000:00010000:2.0:1790771166.588717:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771166.588720:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936256 00010000:00010000:2.0:1790771166.588725:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.588727:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936256 00010000:00010000:2.0:1790771166.588731:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588731:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.588749:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6141 00010000:00010000:2.0:1790771166.588753:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0da7e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.588760:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6142 00000100:00100000:1.0:1790771166.588765:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:14512:x1877759533925632:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771166.588771:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.588776:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:12014:x1877759533936256:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.588779:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.588784:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588790:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.588791:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588794:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0da9a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d1b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588798:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.588802:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0daa1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dd1 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588803:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588809:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588827:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588831:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588835:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc13348f00) 00010000:00010000:2.0:1790771166.588839:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.588840:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588842:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588850:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588856:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.588857:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 17258 00010000:00010000:2.0:1790771166.588860:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0da8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588882:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588883:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588894:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588896:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0da69 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d53 expref: 138 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588902:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588929:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588929:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.588930:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588935:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:0.0:1790771166.588937:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.588943:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0da69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d53 expref: 138 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.588945:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.588954:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.588959:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.588961:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00010000:00010000:3.0:1790771166.588962:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.588964:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.588983:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.588985:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.588987:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14553:x1877759533928448:12345-192.168.204.50@tcp:101:ln.0 Request processed in 610us (736us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771166.588989:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.588991:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0daa1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 142 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589010:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6139 00010000:00010000:1.0:1790771166.589011:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589030:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589044:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 141 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589044:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.589049:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.589055:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589057:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.589064:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.589067:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0da85 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589068:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81600, rc 0) 00000004:00200000:1.0:1790771166.589073:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.589082:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589088:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589093:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589095:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:12014:x1877759533936256:12345-192.168.204.50@tcp:101:ls.0 Request processed in 324us (402us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.589106:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.589109:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.589111:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589112:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589113:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6142 00010000:00010000:1.0:1790771166.589127:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589132:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589137:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589139:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936384 00000100:00100000:0.0:1790771166.589144:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936384 00010000:00010000:1.0:1790771166.589146:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.589149:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.589152:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589160:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 91 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589160:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589167:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589179:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.589196:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfc1040f000) 00010000:00010000:1.0:1790771166.589199:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.589200:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.589205:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589206:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1700 00010000:00010000:1.0:1790771166.589206:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.589213:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589214:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.589222:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+91:2399:x1877759533936384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.589235:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0daaf lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589237:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0da93 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589238:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.589248:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 91 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589254:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589257:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.589271:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589275:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 91 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589281:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0da70 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 100 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589283:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589297:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f07296 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e339dc expref: 91 pid: 6493 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589300:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.589304:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4aa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.589311:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589312:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589325:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936768 00000100:00100000:2.0:1790771166.589333:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936768 00010000:00010000:1.0:1790771166.589335:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589339:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771166.589344:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771166.589344:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.589348:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfb03218b00) 00010000:00010000:3.0:1790771166.589348:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b800, rc 0) 00010000:00010000:0.0:1790771166.589350:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589355:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.589360:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589362:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589362:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924480 00000100:00100000:2.0:1790771166.589368:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924480 00010000:00010000:1.0:1790771166.589373:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0dac4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589377:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589383:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928576 00000100:00100000:2.0:1790771166.589388:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928576 00010000:00010000:0.0:1790771166.589411:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.589415:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6143 00000100:00100000:3.0:1790771166.589424:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:14400:x1877759533925120:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1025us (1129us total) trans 4294968750 rc 0/0 00000100:00100000:2.0:1790771166.589429:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14787:x1877759533936768:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:0.0:1790771166.589438:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:2399:x1877759533936384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 217us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.589439:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6140 00010000:00010000:1.0:1790771166.589440:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0da9a lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d1b expref: 100 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589443:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.589453:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1700 00010000:00010000:2.0:1790771166.589455:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0dad2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ddf expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589456:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.589462:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1790771166.589468:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6144 00000100:00100000:0.0:1790771166.589469:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936896 00010000:00010000:1.0:1790771166.589470:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0da9a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d1b expref: 99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589475:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936896 00000100:00100000:3.0:1790771166.589482:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:14916:x1877759533924480:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.589505:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2800, rc 0) 00010000:00010000:2.0:1790771166.589513:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589523:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589530:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 827 00000100:00100000:1.0:1790771166.589532:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14512:x1877759533925632:12345-192.168.204.50@tcp:101:rm.0 Request processed in 771us (909us total) trans 4294968751 rc 301/301 00000100:00100000:0.0:1790771166.589542:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:2399:x1877759533936896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.589543:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.589546:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6141 00010000:00010000:0.0:1790771166.589556:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.589569:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.589571:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6145 00010000:00010000:0.0:1790771166.589572:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0d8e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb9 expref: 98 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.589575:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.589581:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0dae0 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cf1 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.589584:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14053:x1877759533928576:12345-192.168.204.50@tcp:101:chown.0 00000004:00200000:2.0:1790771166.589584:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.589589:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:0.0:1790771166.589594:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.589596:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.589607:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dae7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d5a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589612:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0dad2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589618:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:2399:x1877759533936896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.589633:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 827 00010000:00010000:2.0:1790771166.589636:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 140 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589637:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589648:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0dae0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf1 expref: 97 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589672:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589674:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.589676:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589682:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.589688:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f600, rc 0) 00010000:00010000:3.0:1790771166.589692:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0dae0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf1 expref: 97 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589693:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589698:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589712:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14787:x1877759533936768:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 287us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.589731:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6143 00010000:00010000:1.0:1790771166.589748:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589755:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589762:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.589775:0:13772:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968752 00000100:00100000:2.0:1790771166.589780:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.589799:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.589800:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000039cf0791 reply state 00000000aeb98add transno 4294968753 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.589814:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.589821:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589821:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.589823:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589829:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.589830:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937152 00000100:00100000:2.0:1790771166.589836:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937152 00010000:00010000:0.0:1790771166.589844:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:1.0:1790771166.589844:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589850:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.589854:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.589856:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939968 00000100:00100000:2.0:1790771166.589860:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939968 00000004:00200000:1.0:1790771166.589876:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 14473 00000004:00200000:1.0:1790771166.589881:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.589886:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6146 00000100:00100000:0.0:1790771166.589887:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:14825:x1877759533923584:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 15534us (15913us total) trans 4294968753 rc 0/0 00000100:00100000:2.0:1790771166.589896:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14864:x1877759533937152:12345-192.168.204.50@tcp:36:chown.0 00000004:00010000:1.0:1790771166.589898:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.589903:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6117 00000020:00080000:0.0:1790771166.589910:0:13772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.589915:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589918:0:13774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.589926:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.589933:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589936:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0d036 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359b7 expref: 140 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.589936:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a400, rc 0) 00000100:00100000:0.0:1790771166.589939:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6147 00000100:00100000:0.0:1790771166.589959:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+90:13890:x1877759533939968:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.589961:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14916:x1877759533924480:12345-192.168.204.50@tcp:101:ls.0 Request processed in 479us (749us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.589967:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589967:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.589977:0:13774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.589980:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589982:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.589982:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6144 00010000:00010000:1.0:1790771166.589989:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.589993:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.589995:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.589999:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0db0a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c65 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590001:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.590013:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590022:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.590030:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.590036:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.590037:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590054:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0daee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590065:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590069:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590075:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590076:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0db11 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590083:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.590089:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590095:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0db11 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590095:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590112:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x61bf1dfb (ffff8bfb03218900) 00010000:00010000:0.0:1790771166.590115:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0db11 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590116:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.590120:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.590128:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.590129:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0daf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590150:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.590163:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dae7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d5a expref: 140 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590177:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928832 00000100:00100000:0.0:1790771166.590181:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928832 00010000:00010000:1.0:1790771166.590186:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d5a expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590189:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.590198:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.590200:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.590203:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00000100:00100000:0.0:1790771166.590219:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940352 00000100:00100000:0.0:1790771166.590223:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940352 00000100:00100000:1.0:1790771166.590225:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14053:x1877759533928576:12345-192.168.204.50@tcp:101:chown.0 Request processed in 646us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.590232:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6145 00000100:00100000:1.0:1790771166.590257:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6148 00000100:00100000:0.0:1790771166.590266:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6149 00000100:00100000:1.0:1790771166.590269:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:14098:x1877759533928832:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.590277:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.590282:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:13891:x1877759533940352:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.590290:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.590291:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0db1f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d61 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590301:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0db26 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c5e expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590320:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590320:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.590328:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590336:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590346:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0db34 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590352:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.590367:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0db34 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590368:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590374:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937536 00000100:00100000:3.0:1790771166.590379:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937536 00010000:00010000:0.0:1790771166.590388:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0db34 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590389:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.590405:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.590405:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533941376 00000100:00100000:3.0:1790771166.590410:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533941376 00000100:00100000:3.0:1790771166.590435:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6150 00010000:00010000:1.0:1790771166.590439:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790771166.590443:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 88 off11000 00000100:00100000:3.0:1790771166.590446:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:14649:x1877759533937536:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:0.0:1790771166.590457:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0db26 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c5e expref: 97 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590458:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590477:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.590513:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000d89732b reply state 000000008fd47284 transno 4294969368 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590515:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0db34 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c5e expref: 96 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590534:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-mdtlov_UUID:13769:1877759539756928:0@lo:1000:mdt00_014.0 00010000:00010000:2.0:1790771166.590537:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590561:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.590563:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000004:00200000:1.0:1790771166.590565:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.590568:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.590570:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00200000:1.0:1790771166.590573:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1790771166.590576:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105000, rc 0) 00000100:00100000:3.0:1790771166.590576:0:13769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.590577:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1790771166.590591:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590595:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87180 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.590607:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:13891:x1877759533940352:12345-192.168.204.50@tcp:101:ls.0 Request processed in 329us (419us total) trans 4294968755 rc 0/0 00010000:00010000:1.0:1790771166.590607:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.590617:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6151 00000100:00100000:2.0:1790771166.590625:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14864:x1877759533937152:12345-192.168.204.50@tcp:36:chown.0 Request processed in 727us (843us total) trans 4294969368 rc 0/0 00010000:00010000:1.0:1790771166.590628:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590632:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6149 00000100:00100000:3.0:1790771166.590633:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14071:x1877759533941376:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.590646:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6146 00010000:00010000:1.0:1790771166.590648:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590650:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.590669:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590673:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.590677:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590679:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0db50 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35c8f expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590685:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590695:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539756928 00000100:00100000:2.0:1790771166.590701:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539756928 00010000:00010000:1.0:1790771166.590705:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.590709:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.590712:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0db0a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c65 expref: 97 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590713:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590727:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590733:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0db2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590736:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00010000:00010000:0.0:1790771166.590745:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0db11 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c65 expref: 96 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590750:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13769:x1877759539756928:12345-0@lo:1000:mdt00_014.0 00010000:00010000:1.0:1790771166.590759:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590768:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590773:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.590780:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.590780:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.590785:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00010000:00010000:3.0:1790771166.590786:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590791:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590798:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.590800:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590804:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590805:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590811:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:13890:x1877759533939968:12345-192.168.204.50@tcp:101:ls.0 Request processed in 858us (1000us total) trans 4294968754 rc 0/0 00010000:00010000:3.0:1790771166.590823:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590831:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6147 00010000:00010000:1.0:1790771166.590832:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfb03218200) 00010000:00010000:3.0:1790771166.590833:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590836:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:13769:x1877759539756928:12345-0@lo:1000:mdt00_014.0 Request processed in 87us (261us total) trans 0 rc 1/1 00010000:00010000:1.0:1790771166.590840:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.590845:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.590857:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00010000:00010000:1.0:1790771166.590859:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0db3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.590890:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.590896:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0db1f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d61 expref: 142 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.590916:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d61 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.590923:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb03218000) 00010000:00010000:1.0:1790771166.590925:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.590927:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0c00, rc 0) 00010000:00010000:3.0:1790771166.590935:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590942:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590948:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.590954:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936512 00010000:00010000:3.0:1790771166.590954:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.590959:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936512 00010000:00010000:3.0:1790771166.590962:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.590966:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590974:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.590984:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.590987:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.590991:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.590993:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.590999:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1009 00010000:00010000:3.0:1790771166.591002:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996a00/0xfa0c505d97f0db57 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591009:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:14730:x1877759533936512:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:3.0:1790771166.591012:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591017:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.591018:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591024:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591028:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 2/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dd8 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591029:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.591034:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591044:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.591051:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591056:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591060:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc1040fb00) 00000100:00100000:0.0:1790771166.591065:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924608 00010000:00010000:3.0:1790771166.591068:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.591070:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924608 00010000:00010000:1.0:1790771166.591071:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 21 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591073:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591096:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 21 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591097:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937792 00010000:00010000:3.0:1790771166.591098:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0db5e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591103:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937792 00010000:00010000:1.0:1790771166.591114:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771166.591118:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771166.591123:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 6/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd8 expref: 24 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591128:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937920 00000100:00100000:0.0:1790771166.591132:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937920 00010000:00010000:3.0:1790771166.591144:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0db50 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c8f expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591147:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 21 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591155:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6152 00010000:00010000:3.0:1790771166.591163:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.591170:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 21 pid: 8408 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591171:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:14924:x1877759533924608:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.591172:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.591182:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0db50 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c8f expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591187:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.591198:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0db73 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cf8 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591215:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.591215:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3600, rc 0) 00010000:00010000:0.0:1790771166.591236:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591244:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14071:x1877759533941376:12345-192.168.204.50@tcp:101:ls.0 Request processed in 613us (891us total) trans 4294968756 rc 301/301 00010000:00010000:0.0:1790771166.591248:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591255:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6151 00010000:00010000:0.0:1790771166.591262:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591266:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 21 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591281:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 21 pid: 13793 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591281:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6153 00010000:00010000:0.0:1790771166.591282:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591297:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14545:x1877759533937792:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771166.591304:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591314:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.591314:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.591315:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591326:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0db88 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35df4 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591346:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591346:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0db8f lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591357:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591373:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0db8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591374:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 24 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591375:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591389:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6154 00010000:00010000:0.0:1790771166.591398:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591406:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:11972:x1877759533937920:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.591408:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.591413:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0db8f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591425:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.591431:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060806c0 going to sleep for 11 seconds 00000004:00200000:0.0:1790771166.591432:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa6:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.591436:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.591437:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0db9d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e02 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.591447:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591455:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591460:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591465:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14098:x1877759533928832:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 1199us (1313us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.591467:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591469:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591508:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6148 00010000:00010000:3.0:1790771166.591510:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0db88 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35df4 expref: 97 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591512:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591516:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.591522:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591538:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591541:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591542:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c39a00/0xfa0c505d97f0db8f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35df4 expref: 96 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591552:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.591556:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.591560:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.591567:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591567:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:3.0:1790771166.591574:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.591578:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0db7a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591578:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39a00, rc 0) 00000004:00200000:2.0:1790771166.591584:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.591585:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.591593:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.591600:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591602:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14545:x1877759533937792:12345-192.168.204.50@tcp:101:chown.0 Request processed in 308us (610us total) trans 0 rc 0/0 00000004:00010000:2.0:1790771166.591610:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591619:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.591622:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6153 00010000:00010000:0.0:1790771166.591635:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591642:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924864 00000100:00100000:1.0:1790771166.591646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.591647:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924864 00010000:00010000:0.0:1790771166.591649:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591653:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0db9d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e02 expref: 145 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591670:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.591675:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591683:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591691:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x510a92c1 (ffff8bfc3607af00) 00010000:00010000:2.0:1790771166.591692:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e02 expref: 144 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591698:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.591698:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938176 00000100:00100000:1.0:1790771166.591699:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.591704:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591705:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938176 00000100:00100000:1.0:1790771166.591720:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938304 00010000:00010000:0.0:1790771166.591722:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0db81 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591726:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938304 00010000:00010000:2.0:1790771166.591728:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000100:00100000:3.0:1790771166.591731:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938432 00010000:00010000:2.0:1790771166.591737:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.591738:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938432 00010000:00010000:2.0:1790771166.591741:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00010000:00010000:0.0:1790771166.591761:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0db73 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf8 expref: 102 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.591765:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6155 00000100:00100000:3.0:1790771166.591776:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6156 00000100:00100000:1.0:1790771166.591781:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14671:x1877759533924864:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771166.591783:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf8 expref: 101 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.591790:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:11970:x1877759533938176:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.591793:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.591799:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3607a100) 00010000:00010000:0.0:1790771166.591802:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.591805:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79400, rc 0) 00010000:00010000:3.0:1790771166.591805:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.591806:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0dbab lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d06 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591819:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0dbb2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e09 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591831:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14924:x1877759533924608:12345-192.168.204.50@tcp:101:cp.0 Request processed in 663us (920us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.591837:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591838:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6152 00010000:00010000:1.0:1790771166.591849:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591855:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:11972:x1877759533937920:12345-192.168.204.50@tcp:101:ls.0 Request processed in 452us (815us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.591856:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.591863:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6157 00010000:00010000:1.0:1790771166.591867:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591877:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6154 00000100:00100000:0.0:1790771166.591878:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:11967:x1877759533938304:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.591879:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591894:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.591896:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591901:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6158 00010000:00010000:1.0:1790771166.591904:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591906:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dbce lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e10 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.591917:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:11973:x1877759533938432:12345-192.168.204.50@tcp:101:ls.0 00000004:00200000:3.0:1790771166.591920:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.591929:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.591932:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591934:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1790771166.591939:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591943:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591946:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0dbd5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e17 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591953:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591959:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0dbb2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e09 expref: 149 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591977:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.591985:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.591987:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e09 expref: 149 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.591996:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.591999:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592001:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000004:00200000:0.0:1790771166.592008:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.592008:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.592013:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60200, rc 0) 00000004:00200000:0.0:1790771166.592016:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.592020:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592022:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.592027:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.592036:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:11970:x1877759533938176:12345-192.168.204.50@tcp:101:ls.0 Request processed in 250us (452us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.592037:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592045:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.592057:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6156 00010000:00010000:0.0:1790771166.592061:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dbce lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e10 expref: 150 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.592073:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.592077:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 3407872 00010000:00010000:0.0:1790771166.592078:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e10 expref: 148 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.592078:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:1.0:1790771166.592084:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.592093:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-mdtlov_UUID:13769:1877759539756928:0@lo:1000:mdt00_014.0 00000004:00010000:2.0:1790771166.592094:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592096:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000004:00010000:1.0:1790771166.592099:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592105:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.592109:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00010000:00010000:1.0:1790771166.592120:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592127:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592132:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0dbd5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 149 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592134:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:11967:x1877759533938304:12345-192.168.204.50@tcp:101:ls.0 Request processed in 258us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.592139:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:14649:x1877759533937536:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 1694us (1817us total) trans 0 rc -17/-17 00010000:00010000:1.0:1790771166.592143:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592155:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6157 00010000:00010000:1.0:1790771166.592168:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.592168:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6150 00010000:00010000:2.0:1790771166.592179:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 147 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592180:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592198:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3ab400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.592200:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.592202:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592204:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.592208:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2200, rc 0) 00010000:00010000:1.0:1790771166.592211:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592220:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.592223:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.592225:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592230:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0dbb9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592237:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:11973:x1877759533938432:12345-192.168.204.50@tcp:101:ls.0 Request processed in 320us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.592241:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.592250:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592255:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6158 00010000:00010000:1.0:1790771166.592261:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.592263:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938688 00000100:00100000:3.0:1790771166.592269:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938688 00010000:00010000:1.0:1790771166.592270:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592276:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aa600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.592280:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.592280:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592287:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592293:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9537b590 (ffff8bfb03218f00) 00010000:00010000:1.0:1790771166.592295:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.592297:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592302:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0dbc7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592306:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938816 00000100:00100000:0.0:1790771166.592312:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6159 00000100:00100000:2.0:1790771166.592313:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938816 00000100:00100000:0.0:1790771166.592325:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:11974:x1877759533938688:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.592326:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0dbab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d06 expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592337:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.592343:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d06 expref: 102 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592348:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0dbf1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e1e expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592349:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.592356:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00000100:00100000:2.0:1790771166.592358:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6160 00010000:00010000:1.0:1790771166.592361:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3ab200, rc 0) 00000100:00100000:3.0:1790771166.592364:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.592373:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14823:x1877759533938816:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.592385:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14671:x1877759533924864:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 609us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.592392:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6155 00010000:00010000:0.0:1790771166.592394:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592402:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592409:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592410:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592412:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938944 00000100:00100000:1.0:1790771166.592417:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938944 00000100:00100000:3.0:1790771166.592420:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.592432:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 95 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.592435:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.592441:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.592446:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533925248 00010000:00010000:2.0:1790771166.592447:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 101 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.592452:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592452:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6161 00000100:00100000:3.0:1790771166.592453:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533925248 00010000:00010000:2.0:1790771166.592467:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 5/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592469:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:12016:x1877759533938944:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.592505:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6162 00010000:00010000:1.0:1790771166.592508:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.592517:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0dbf1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 149 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.592518:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14757:x1877759533925248:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.592520:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dc06 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e25 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592534:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.592543:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 102 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592550:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dc0d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d14 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592551:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 149 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592561:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592563:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 102 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592577:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.592585:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.592589:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372c00, rc 0) 00010000:00010000:1.0:1790771166.592591:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592598:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539757440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.592599:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592601:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592611:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:11974:x1877759533938688:12345-192.168.204.50@tcp:101:ls.0 Request processed in 289us (372us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.592624:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592626:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6159 00000004:00200000:1.0:1790771166.592636:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.592637:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.592642:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.592655:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592670:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592678:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 95 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592686:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592693:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.592693:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dc06 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 149 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592697:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 95 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592711:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592723:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.592727:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592729:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539757568:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.592746:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.592751:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.592754:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.592757:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03000, rc 0) 00000100:00100000:2.0:1790771166.592758:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb03cdde40 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.592775:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592776:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.592783:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:12016:x1877759533938944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 316us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.592790:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939584 00010000:00010000:3.0:1790771166.592790:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592791:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6161 00000100:00100000:0.0:1790771166.592796:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533924736 00000100:00100000:2.0:1790771166.592796:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939584 00000100:00100000:0.0:1790771166.592803:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533924736 00010000:00010000:3.0:1790771166.592805:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592810:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939712 00000100:00100000:1.0:1790771166.592814:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939712 00000004:00200000:3.0:1790771166.592826:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000004:00200000:3.0:1790771166.592830:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.592839:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939328 00000004:00010000:3.0:1790771166.592841:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592845:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6163 00000100:00100000:2.0:1790771166.592847:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939328 00000100:00100000:1.0:1790771166.592856:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6164 00010000:00010000:3.0:1790771166.592856:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.592860:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14655:x1877759533924736:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.592874:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.592874:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.592875:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14827:x1877759533939712:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771166.592885:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dc30 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35cff expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592888:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592890:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 828 00010000:00010000:1.0:1790771166.592894:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.592908:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.592910:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:2396:x1877759533939584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.592911:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0dc37 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e41 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592925:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592927:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592931:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.592940:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0dc45 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592946:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.592951:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0d982 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c3b expref: 99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.592954:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592967:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0dc45 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592969:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.592982:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.592989:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.592996:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.592997:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.592998:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0dc45 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593010:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:2396:x1877759533939584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (290us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.593020:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.593025:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.593028:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 828 00010000:00010000:3.0:1790771166.593030:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593036:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593037:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dc1b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593046:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 829 00000100:00100000:2.0:1790771166.593057:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:2396:x1877759533939328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.593060:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593060:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593066:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.593079:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.593080:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0dc37 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e41 expref: 98 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593085:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0d96d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c34 expref: 98 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593086:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593100:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.593114:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0dc45 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e41 expref: 96 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593116:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.593118:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.593122:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593128:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.593135:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00010000:00010000:3.0:1790771166.593137:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.593139:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.593142:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.593144:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02600, rc 0) 00000100:00100000:2.0:1790771166.593145:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:2396:x1877759533939328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (401us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.593159:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc1040fa00) 00000100:00100000:2.0:1790771166.593163:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 829 00010000:00010000:0.0:1790771166.593164:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593167:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.593171:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14827:x1877759533939712:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 299us (393us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.593175:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593183:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.593191:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6164 00010000:00010000:3.0:1790771166.593207:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dc22 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.593225:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00000100:00100000:1.0:1790771166.593226:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533938560 00000100:00100000:1.0:1790771166.593231:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533938560 00000004:00200000:0.0:1790771166.593232:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.593238:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dc0d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d14 expref: 107 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.593249:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593251:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d14 expref: 106 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.593258:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1604 00000100:00100000:1.0:1790771166.593271:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14912:x1877759533938560:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:3.0:1790771166.593274:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771166.593275:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.593280:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.593284:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fa00, rc 0) 00010000:00010000:0.0:1790771166.593296:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593302:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.593306:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14757:x1877759533925248:12345-192.168.204.50@tcp:101:cp.0 Request processed in 792us (890us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.593313:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.593318:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6162 00010000:00010000:0.0:1790771166.593324:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.593328:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593333:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593340:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.593343:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.593345:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593350:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dc3e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593359:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593364:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593369:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593374:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.593377:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593382:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593390:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xa5ec40c9 (ffff8bfc3607a500) 00010000:00010000:0.0:1790771166.593392:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.593395:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.593401:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.593406:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dc4c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593429:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dc30 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 106 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593440:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 105 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.593447:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.593453:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771166.593456:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.593458:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372400, rc 0) 00000100:00100000:0.0:1790771166.593479:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14655:x1877759533924736:12345-192.168.204.50@tcp:101:ln.0 Request processed in 624us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.593513:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6163 00000100:00100000:0.0:1790771166.593534:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940096 00000100:00100000:0.0:1790771166.593538:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940096 00000100:00100000:3.0:1790771166.593547:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.593562:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6165 00000100:00100000:0.0:1790771166.593571:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14716:x1877759533940096:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.593576:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939840 00000100:00100000:2.0:1790771166.593583:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939840 00010000:00010000:0.0:1790771166.593589:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.593605:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0af89 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x20/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34e6c expref: 96 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593608:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940224 00000100:00100000:2.0:1790771166.593614:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940224 00010000:00010000:0.0:1790771166.593622:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.593629:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.593635:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1605 00010000:00010000:0.0:1790771166.593642:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.593652:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.593671:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 104 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593684:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 104 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593692:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940480 00010000:00010000:0.0:1790771166.593694:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 104 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593697:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940480 00010000:00010000:0.0:1790771166.593709:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 96 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593719:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 7/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.593724:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6166 00000100:00100000:2.0:1790771166.593733:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:14478:x1877759533940480:12345-192.168.204.50@tcp:36:dd.0 00010000:00010000:0.0:1790771166.593748:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 96 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593760:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 96 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.593772:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757696:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.593777:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.593796:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0d625 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35940 expref: 148 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593814:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff8bfc4205d100) 00010000:00010000:2.0:1790771166.593824:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.593830:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 104 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593843:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 104 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.593856:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03020000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757824:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.593883:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.593897:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 105 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.593902:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1606 00010000:00010000:0.0:1790771166.593910:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 105 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.593918:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14072:x1877759533940224:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.593921:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03021500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757952:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.593924:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593933:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.593940:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593947:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 105 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.593954:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 105 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.593966:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03021180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539758080:192.168.204.50@tcp:104: 00000001:00080000:2.0:1790771166.593972:0:13768:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969370 00000100:00100000:0.0:1790771166.593987:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b3c0 going to sleep for 11 seconds 00000004:00010000:2.0:1790771166.594000:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e688dd6 reply state 000000000974eb00 transno 4294969371 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.594010:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594012:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14072:x1877759533940224:12345-192.168.204.50@tcp:35:ls.0 Request processed in 97us (464us total) trans 4294968757 rc 0/0 00010000:00010000:2.0:1790771166.594021:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff8bfc310f1d00) 00000100:00100000:0.0:1790771166.594024:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539756288:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.594028:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1606 00010000:00010000:2.0:1790771166.594029:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.594034:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.594038:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d804700 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539756416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.594057:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940608 00010000:00010000:0.0:1790771166.594059:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594062:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940608 00000100:00100000:3.0:1790771166.594070:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.594078:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+150:14478:x1877759533940480:12345-192.168.204.50@tcp:36:dd.0 Request processed in 343us (424us total) trans 4294969371 rc 0/0 00000100:00100000:2.0:1790771166.594085:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6166 00000100:00100000:0.0:1790771166.594088:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533928960 00000020:00080000:2.0:1790771166.594090:0:13768:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790771166.594094:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533928960 00000100:00100000:1.0:1790771166.594098:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1010 00000100:00100000:1.0:1790771166.594108:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:10887:x1877759533940608:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1790771166.594115:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.594125:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e48 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.594137:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6167 00000100:00100000:3.0:1790771166.594138:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.594147:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.594152:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14564:x1877759533928960:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:1.0:1790771166.594163:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x10:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1790771166.594166:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790771166.594167:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.594172:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e48 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594179:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dc6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d68 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.594181:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969369 is committed 00010000:00010000:1.0:1790771166.594192:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 24 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594194:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771166.594198:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969368 is committed 00010000:00010000:0.0:1790771166.594211:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.594214:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 24 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594215:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594222:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594248:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594249:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539758208:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.594249:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594256:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 50 batchid updated 00000020:00080000:2.0:1790771166.594265:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 47 batchid updated 00010000:00010000:3.0:1790771166.594269:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.594273:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594277:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080840 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.594279:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594280:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594300:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 50 00010000:00010000:3.0:1790771166.594305:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771166.594306:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594313:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.594318:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594319:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594330:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0d235 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594342:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594349:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.594350:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc2d235e40 with version 79 00010000:00010000:3.0:1790771166.594351:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594359:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594362:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594363:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 47 cancel update log [0x240000401:0x3:0x0].37: rc = 0 00010000:00010000:0.0:1790771166.594373:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.594378:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594379:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594395:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.594397:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594399:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594410:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 47 cancel update log [0x200000400:0x3:0x0].37: rc = 0 00010000:00010000:0.0:1790771166.594411:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.594413:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594418:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.594425:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594429:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0xdcc87686 (ffff8bfc4205d200) 00010000:00010000:0.0:1790771166.594431:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dc76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594432:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.594438:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594444:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0d617 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.594445:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc07f3f6c0 with version 80 00010000:00010000:0.0:1790771166.594446:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594453:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 48 cancel update log [0x240000401:0x3:0x0].38: rc = 0 00010000:00010000:0.0:1790771166.594464:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594471:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594476:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.594479:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594481:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 48 cancel update log [0x200000400:0x3:0x0].38: rc = 0 00010000:00010000:0.0:1790771166.594526:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594535:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.594538:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.594541:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594547:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dc7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.594547:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc07829a80 with version 81 00000020:00080000:2.0:1790771166.594555:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 50 cancel update log [0x240000401:0x3:0x0].39: rc = 0 00010000:00010000:0.0:1790771166.594572:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dc6f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d68 expref: 126 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594580:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.594583:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.594587:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dc6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d68 expref: 126 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.594589:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 50 cancel update log [0x200000400:0x3:0x0].39: rc = 0 00010000:00010000:0.0:1790771166.594606:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372a00, rc 0) 00000020:00080000:2.0:1790771166.594609:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 50 00000004:00080000:2.0:1790771166.594624:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 79 rpc_version 79 00000100:00100000:0.0:1790771166.594627:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14564:x1877759533928960:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 479us (559us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771166.594634:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6167 00010000:00010000:3.0:1790771166.594634:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594644:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1790771166.594650:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1790771166.594650:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594674:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.594676:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05c30000 x1877759539758464/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1790771166.594677:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594679:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594699:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594701:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.594711:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c30000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758464:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.594717:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594724:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1bc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.594724:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9f:0x0].0x0 (ffff8bfc1040fe00) 00010000:00010000:3.0:1790771166.594730:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.594731:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594734:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594738:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594744:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668600/0xfa0c505d97f0d679 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x9f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594750:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xdcc87686 (ffff8bfc1040f500) 00000100:00100000:2.0:1790771166.594755:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.594756:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940992 00010000:00010000:0.0:1790771166.594757:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.594760:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594764:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594765:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940992 00010000:00010000:0.0:1790771166.594772:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0d377 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.594777:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829f00 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.594796:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.594801:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539758464 00000100:00100000:1.0:1790771166.594803:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 830 00000100:00100000:2.0:1790771166.594808:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539758464 00010000:00010000:3.0:1790771166.594815:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594816:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:2396:x1877759533940992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.594817:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.594833:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.594833:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594835:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.594840:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00010000:00010000:1.0:1790771166.594847:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0da2a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c49 expref: 97 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594854:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.594855:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.594855:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7768:x1877759539758464:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771166.594860:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594863:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.594881:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.594881:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594882:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.594892:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594908:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771166.594910:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa9:0x0].0x0 (ffff8bfc22108f00) 00010000:00010000:1.0:1790771166.594910:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594911:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.594917:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594918:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.594924:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.594925:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594927:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0d760 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.594936:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0d434 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594946:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.594951:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539758464:12345-0@lo:1000:osp_up1-0.0 Request processed in 97us (199us total) trans 4294968758 rc 0/0 00010000:00010000:0.0:1790771166.594953:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594956:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594958:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:2396:x1877759533940992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.594972:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:0.0:1790771166.594976:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594981:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.594982:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 830 00010000:00010000:0.0:1790771166.594993:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.594994:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.595000:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595003:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.595009:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595011:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595015:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c30000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758464:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.595028:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.595033:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 80 rpc_version 80 00010000:00010000:3.0:1790771166.595033:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x85:0x0].0x0 (ffff8bfb03188b00) 00010000:00010000:0.0:1790771166.595040:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x37:0x0].0x0 (ffff8bfc29009800) 00010000:00010000:3.0:1790771166.595040:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.595044:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.595045:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595049:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1790771166.595049:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1790771166.595052:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0d5bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x85:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595060:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05c31f80 x1877759539758720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1790771166.595069:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0d29e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595079:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.595084:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11375850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14805:x1877759533939840:12345-192.168.204.50@tcp:33:getfattr.0 00000100:00100000:2.0:1790771166.595092:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c31f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758720:0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.595094:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595101:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595105:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595109:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.595111:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.595118:0:6497:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x12:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.595125:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:1.0:1790771166.595126:0:6497:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.595132:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595134:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595144:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1106fe40 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.595148:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:3.0:1790771166.595148:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595154:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.595159:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595160:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539758720 00010000:00010000:3.0:1790771166.595162:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.595166:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539758720 00000100:00100000:1.0:1790771166.595167:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11375850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14805:x1877759533939840:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 1522us (1768us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.595170:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595174:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0d3bd lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.595185:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1605 00000100:00100000:2.0:1790771166.595193:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00010000:00010000:0.0:1790771166.595203:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595204:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595206:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539758720:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.595224:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595229:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.595230:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595233:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.595239:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595240:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.595246:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595248:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0d7d0 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595259:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595271:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771166.595272:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595273:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00010000:1.0:1790771166.595277:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004c6f2741 reply state 00000000ea96f98c transno 4294969369 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595278:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595294:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0db03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595299:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595307:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.595310:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.595312:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790771166.595316:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.595319:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595320:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539758720:12345-0@lo:1000:osp_up1-0.0 Request processed in 113us (195us total) trans 4294968759 rc 0/0 00010000:00010000:3.0:1790771166.595334:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595341:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00010000:00010000:3.0:1790771166.595343:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.595347:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1790771166.595351:0:13770:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1790771166.595353:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.595360:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14660:x1877759533921024:12345-192.168.204.50@tcp:36:chown.0 Request processed in 94712us (94799us total) trans 4294969369 rc 0/0 00010000:00010000:3.0:1790771166.595363:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc3600d000) 00010000:00010000:3.0:1790771166.595366:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.595367:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6103 00010000:00010000:3.0:1790771166.595370:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595377:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0d51b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595384:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c31f80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758720:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771166.595395:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.595397:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 81 rpc_version 81 00010000:00010000:3.0:1790771166.595405:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595410:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1790771166.595413:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:3.0:1790771166.595414:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.595419:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595422:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb05c31500 x1877759539758976/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1790771166.595428:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595440:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c31500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758976:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771166.595441:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.595466:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533940864 00010000:00010000:3.0:1790771166.595467:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc3600d100) 00000100:00100000:0.0:1790771166.595471:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533940864 00010000:00010000:3.0:1790771166.595472:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.595478:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595480:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.595503:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0d514 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.595514:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.595526:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595527:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 120 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595531:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113e06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.595536:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533941120 00000100:00100000:1.0:1790771166.595541:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533941120 00010000:00010000:3.0:1790771166.595547:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595555:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539758976 00010000:00010000:3.0:1790771166.595555:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595560:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 118 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595563:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539758976 00010000:00010000:3.0:1790771166.595564:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.595569:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1701 00010000:00010000:3.0:1790771166.595571:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595581:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.595586:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533940864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.595596:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:0.0:1790771166.595597:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.595601:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1702 00010000:00010000:3.0:1790771166.595603:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771166.595607:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 120 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595608:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595611:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:1.0:1790771166.595615:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc104d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759533941120:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.595630:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539758976:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.595632:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.595632:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0d530 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595638:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 120 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595642:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 118 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595656:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595681:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0c244 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3550a expref: 119 pid: 13767 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595685:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595687:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 118 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595705:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595707:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771166.595715:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595716:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.595721:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595725:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595727:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7768:x1877759539758976:12345-0@lo:1000:osp_up1-0.0 Request processed in 101us (250us total) trans 4294968760 rc 0/0 00010000:00010000:0.0:1790771166.595745:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.595755:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596200/0xfa0c505d97f0ac02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d3f expref: 118 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.595756:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595759:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1790771166.595776:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533940864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 193us (334us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.595780:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.595784:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.595785:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000100:00100000:0.0:1790771166.595787:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1701 00010000:00010000:3.0:1790771166.595788:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595791:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595803:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c31500 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539758976:0@lo:1000:osp_up1-0.0 00010000:00010000:3.0:1790771166.595806:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0d824 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595812:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595820:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.595836:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.595850:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595857:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.595860:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc104d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:2396:x1877759533941120:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 249us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.595869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.595879:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1702 00010000:00010000:0.0:1790771166.595880:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595887:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595892:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595897:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929216 00010000:00010000:0.0:1790771166.595898:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.595902:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929216 00010000:00010000:0.0:1790771166.595903:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595912:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.595920:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.595921:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771166.595924:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771166.595927:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.595932:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0da00 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.595944:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6168 00000100:00100000:2.0:1790771166.595955:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14601:x1877759533929216:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:2.0:1790771166.595963:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.595966:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533941248 00000100:00100000:0.0:1790771166.595968:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14763:x1877759533931392:12345-192.168.204.50@tcp:55:cp.0 Request processed in 19427us (19825us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790771166.595971:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533941248 00010000:00010000:2.0:1790771166.595973:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0dc84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d6f expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.595978:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6133 00000100:00100000:1.0:1790771166.595999:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.596007:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596015:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.596021:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533941504 00010000:00010000:2.0:1790771166.596023:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.596026:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533941504 00010000:00010000:2.0:1790771166.596041:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596047:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596053:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.596061:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1607 00002000:00100000:3.0:1790771166.596064:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (544768->548863) req@ffff8bfb058b3100 x1877759533941248/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.596075:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13265:x1877759533941504:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.596077:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.596078:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb058b3100 with x1877759533941248 ext(544768->548863) 00002000:00010000:3.0:1790771166.596086:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb058b3100 00010000:00010000:2.0:1790771166.596089:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.596095:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:13791:1877759539756672:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.596097:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.596110:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:2.0:1790771166.596112:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596121:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596129:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.596137:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2399:x1877759533934080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8836us (8936us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.596142:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.596147:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1698 00010000:00010000:2.0:1790771166.596157:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aec00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.596163:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 421 00000100:00100000:0.0:1790771166.596164:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13265:x1877759533941504:12345-192.168.204.50@tcp:35:ls.0 Request processed in 91us (163us total) trans 4294969372 rc 0/0 00010000:00010000:2.0:1790771166.596165:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.596183:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1607 00010000:00010000:2.0:1790771166.596186:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.596186:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533941248:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771166.596206:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.596209:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.596213:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596221:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0dc8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596235:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596242:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596249:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596256:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.596260:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596267:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596276:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x84832a57 (ffff8bfc310f1c00) 00010000:00010000:2.0:1790771166.596278:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.596281:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.596287:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dc92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.596303:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533941248:12345-192.168.204.50@tcp:3:cat.0 Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.596313:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 421 00010000:00010000:2.0:1790771166.596320:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0dc84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d6f expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.596324:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (544768->548863) req@ffff8bfb058b3100 x1877759533941248/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.596351:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb058b3100 with x1877759533941248 ext(544768->548863) 00010000:00010000:2.0:1790771166.596353:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d6f expref: 118 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.596357:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb058b3100 00010000:00010000:2.0:1790771166.596373:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:2.0:1790771166.596376:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.596380:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00000100:00100000:3.0:1790771166.596402:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539756544:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.596413:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14601:x1877759533929216:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 459us (546us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.596415:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.596423:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6168 00000100:00100000:3.0:1790771166.596439:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759533933568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 10386us (10481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.596447:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1691 00000100:00100000:2.0:1790771166.596465:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539756800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.596560:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.597384:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14944:x1877759533934976:12345-192.168.204.50@tcp:37:ln.0 Request processed in 9500us (9663us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.597390:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1603 00000100:00100000:3.0:1790771166.597453:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:11954:x1877759533933952:12345-192.168.204.50@tcp:37:ls.0 Request processed in 10302us (10381us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.597459:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1601 00010000:00010000:1.0:1790771166.610565:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771166.618936:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.618967:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.618988:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.619010:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942144 00000100:00100000:1.0:1790771166.619013:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.619022:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942144 00000100:00100000:2.0:1790771166.619034:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942400 00000100:00100000:1.0:1790771166.619035:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.619043:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942400 00000100:00100000:1.0:1790771166.619059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.619085:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.619098:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1608 00000100:00100000:3.0:1790771166.619105:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942272 00000100:00100000:2.0:1790771166.619112:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1609 00000100:00100000:3.0:1790771166.619113:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942272 00000100:00100000:0.0:1790771166.619114:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13673:x1877759533942144:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.619116:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942656 00000100:00100000:1.0:1790771166.619123:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942656 00000100:00100000:2.0:1790771166.619130:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:12186:x1877759533942400:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.619144:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 116 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.619155:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942784 00000100:00100000:1.0:1790771166.619159:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942784 00000100:00100000:3.0:1790771166.619177:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1703 00000100:00100000:1.0:1790771166.619184:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 831 00000100:00100000:3.0:1790771166.619188:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:2396:x1877759533942272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.619196:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:2396:x1877759533942656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.619200:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.619206:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.619207:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 116 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619223:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 116 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619230:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0da3f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c57 expref: 96 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619241:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f08ba9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34225 expref: 116 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619246:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.619252:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619254:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8bfc1ae7ff00) 00010000:00010000:3.0:1790771166.619263:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619265:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619273:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619274:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.619282:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619305:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.619322:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2396:x1877759533942656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.619329:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13673:x1877759533942144:12345-192.168.204.50@tcp:35:ls.0 Request processed in 220us (397us total) trans 4294968761 rc 0/0 00000100:00100000:1.0:1790771166.619332:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 831 00000100:00100000:2.0:1790771166.619340:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:12186:x1877759533942400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 211us (366us total) trans 4294969373 rc 0/0 00000100:00100000:3.0:1790771166.619342:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:2396:x1877759533942272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.619348:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1608 00000100:00100000:1.0:1790771166.619356:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 832 00000100:00100000:2.0:1790771166.619365:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1609 00000100:00100000:3.0:1790771166.619365:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1703 00000100:00100000:1.0:1790771166.619367:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2396:x1877759533942784:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.619376:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.619388:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0d9ac lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c42 expref: 94 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619397:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.619400:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.619405:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929344 00000100:00100000:3.0:1790771166.619410:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929344 00010000:00010000:1.0:1790771166.619412:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619416:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619419:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.619429:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.619435:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.619440:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929472 00000100:00100000:3.0:1790771166.619445:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929472 00000100:00100000:1.0:1790771166.619449:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:2396:x1877759533942784:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.619454:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 832 00000100:00100000:3.0:1790771166.619473:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942912 00000100:00100000:3.0:1790771166.619477:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942912 00000100:00100000:0.0:1790771166.619518:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.619525:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6169 00000100:00100000:1.0:1790771166.619536:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14629:x1877759533929344:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:2.0:1790771166.619543:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619548:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.619557:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6170 00000100:00100000:0.0:1790771166.619563:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.619564:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0dca0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d76 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619572:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.619574:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14767:x1877759533929472:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771166.619590:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619590:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.619599:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.619603:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0dca7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d7d expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619608:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.619617:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619622:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619628:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619633:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619635:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.619639:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619653:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929600 00010000:00010000:1.0:1790771166.619671:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619675:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8bfc1ae7ff00) 00000100:00100000:0.0:1790771166.619678:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929600 00010000:00010000:3.0:1790771166.619680:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619685:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.619693:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619695:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619698:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619704:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533925760 00000100:00100000:0.0:1790771166.619709:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533925760 00010000:00010000:2.0:1790771166.619719:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0da54 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619720:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619728:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939072 00010000:00010000:3.0:1790771166.619728:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619733:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939072 00010000:00010000:1.0:1790771166.619743:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619749:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619753:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.619756:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6171 00000100:00100000:0.0:1790771166.619768:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14554:x1877759533942912:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771166.619774:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619774:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619784:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619794:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.619799:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619803:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619812:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0d656 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b07 expref: 121 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619813:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.619817:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619822:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619836:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.619842:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.619842:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40218400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619844:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0dcd1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619854:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.619860:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00000004:00200000:1.0:1790771166.619868:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.619868:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.619871:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619873:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619876:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1790771166.619883:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619888:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 120 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.619897:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619899:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619908:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619925:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 120 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619929:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619943:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.619943:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.619944:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 120 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.619950:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.619961:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.619965:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0dcd1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.619969:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 120 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.619970:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.619979:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620004:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 121 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620004:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.620007:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cde70fd5 reply state 000000003cfb9ea2 transno 4294969374 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620027:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.620028:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620035:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620036:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620037:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 121 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620046:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.620054:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620062:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771166.620062:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620071:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.620072:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 121 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.620076:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.620080:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620086:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.620094:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.620099:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620105:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771166.620106:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14554:x1877759533942912:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 337us (677us total) trans 4294969374 rc 0/0 00010000:00010000:3.0:1790771166.620113:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.620119:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620122:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dcae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620124:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 122 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.620127:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6171 00010000:00010000:3.0:1790771166.620140:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0dcb5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.620146:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6172 00010000:00010000:1.0:1790771166.620147:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620160:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 121 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.620161:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14113:x1877759533929600:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771166.620166:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620169:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620184:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.620190:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620191:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620196:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0dcdf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d84 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620197:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620212:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620213:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.620219:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620232:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620233:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.620236:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620239:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620241:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620261:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfb03218f00) 00010000:00010000:3.0:1790771166.620265:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620266:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.620268:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620268:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620271:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620286:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xb62e0cbf (ffff8bfc1040fa00) 00010000:00010000:0.0:1790771166.620294:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620294:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.620300:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620305:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620309:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dcbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620324:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620324:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0dcc3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620339:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620347:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620348:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0dca0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 123 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620364:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 124 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620366:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0dca7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d7d expref: 124 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620370:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620381:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 123 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620396:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.620400:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.620401:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 122 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620403:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e000/0xfa0c505d97f0dcd1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d7d expref: 122 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620404:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0400, rc 0) 00010000:00010000:0.0:1790771166.620423:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0dcf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x90:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620425:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa0:0x0].0x0 (ffff8bfc1040fb00) 00010000:00010000:3.0:1790771166.620433:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.620434:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14629:x1877759533929344:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 897us (1417us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.620440:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e000, rc 0) 00010000:00010000:2.0:1790771166.620447:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 122 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620448:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.620454:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6169 00010000:00010000:0.0:1790771166.620470:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.620471:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14767:x1877759533929472:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 901us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.620477:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6173 00010000:00010000:2.0:1790771166.620479:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 121 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.620513:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14806:x1877759533925760:12345-192.168.204.50@tcp:101:setfattr.0 00000004:00200000:0.0:1790771166.620514:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x90:0x0]: returning size 5 00000100:00100000:3.0:1790771166.620519:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6170 00000004:00010000:0.0:1790771166.620529:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0dcf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620530:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.620536:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620543:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620544:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dcfb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d22 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.620546:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6174 00010000:00010000:2.0:1790771166.620558:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.620562:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:12017:x1877759533939072:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.620565:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620577:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.620584:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620587:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0dd02 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e2c expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620591:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620595:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620598:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.620605:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620621:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620625:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620630:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 120 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620637:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620649:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.620650:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620671:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.620674:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620677:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620682:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 120 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620694:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620699:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dce6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620699:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620715:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 120 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620718:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620726:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.620737:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.620740:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.620746:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.620748:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620752:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620765:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.620766:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620781:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620787:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.620794:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620801:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620801:0:13763:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620802:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620809:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0dd02 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 117 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620830:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdd6ff3 (ffff8bfc3607aa00) 00010000:00010000:1.0:1790771166.620831:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620837:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.620837:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620843:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620847:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 116 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.620857:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa1:0x0]: returning size 0 00010000:00010000:0.0:1790771166.620863:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dced lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.620864:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.620875:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000004:00010000:1.0:1790771166.620877:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.620882:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.620888:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ee00, rc 0) 00010000:00010000:1.0:1790771166.620890:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.620891:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 121 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620902:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0dcdf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d84 expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620908:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.620919:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:12017:x1877759533939072:12345-192.168.204.50@tcp:101:ls.0 Request processed in 359us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.620929:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759104:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.620939:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73e00/0xfa0c505d97f0dcf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x90:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d84 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.620939:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6174 00010000:00010000:1.0:1790771166.620948:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620958:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x90:0x0].0x0 (ffff8bfc0ab7eb00) 00010000:00010000:1.0:1790771166.620959:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620965:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00000100:00100000:3.0:1790771166.620965:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943040 00010000:00010000:1.0:1790771166.620968:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.620970:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73e00, rc 0) 00000100:00100000:3.0:1790771166.620971:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943040 00010000:00010000:1.0:1790771166.620976:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.620980:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620986:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.620993:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.620995:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.620998:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.621003:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1610 00010000:00010000:1.0:1790771166.621005:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0dd09 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621011:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14113:x1877759533929600:12345-192.168.204.50@tcp:101:cat.0 Request processed in 848us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.621018:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13998:x1877759533943040:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.621019:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.621023:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 121 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621029:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6172 00010000:00010000:1.0:1790771166.621039:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.621047:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.621050:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c30380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759232:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.621055:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.621060:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.621065:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.621072:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xbc0ca3a9 (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.621074:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.621077:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.621081:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0dd17 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.621103:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 121 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.621112:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dcfb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621116:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.621125:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759360:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.621134:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13998:x1877759533943040:12345-192.168.204.50@tcp:35:ls.0 Request processed in 118us (1615us total) trans 4294969375 rc 0/0 00010000:00010000:1.0:1790771166.621138:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 108 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.621145:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1610 00010000:00010000:1.0:1790771166.621153:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:1.0:1790771166.621157:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.621160:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02c00, rc 0) 00000100:00100000:3.0:1790771166.621168:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943424 00000100:00100000:3.0:1790771166.621174:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943424 00010000:00010000:2.0:1790771166.621176:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621177:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.621190:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03023800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14806:x1877759533925760:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 678us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.621198:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759488:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.621200:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943552 00000100:00100000:1.0:1790771166.621205:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6173 00000100:00100000:0.0:1790771166.621206:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943552 00000100:00100000:3.0:1790771166.621216:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6175 00000100:00100000:3.0:1790771166.621227:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14768:x1877759533943424:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:0.0:1790771166.621243:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1611 00010000:00010000:2.0:1790771166.621245:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 120 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.621250:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.621255:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11374050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14808:x1877759533943552:12345-192.168.204.50@tcp:49:setfattr.0 00010000:00010000:3.0:1790771166.621267:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0d4c0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b3f expref: 94 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.621279:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c30700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759616:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.621279:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771166.621286:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.621307:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11374050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+93:14808:x1877759533943552:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 56us (135us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771166.621314:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1611 00010000:00010000:2.0:1790771166.621329:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 120 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.621334:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.621349:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759744:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.621372:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943936 00010000:00010000:3.0:1790771166.621372:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621377:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943936 00010000:00010000:3.0:1790771166.621388:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 107 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.621393:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 120 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.621394:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.621407:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533944064 00010000:00010000:3.0:1790771166.621408:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621412:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533944064 00000100:00100000:2.0:1790771166.621419:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759872:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.621437:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 107 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621445:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6176 00000100:00100000:1.0:1790771166.621451:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.621459:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14933:x1877759533943936:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.621466:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 107 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.621467:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 120 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.621511:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539760000:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.621515:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539760128:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.621517:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.621531:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.621536:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.621542:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943168 00010000:00010000:0.0:1790771166.621545:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.621549:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943168 00000100:00100000:3.0:1790771166.621549:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87540 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.621555:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943808 00000100:00100000:1.0:1790771166.621560:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943808 00000100:00100000:3.0:1790771166.621575:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6177 00000100:00100000:3.0:1790771166.621584:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14871:x1877759533944064:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:2.0:1790771166.621600:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1011 00000100:00100000:1.0:1790771166.621610:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 422 00010000:00010000:3.0:1790771166.621613:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.621618:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2398:x1877759533943168:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:1.0:1790771166.621626:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533943808:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:3.0:1790771166.621627:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 94 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.621640:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 107 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.621645:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000097151ddd reply state 00000000736a57b2 transno 4294969376 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.621646:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 5/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.621677:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.621684:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.621687:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.621689:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.621696:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 107 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.621705:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621714:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14933:x1877759533943936:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 258us (383us total) trans 4294969376 rc 0/0 00000100:00100000:3.0:1790771166.621715:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539760256:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.621727:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6176 00010000:00010000:3.0:1790771166.621766:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 94 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.621781:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 94 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.621790:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.621801:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539760384:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.621828:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87000 going to sleep for 11 seconds 00002000:00010000:1.0:1790771166.621830:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb size from disk: 5844 -> 5844 00002000:00010000:1.0:1790771166.621834:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:1.0:1790771166.621837:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb atime from disk: 1790771159 -> 0 00002000:00010000:1.0:1790771166.621839:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00002000:00010000:1.0:1790771166.621842:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb blocks from disk: 0 -> 16 00000100:00100000:3.0:1790771166.621854:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533943296 00000100:00100000:3.0:1790771166.621860:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533943296 00000100:00100000:1.0:1790771166.621865:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2398:x1877759533943808:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 246us (340us total) trans 4294967620 rc 0/0 00000100:00100000:1.0:1790771166.621872:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 422 00002000:00010000:3.0:1790771166.621886:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1790771166.621892:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03020e00 with x1877759533943296 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771166.621902:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03020e00. 00000100:00100000:3.0:1790771166.621930:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 423 00000100:00100000:3.0:1790771166.621940:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533943296:12345-192.168.204.50@tcp:10:cp.0 00010000:00010000:2.0:1790771166.622001:0:13763:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 120 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.622016:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa96300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539760512:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.622055:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113e06c0 going to sleep for 11 seconds 00002000:00010000:3.0:1790771166.622228:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 21450 -> 0 00002000:00010000:3.0:1790771166.622232:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790771163 -> 1790771166 00002000:00010000:3.0:1790771166.622234:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1790771165 -> 1752421453 00002000:00010000:3.0:1790771166.622235:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:3.0:1790771166.622237:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 56 -> 0 00000100:00100000:3.0:1790771166.622322:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2398:x1877759533943296:12345-192.168.204.50@tcp:10:cp.0 Request processed in 385us (536us total) trans 4294967621 rc 0/0 00000100:00100000:0.0:1790771166.622330:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.622336:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 423 00002000:00010000:3.0:1790771166.622340:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1790771166.622343:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03020e00 with x1877759533943296 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771166.622347:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03020e00. 00000100:00100000:3.0:1790771166.622363:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533944320 00000100:00100000:3.0:1790771166.622366:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533944320 00002000:00100000:3.0:1790771166.622385:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (0->4095) req@ffff8bfb03021880 x1877759533944320/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.622392:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03021880 with x1877759533944320 ext(0->4095) 00002000:00010000:3.0:1790771166.622396:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03021880 00000100:00100000:3.0:1790771166.622416:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 424 00000100:00100000:3.0:1790771166.622423:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2398:x1877759533944320:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771166.622438:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.622466:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.622513:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533945344 00000100:00100000:0.0:1790771166.622517:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533945344 00000100:00100000:0.0:1790771166.622550:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 833 00000100:00100000:0.0:1790771166.622559:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2397:x1877759533945344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.622561:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926144 00010000:00010000:0.0:1790771166.622566:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.622569:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926144 00010000:00010000:0.0:1790771166.622579:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0dc45 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e41 expref: 95 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.622592:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:3.0:1790771166.622597:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2398:x1877759533944320:12345-192.168.204.50@tcp:3:cat.0 Request processed in 172us (268us total) trans 0 rc 4096/4096 00010000:00010000:0.0:1790771166.622598:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.622607:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 424 00002000:00100000:3.0:1790771166.622614:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x11:0x0] (0->4095) req@ffff8bfb03021880 x1877759533944320/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.622622:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6178 00002000:00100000:3.0:1790771166.622625:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03021880 with x1877759533944320 ext(0->4095) 00000100:00100000:0.0:1790771166.622630:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2397:x1877759533945344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (161us total) trans 0 rc 0/0 00002000:00010000:3.0:1790771166.622632:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03021880 00000100:00100000:2.0:1790771166.622640:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14917:x1877759533926144:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.622646:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 833 00010000:00010000:3.0:1790771166.622706:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.622712:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.622719:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dd3a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d29 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.622740:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533929728 00010000:00010000:3.0:1790771166.622740:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dd3a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d29 expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.622756:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dd3a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d29 expref: 108 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.622764:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.622770:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.622771:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533929728 00010000:00010000:3.0:1790771166.622774:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669400, rc 0) 00000100:00100000:0.0:1790771166.622796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.622810:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939200 00000100:00100000:2.0:1790771166.622814:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939200 00000100:00100000:3.0:1790771166.622850:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03022300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14917:x1877759533926144:12345-192.168.204.50@tcp:101:ls.0 Request processed in 213us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.622851:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6179 00000100:00100000:3.0:1790771166.622867:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6178 00000100:00100000:2.0:1790771166.622868:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13293:x1877759533929728:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.622873:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.622885:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.622896:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dd41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d8b expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.622931:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.622935:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926272 00000100:00100000:3.0:1790771166.622941:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926272 00000100:00100000:0.0:1790771166.622946:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.622952:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.622964:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.622970:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.622994:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623001:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.623011:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533946112 00010000:00010000:2.0:1790771166.623012:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.623016:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533946112 00010000:00010000:2.0:1790771166.623026:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623034:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.623046:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533946624 00000100:00100000:3.0:1790771166.623051:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533946624 00000100:00100000:0.0:1790771166.623055:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533945856 00000100:00100000:0.0:1790771166.623059:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533945856 00000100:00100000:3.0:1790771166.623085:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6180 00000100:00100000:0.0:1790771166.623086:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947008 00010000:00010000:2.0:1790771166.623087:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dd56 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623091:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947008 00000100:00100000:3.0:1790771166.623097:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:11971:x1877759533939200:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.623105:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14912:x1877759533938560:12345-192.168.204.50@tcp:37:ls.0 Request processed in 29833us (31410us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.623106:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dd56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623110:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.623115:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1612 00010000:00010000:3.0:1790771166.623122:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd5d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e33 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623128:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dd56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.623130:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1604 00000100:00100000:0.0:1790771166.623131:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14400:x1877759533945856:12345-192.168.204.50@tcp:35:lfs.0 00000004:00200000:2.0:1790771166.623164:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.623165:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.623169:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.623175:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1613 00010000:00010000:3.0:1790771166.623179:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.623186:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:13884:x1877759533947008:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.623189:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.623191:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dd56 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623208:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.623215:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.623216:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.623220:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.623230:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.623234:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623237:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.623245:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623250:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14400:x1877759533945856:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 123us (305us total) trans 4294968763 rc 0/0 00010000:00010000:3.0:1790771166.623261:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd5d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623266:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623267:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1612 00000100:00100000:1.0:1790771166.623281:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:13884:x1877759533947008:12345-192.168.204.50@tcp:35:ls.0 Request processed in 95us (249us total) trans 4294968764 rc 0/0 00010000:00010000:2.0:1790771166.623291:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.623292:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.623294:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1613 00000100:00100000:0.0:1790771166.623299:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6181 00010000:00010000:2.0:1790771166.623301:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.623308:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623309:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000100:00100000:0.0:1790771166.623314:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14914:x1877759533926272:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.623316:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.623321:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669800, rc 0) 00010000:00010000:0.0:1790771166.623327:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.623329:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0dd48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.623338:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6182 00010000:00010000:0.0:1790771166.623339:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dd6b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d30 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623346:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.623350:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:11971:x1877759533939200:12345-192.168.204.50@tcp:101:ls.0 Request processed in 255us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.623358:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14822:x1877759533946112:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:0.0:1790771166.623366:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dd6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d30 expref: 109 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.623370:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6180 00010000:00010000:2.0:1790771166.623371:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623389:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.623390:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dd6b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d30 expref: 109 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.623391:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6183 00000100:00100000:3.0:1790771166.623404:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:14769:x1877759533946624:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:2.0:1790771166.623412:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.623414:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.623418:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.623418:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.623423:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00010000:00010000:3.0:1790771166.623430:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.623432:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623444:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058af400/0xfa0c505d97f0d73d lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba1 expref: 97 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623446:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9b50d0cc (ffff8bfc0786ee00) 00000100:00100000:0.0:1790771166.623449:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14914:x1877759533926272:12345-192.168.204.50@tcp:101:ls.0 Request processed in 137us (577us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.623455:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.623462:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.623466:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6181 00010000:00010000:3.0:1790771166.623468:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc29009200) 00010000:00010000:1.0:1790771166.623473:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623481:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.623506:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.623514:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623520:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0dd4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.623527:0:12030:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623527:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623547:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.623549:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623557:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623560:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0dd41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d8b expref: 123 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623587:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1c00/0xfa0c505d97f0dd56 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d8b expref: 122 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.623595:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:2.0:1790771166.623599:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1790771166.623602:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1c00, rc 0) 00000100:00100000:2.0:1790771166.623642:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13293:x1877759533929728:12345-192.168.204.50@tcp:101:ls.0 Request processed in 780us (931us total) trans 0 rc 0/0 00000001:00080000:1.0:1790771166.623645:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967618 is committed 00000100:00100000:2.0:1790771166.623672:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6179 00000004:00010000:3.0:1790771166.623682:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001030d39d reply state 0000000065c932bd transno 4294968766 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.623692:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771166.623694:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967613 is committed 00010000:00010000:3.0:1790771166.623702:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc1040f000) 00010000:00010000:3.0:1790771166.623705:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.623707:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771166.623711:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.623782:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533943168:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2172us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.623791:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1011 00000100:00100000:3.0:1790771166.623799:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14769:x1877759533946624:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 396us (799us total) trans 4294968766 rc 0/0 00000100:00100000:3.0:1790771166.623807:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6183 00000100:00100000:0.0:1790771166.637969:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.638021:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926912 00000100:00100000:3.0:1790771166.638031:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926912 00000100:00100000:3.0:1790771166.638083:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6184 00000100:00100000:3.0:1790771166.638093:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13742:x1877759533926912:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.638115:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.638128:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0dd80 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d4c expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638184:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638195:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638202:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638214:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638219:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638223:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.638299:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.638351:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638356:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638361:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638365:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638369:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.638371:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638376:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638384:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.638386:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.638390:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638394:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dd87 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638403:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638407:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638411:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638414:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.638416:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638420:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638424:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9b50d0cc (ffff8bfc1040fa00) 00010000:00010000:3.0:1790771166.638425:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.638427:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638430:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0dd8e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638454:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0dd80 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d4c expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638464:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.638466:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.638468:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0dd80 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d4c expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.638475:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00000100:00100000:3.0:1790771166.638542:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13742:x1877759533926912:12345-192.168.204.50@tcp:101:ls.0 Request processed in 450us (578us total) trans 4294968767 rc 301/301 00000100:00100000:3.0:1790771166.638547:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6184 00000100:00100000:0.0:1790771166.639087:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.639123:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926400 00000100:00100000:3.0:1790771166.639129:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926400 00000100:00100000:0.0:1790771166.639152:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.639167:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6185 00000100:00100000:0.0:1790771166.639175:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.639182:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14911:x1877759533926400:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.639190:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.639199:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd9c lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d37 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639209:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757056:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.639212:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.639218:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd9c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d37 expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639230:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.639231:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd9c lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d37 expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.639235:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947264 00000100:00100000:0.0:1790771166.639240:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947776 00000100:00100000:2.0:1790771166.639243:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947264 00010000:00010000:3.0:1790771166.639246:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771166.639247:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947776 00000100:00100000:1.0:1790771166.639248:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539757312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.639251:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.639257:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668800, rc 0) 00000100:00100000:0.0:1790771166.639288:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6186 00010000:00010000:1.0:1790771166.639289:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 3/0,0 mode: --/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [28672->32767] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd8 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.639295:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14911:x1877759533926400:12345-192.168.204.50@tcp:101:ls.0 Request processed in 113us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.639300:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533946368 00000100:00100000:0.0:1790771166.639305:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14452:x1877759533947776:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:2.0:1790771166.639308:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533946368 00000100:00100000:3.0:1790771166.639313:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6185 00010000:00010000:1.0:1790771166.639321:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3ab600, rc 0) 00010000:00010000:0.0:1790771166.639337:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.639353:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14730:x1877759533936512:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 48343us (50205us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.639354:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0b31e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ece expref: 111 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.639363:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 834 00000100:00100000:1.0:1790771166.639371:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1009 00000100:00100000:3.0:1790771166.639376:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 835 00010000:00010000:0.0:1790771166.639380:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:2.0:1790771166.639383:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:2396:x1877759533947264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.639386:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.639393:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:2396:x1877759533946368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.639400:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.639403:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.639407:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.639421:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0db11 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c65 expref: 99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639422:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.639425:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105000/0xfa0c505d97f0db34 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c5e expref: 99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639440:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.639446:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639456:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.639462:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771166.639465:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926656 00010000:00010000:0.0:1790771166.639468:0:13767:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 4/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639470:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926656 00010000:00010000:2.0:1790771166.639471:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639520:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639530:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6187 00010000:00010000:2.0:1790771166.639542:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.639543:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14909:x1877759533926656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.639557:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.639558:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.639558:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.639564:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639568:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.639571:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ddaa lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d45 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.639578:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.639586:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.639591:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:2396:x1877759533947264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 212us (435us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.639596:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d45 expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.639610:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 834 00000100:00100000:3.0:1790771166.639611:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:2396:x1877759533946368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 223us (437us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.639612:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ddaa lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d45 expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639624:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.639631:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 835 00010000:00010000:1.0:1790771166.639632:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.639636:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.639638:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03c00, rc 0) 00000100:00100000:2.0:1790771166.639645:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947520 00000100:00100000:2.0:1790771166.639651:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947520 00000100:00100000:3.0:1790771166.639654:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948160 00000100:00100000:3.0:1790771166.639674:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948160 00000100:00100000:1.0:1790771166.639681:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14909:x1877759533926656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.639691:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6187 00010000:00010000:2.0:1790771166.639691:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 23 pid: 8408 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.639693:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 26 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639696:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.639718:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947904 00000100:00100000:1.0:1790771166.639723:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947904 00000100:00100000:0.0:1790771166.639735:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.639740:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 24 pid: 13793 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.639747:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1704 00000100:00100000:2.0:1790771166.639758:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1705 00000100:00100000:0.0:1790771166.639765:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.639765:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2398:x1877759533948160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.639777:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533947520:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.639781:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.639789:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.639790:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1706 00010000:00010000:3.0:1790771166.639800:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 26 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639808:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533926528 00000100:00100000:1.0:1790771166.639808:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533947904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.639809:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 24 pid: 8408 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639814:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533926528 00010000:00010000:1.0:1790771166.639825:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.639830:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 26 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639839:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533930240 00000100:00100000:0.0:1790771166.639842:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533930240 00010000:00010000:2.0:1790771166.639848:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 24 pid: 8408 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639858:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6188 00010000:00010000:1.0:1790771166.639863:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 4/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 24 pid: 13793 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.639868:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14913:x1877759533926528:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.639874:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e4af9de/0xfa0c505d97f0b5cc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351de expref: 26 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.639881:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002694201b/0xfa0c505d97f0bc7f lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35358 expref: 24 pid: 8408 timeout: 266 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639884:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.639886:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 24 pid: 13793 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639894:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ddb1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d3e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.639916:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.639924:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771166.639925:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004372c1eb/0xfa0c505d97f0bccc lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0xd:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3539e expref: 23 pid: 13793 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639926:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ddb1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d3e expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.639937:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xd:0x0].0x0 since=0s v=(2 0) 00000100:00100000:3.0:1790771166.639940:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533948160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 180us (325us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.639958:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd8 expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.639959:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1704 00010000:00010000:0.0:1790771166.639960:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ddb1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d3e expref: 113 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639984:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.639989:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.639991:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd8 expref: 24 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.639992:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391e00, rc 0) 00010000:00010000:1.0:1790771166.640005:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.640014:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6189 00000100:00100000:0.0:1790771166.640019:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14913:x1877759533926528:12345-192.168.204.50@tcp:101:ls.0 Request processed in 153us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.640027:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:12241:x1877759533930240:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.640029:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6188 00010000:00010000:2.0:1790771166.640034:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000a58b030/0xfa0c505d97f0db6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->32767) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd8 expref: 24 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.640036:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2398:x1877759533947904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 230us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.640048:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.640051:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1706 00010000:00010000:3.0:1790771166.640066:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0ddb8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d99 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.640067:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539760640:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.640112:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0ddbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.640119:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539757440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.640120:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.640132:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.640133:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1106fe40 going to sleep for 11 seconds 00000004:00200000:3.0:1790771166.640159:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.640162:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.640175:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c32d80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539757568:192.168.204.50@tcp:104: 00000004:00010000:3.0:1790771166.640175:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0ddbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.640187:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.640198:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.640203:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0ddb8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d99 expref: 124 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.640220:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f600/0xfa0c505d97f0ddbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d99 expref: 123 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.640225:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:3.0:1790771166.640228:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.640230:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533f600, rc 0) 00000100:00100000:2.0:1790771166.640237:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948800 00000100:00100000:2.0:1790771166.640244:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948800 00000100:00100000:3.0:1790771166.640257:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12241:x1877759533930240:12345-192.168.204.50@tcp:101:ls.0 Request processed in 236us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.640265:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6189 00000100:00100000:1.0:1790771166.640270:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.640297:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948928 00000100:00100000:1.0:1790771166.640300:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948928 00000100:00100000:2.0:1790771166.640304:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6190 00010000:00010000:1.0:1790771166.640318:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 96 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.640320:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14784:x1877759533948800:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:1.0:1790771166.640355:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1707 00000100:00100000:1.0:1790771166.640363:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+96:2396:x1877759533948928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.640370:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640371:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.640378:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 96 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.640393:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640399:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 96 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.640409:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640420:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0d54c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b70 expref: 96 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640431:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:1.0:1790771166.640434:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640439:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640443:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.640468:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2396:x1877759533948928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.640472:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1707 00000004:00010000:2.0:1790771166.640565:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051815815 reply state 000000009efbb71d transno 4294969377 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.640577:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.640585:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.640588:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1790771166.640591:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771166.640596:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.640645:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14784:x1877759533948800:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 331us (462us total) trans 4294969377 rc 0/0 00000100:00100000:2.0:1790771166.640653:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6190 00000100:00100000:0.0:1790771166.640745:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.640767:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.640790:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.640812:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533949184 00000100:00100000:1.0:1790771166.640817:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533949184 00000100:00100000:2.0:1790771166.640832:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948672 00000100:00100000:3.0:1790771166.640838:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533949056 00000100:00100000:2.0:1790771166.640840:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948672 00000100:00100000:1.0:1790771166.640853:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 836 00000100:00100000:0.0:1790771166.640854:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020a80 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757696:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.640864:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2396:x1877759533949184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.640866:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 113 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640873:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.640888:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0dba4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e02 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640899:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.640902:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.640908:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1708 00000100:00100000:3.0:1790771166.640913:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533949056 00000100:00100000:0.0:1790771166.640920:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.640925:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2396:x1877759533948672:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.640930:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759533949184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.640939:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 836 00010000:00010000:2.0:1790771166.640942:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.640949:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533949568 00010000:00010000:2.0:1790771166.640951:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 114 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.640953:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533949568 00000100:00100000:1.0:1790771166.640959:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 837 00010000:00010000:3.0:1790771166.640968:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 95 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.640975:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2396:x1877759533949056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.640978:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 114 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.640991:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.641004:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0d935 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cc7 expref: 114 pid: 13765 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.641005:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1709 00010000:00010000:1.0:1790771166.641008:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0dc29 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d14 expref: 114 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.641016:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03020000 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757824:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.641042:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771166.641042:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:1.0:1790771166.641050:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.641052:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.641063:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.641066:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2399:x1877759533949568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.641079:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03021500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539757952:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.641080:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.641085:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.641095:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2396:x1877759533949056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 121us (299us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.641096:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 95 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.641112:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 837 00010000:00010000:2.0:1790771166.641116:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.641116:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 95 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.641133:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0d50d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b5b expref: 95 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.641144:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.641147:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.641152:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.641157:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.641163:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759533948672:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 242us (390us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.641168:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.641176:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1708 00010000:00010000:0.0:1790771166.641178:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.641269:0:13771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968768 00000004:00010000:0.0:1790771166.641290:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9401369 reply state 00000000912b619b transno 4294968769 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641297:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641305:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:0.0:1790771166.641306:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.641308:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.641345:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14823:x1877759533938816:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 48977us (49068us total) trans 4294968769 rc 0/0 00000100:00100000:0.0:1790771166.641350:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6160 00000020:00080000:0.0:1790771166.641353:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771166.641405:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2399:x1877759533949568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 344us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.641413:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1709 00000100:00100000:0.0:1790771166.641440:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03021180 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539758080:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.641465:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.641478:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539758208:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.641526:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e48 expref: 21 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641536:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02200, rc 0) 00000100:00100000:1.0:1790771166.641557:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:10887:x1877759533940608:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 47452us (47677us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.641564:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1010 00000100:00100000:0.0:1790771166.641594:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.641617:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533949824 00000100:00100000:1.0:1790771166.641621:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533949824 00010000:00010000:1.0:1790771166.641635:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 113 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.641678:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1710 00000100:00100000:0.0:1790771166.641686:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.641691:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2399:x1877759533949824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.641700:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.641705:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 113 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641714:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 113 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641725:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0cd42 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3592b expref: 113 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641733:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.641736:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641741:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.641745:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.641761:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533930624 00000100:00100000:3.0:1790771166.641768:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533930624 00000100:00100000:1.0:1790771166.641769:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2399:x1877759533949824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.641776:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1710 00000100:00100000:0.0:1790771166.641821:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6191 00000100:00100000:0.0:1790771166.641829:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14489:x1877759533930624:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771166.641837:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.641846:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0ddcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35da0 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641870:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641878:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641883:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641898:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641904:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641909:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.641919:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.641954:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.641961:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.641963:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950848 00010000:00010000:0.0:1790771166.641967:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.641970:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950848 00000004:00200000:0.0:1790771166.641982:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 47794 00000004:00200000:0.0:1790771166.641985:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.641994:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642001:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642007:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642012:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.642015:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6192 00010000:00010000:0.0:1790771166.642025:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642031:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.642034:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:14944:x1877759533950848:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.642039:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfca00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.642043:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642048:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642049:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.642056:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.642060:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.642062:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642069:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0dde9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35edb expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642070:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0ddd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642081:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642088:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642092:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642096:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfcc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.642098:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642102:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642107:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd6e9df9d (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.642109:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.642111:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642118:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0dddb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642118:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642135:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642140:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0ddcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da0 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642157:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642158:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc000/0xfa0c505d97f0dde2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da0 expref: 126 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.642175:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771166.642178:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:0.0:1790771166.642181:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc000, rc 0) 00000004:00200000:2.0:1790771166.642202:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.642207:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.642211:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14489:x1877759533930624:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 383us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.642218:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6191 00000004:00010000:2.0:1790771166.642224:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642250:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0dde9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 96 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642270:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 95 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642280:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.642282:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.642286:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00000100:00100000:2.0:1790771166.642325:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14944:x1877759533950848:12345-192.168.204.50@tcp:101:ln.0 Request processed in 298us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.642334:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6192 00000100:00100000:1.0:1790771166.642576:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.642599:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.642607:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950976 00000100:00100000:2.0:1790771166.642613:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950976 00000100:00100000:1.0:1790771166.642622:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.642625:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951104 00000100:00100000:0.0:1790771166.642630:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951104 00000100:00100000:2.0:1790771166.642649:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6193 00000100:00100000:2.0:1790771166.642678:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14601:x1877759533950976:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:1.0:1790771166.642688:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1614 00010000:00010000:2.0:1790771166.642688:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.642702:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14657:x1877759533951104:12345-192.168.204.50@tcp:35:touch.0 00010000:00010000:2.0:1790771166.642703:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ddf7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ee2 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.642703:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931136 00000100:00100000:3.0:1790771166.642711:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931136 00000100:00100000:3.0:1790771166.642742:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6194 00010000:00010000:2.0:1790771166.642748:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.642755:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14573:x1877759533931136:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771166.642764:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.642771:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.642783:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.642785:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0de05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35da7 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.642807:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771166.642815:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.642821:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.642850:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ddf7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.642855:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14657:x1877759533951104:12345-192.168.204.50@tcp:35:touch.0 Request processed in 154us (251us total) trans 4294969378 rc 0/0 00000100:00100000:0.0:1790771166.642867:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.642872:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1614 00010000:00010000:2.0:1790771166.642881:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 113 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.642890:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.642894:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.642895:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950720 00010000:00010000:2.0:1790771166.642898:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3200, rc 0) 00000100:00100000:1.0:1790771166.642899:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950720 00000100:00100000:1.0:1790771166.642928:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 838 00000100:00100000:1.0:1790771166.642935:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2396:x1877759533950720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.642941:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.642947:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.642948:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14601:x1877759533950976:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 287us (367us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.642955:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0dbc0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e09 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.642968:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6193 00000100:00100000:0.0:1790771166.642969:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.642971:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.642976:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.642994:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533942528 00000100:00100000:2.0:1790771166.643001:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533942528 00000100:00100000:1.0:1790771166.643002:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759533950720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64us (136us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.643011:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.643013:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 838 00010000:00010000:3.0:1790771166.643025:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.643039:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533930368 00000100:00100000:2.0:1790771166.643045:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533930368 00000100:00100000:1.0:1790771166.643046:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6195 00010000:00010000:3.0:1790771166.643046:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.643059:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:12121:x1877759533942528:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.643067:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.643075:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0de1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dae expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.643089:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6196 00000100:00100000:2.0:1790771166.643102:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14003:x1877759533930368:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.643113:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643114:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.643128:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643132:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643132:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0de28 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35bd2 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643149:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643176:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643183:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643190:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.643201:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.643207:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643219:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643226:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643229:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.643236:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.643254:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643264:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643268:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643272:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643275:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643283:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643289:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643306:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643307:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643323:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.643326:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643334:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643338:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643344:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.643350:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.643354:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.643355:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.643358:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 120 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643369:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0de21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.643376:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539760768:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.643379:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643385:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643389:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643394:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.643397:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643401:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643405:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643407:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.643413:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.643417:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.643419:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8b3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.643421:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643442:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0de2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643444:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643456:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643469:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.643474:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951360 00010000:00010000:2.0:1790771166.643475:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643477:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0de1a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dae expref: 120 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.643480:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951360 00010000:00010000:1.0:1790771166.643528:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.643534:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.643540:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0de1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dae expref: 120 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643544:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.643547:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03400, rc 0) 00010000:00010000:2.0:1790771166.643563:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.643567:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.643571:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.643578:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:12121:x1877759533942528:12345-192.168.204.50@tcp:101:ls.0 Request processed in 521us (772us total) trans 4294969379 rc 301/301 00010000:00010000:2.0:1790771166.643583:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0de36 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.643590:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6195 00000100:00100000:3.0:1790771166.643590:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 839 00000100:00100000:3.0:1790771166.643606:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759533951360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.643611:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643614:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.643624:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643630:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0dc99 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d6f expref: 131 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643638:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.643646:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:2.0:1790771166.643647:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.643654:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.643655:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643679:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643694:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0786e900) 00010000:00010000:2.0:1790771166.643697:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.643701:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643708:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0de3d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.643734:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759533951360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (531us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.643740:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0de28 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bd2 expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.643748:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 839 00010000:00010000:2.0:1790771166.643758:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.643762:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.643768:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0de28 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bd2 expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.643779:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104200, rc 0) 00000100:00100000:2.0:1790771166.643814:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14003:x1877759533930368:12345-192.168.204.50@tcp:101:ls.0 Request processed in 716us (849us total) trans 4294969380 rc 301/301 00000100:00100000:2.0:1790771166.643822:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6196 00000100:00100000:0.0:1790771166.646457:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.646534:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533941888 00000100:00100000:2.0:1790771166.646540:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533941888 00000100:00100000:2.0:1790771166.646576:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6197 00000100:00100000:2.0:1790771166.646584:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:13736:x1877759533941888:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.646597:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.646606:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de59 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e4f expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646650:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646677:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646686:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646701:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646708:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646714:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.646769:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.646809:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646817:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646823:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646830:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646836:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.646840:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646847:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646857:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.646860:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.646863:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646868:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0de60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646878:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646885:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646891:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646897:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.646901:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646907:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646915:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc0786e700) 00010000:00010000:2.0:1790771166.646917:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.646920:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646927:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0de67 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646954:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de59 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e4f expref: 115 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646965:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.646967:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.646971:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de59 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e4f expref: 115 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.646982:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105800, rc 0) 00000100:00100000:2.0:1790771166.647018:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13736:x1877759533941888:12345-192.168.204.50@tcp:101:ls.0 Request processed in 434us (561us total) trans 4294968770 rc 301/301 00000100:00100000:2.0:1790771166.647026:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6197 00000100:00100000:0.0:1790771166.647441:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.647473:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950464 00000100:00100000:1.0:1790771166.647478:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950464 00010000:00010000:1.0:1790771166.647511:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 114 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.647532:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1711 00000100:00100000:1.0:1790771166.647538:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2396:x1877759533950464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.647544:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.647548:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 114 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.647560:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 114 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.647570:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82400/0xfa0c505d97f0bfd5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35423 expref: 114 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.647578:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.647582:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.647587:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.647591:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.647612:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2396:x1877759533950464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.647616:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1711 00000100:00100000:1.0:1790771166.698674:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.698677:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.698710:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.698734:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.698749:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951232 00000100:00100000:2.0:1790771166.698760:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951232 00000100:00100000:0.0:1790771166.698769:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.698770:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533944448 00000100:00100000:1.0:1790771166.698776:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533944448 00000100:00100000:1.0:1790771166.698823:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950080 00000100:00100000:1.0:1790771166.698825:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950080 00000100:00100000:0.0:1790771166.698829:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951488 00000100:00100000:2.0:1790771166.698832:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 840 00000100:00100000:0.0:1790771166.698837:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951488 00000100:00100000:2.0:1790771166.698849:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2396:x1877759533951232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.698850:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951744 00000100:00100000:1.0:1790771166.698855:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951744 00000100:00100000:3.0:1790771166.698863:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6198 00010000:00010000:2.0:1790771166.698869:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.698881:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:13737:x1877759533944448:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.698897:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6199 00010000:00010000:2.0:1790771166.698898:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0dbdc lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e10 expref: 122 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.698903:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.698910:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6200 00000100:00100000:0.0:1790771166.698916:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:11335:x1877759533950080:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771166.698924:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0de75 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35de6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.698928:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.698932:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790771166.698933:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00000100:00100000:1.0:1790771166.698934:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14271:x1877759533951488:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:2.0:1790771166.698945:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.698950:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0cc93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35780 expref: 121 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.698965:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:0.0:1790771166.698969:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.698977:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0de7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dfb expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.699004:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2396:x1877759533951232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.699012:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 840 00000100:00100000:2.0:1790771166.699047:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6201 00010000:00010000:3.0:1790771166.699047:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.699062:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14727:x1877759533951744:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.699065:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699074:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699080:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699084:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.699091:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.699093:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699105:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699107:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14271:x1877759533951488:12345-192.168.204.50@tcp:36:ln.0 Request processed in 183us (373us total) trans 0 rc -17/-17 00010000:00010000:0.0:1790771166.699114:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699124:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6200 00010000:00010000:0.0:1790771166.699134:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699139:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 120 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699143:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699159:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.699167:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699178:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699188:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 119 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699195:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0dea6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699200:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 119 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699206:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699220:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.699223:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699225:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0dea6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699236:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937408 00010000:00010000:3.0:1790771166.699242:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0de75 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699243:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937408 00000004:00200000:0.0:1790771166.699245:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 5 00010000:00010000:2.0:1790771166.699250:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 119 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699264:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 10/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699266:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 115 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699268:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533939456 00000100:00100000:1.0:1790771166.699273:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533939456 00010000:00010000:3.0:1790771166.699286:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:3.0:1790771166.699289:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.699292:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1e00, rc 0) 00010000:00010000:0.0:1790771166.699296:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699300:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6202 00010000:00010000:0.0:1790771166.699309:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699317:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699319:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13208:x1877759533937408:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.699320:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699338:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699342:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.699344:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.699348:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 121 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699350:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699358:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0deb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35d92 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.699367:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13737:x1877759533944448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 443us (662us total) trans 4294968771 rc 0/0 00010000:00010000:0.0:1790771166.699369:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.699387:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539760896:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.699389:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6198 00010000:00010000:0.0:1790771166.699392:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:0.0:1790771166.699398:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.699401:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699406:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0de8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.699411:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6203 00010000:00010000:0.0:1790771166.699417:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699419:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699429:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699437:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699438:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699456:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.699463:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699464:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.699469:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:11969:x1877759533939456:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.699478:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 121 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699519:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699521:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699533:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 121 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699538:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0xb62e0cbf (ffff8bfc3607aa00) 00010000:00010000:1.0:1790771166.699542:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699545:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.699551:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699551:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.699563:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0dec9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e3a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.699570:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa96680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.699571:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0de98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699584:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699614:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699620:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0de7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dfb expref: 123 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699623:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699633:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699639:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699642:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699643:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0dea6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dfb expref: 122 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699679:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.699687:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:1.0:1790771166.699688:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699691:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 122 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.699693:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.699698:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc800, rc 0) 00010000:00010000:1.0:1790771166.699707:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699713:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 7/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.699715:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.699717:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.699725:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.699728:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:11335:x1877759533950080:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 817us (1015us total) trans 4294969381 rc 0/0 00010000:00010000:1.0:1790771166.699730:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699730:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.699745:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6199 00010000:00010000:1.0:1790771166.699753:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0debb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699764:0:6493:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 7/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699765:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699774:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 121 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699785:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699795:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699798:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 121 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699800:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.699804:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699818:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.699822:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699826:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfb03218200) 00000100:00100000:2.0:1790771166.699826:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761280:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.699832:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.699837:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.699843:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.699849:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0dec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.699875:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0deb4 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d92 expref: 129 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.699884:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.699886:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.699893:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.699899:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.699902:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 121 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.699907:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533952512 00010000:00010000:1.0:1790771166.699908:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0deb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d92 expref: 129 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.699912:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533952512 00000100:00100000:3.0:1790771166.699917:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533952000 00000100:00100000:3.0:1790771166.699924:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533952000 00000100:00100000:2.0:1790771166.699931:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.699932:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2c00, rc 0) 00000100:00100000:0.0:1790771166.699947:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1615 00002000:00100000:3.0:1790771166.699955:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (548864->552959) req@ffff8bfb06ba3480 x1877759533952000/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.699960:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14000:x1877759533952512:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.699975:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.699977:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13208:x1877759533937408:12345-192.168.204.50@tcp:101:ls.0 Request processed in 660us (815us total) trans 0 rc 301/301 00002000:00100000:3.0:1790771166.699978:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba3480 with x1877759533952000 ext(548864->552959) 00002000:00010000:3.0:1790771166.699986:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba3480 00000100:00100000:1.0:1790771166.700007:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6202 00010000:00010000:2.0:1790771166.700007:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 129 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.700014:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 425 00000100:00100000:3.0:1790771166.700027:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533952000:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771166.700031:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa94380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761536:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.700069:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14000:x1877759533952512:12345-192.168.204.50@tcp:35:ls.0 Request processed in 113us (185us total) trans 4294969382 rc 0/0 00000100:00100000:0.0:1790771166.700077:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1615 00010000:00010000:2.0:1790771166.700077:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 121 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700094:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 121 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700110:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.700123:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761664:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.700140:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950336 00000100:00100000:1.0:1790771166.700146:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950336 00000100:00100000:2.0:1790771166.700157:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f50300 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.700168:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 115 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700169:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.700176:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759533952000:12345-192.168.204.50@tcp:3:cat.0 Request processed in 149us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.700189:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 425 00002000:00100000:3.0:1790771166.700195:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (548864->552959) req@ffff8bfb06ba3480 x1877759533952000/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771166.700203:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06ba3480 with x1877759533952000 ext(548864->552959) 00002000:00010000:3.0:1790771166.700206:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06ba3480 00000100:00100000:1.0:1790771166.700214:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1712 00000100:00100000:0.0:1790771166.700220:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.700228:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2399:x1877759533950336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.700234:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533952128 00000100:00100000:3.0:1790771166.700238:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533952128 00010000:00010000:1.0:1790771166.700240:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.700248:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 115 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.700255:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533950592 00000100:00100000:2.0:1790771166.700262:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533950592 00010000:00010000:1.0:1790771166.700265:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 115 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700267:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.700274:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1012 00000100:00100000:0.0:1790771166.700291:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533952896 00000100:00100000:3.0:1790771166.700292:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2399:x1877759533952128:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771166.700293:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0bfdc lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3542a expref: 115 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700293:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700295:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533952896 00010000:00010000:3.0:1790771166.700307:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.700321:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003777eef6/0xfa0c505d97f0ded7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ef0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.700325:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:0.0:1790771166.700328:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1013 00010000:00010000:1.0:1790771166.700337:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700341:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759533952896:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:2.0:1790771166.700348:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1713 00010000:00010000:1.0:1790771166.700359:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.700365:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539761792:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771166.700366:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533950592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.700378:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700385:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.700395:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.700399:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc08545b40 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.700401:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.700414:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700425:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2399:x1877759533950336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (318us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771166.700429:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 2272 -> 2272 00000100:00100000:1.0:1790771166.700433:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1712 00002000:00010000:0.0:1790771166.700436:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00010000:00010000:2.0:1790771166.700437:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea52ba6/0xfa0c505d97efbf7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2fa42 expref: 25 pid: 8408 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.700440:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771166.700445:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.700451:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:3.0:1790771166.700453:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700463:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700466:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790771166.700472:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(1 0) 00000100:00100000:0.0:1790771166.700478:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533952896:12345-192.168.204.50@tcp:2:chown.0 Request processed in 137us (213us total) trans 4294967622 rc 0/0 00000100:00100000:1.0:1790771166.700509:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.700513:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1013 00010000:00010000:2.0:1790771166.700518:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e48 expref: 24 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700539:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e48 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700561:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.700574:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000211be541/0xfa0c505d97f0dc68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e48 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700578:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700592:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533951616 00010000:00010000:3.0:1790771166.700595:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700596:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533951616 00000100:00100000:2.0:1790771166.700603:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1877759539761920:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.700606:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700615:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.700619:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700625:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700632:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6204 00010000:00010000:3.0:1790771166.700640:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771166.700641:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13265:x1877759533951616:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.700649:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.700671:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.700671:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 2/0,0 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700683:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0dc5a lrc: 0/0,0 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.700685:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dede lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.700688:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.700725:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953024 00000100:00100000:2.0:1790771166.700731:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953024 00000100:00100000:3.0:1790771166.700737:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14716:x1877759533940096:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 107166us (107292us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771166.700739:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.700756:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6165 00010000:00010000:1.0:1790771166.700758:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700758:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 124 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.700776:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700781:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.700800:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.700803:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.700807:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953408 00000100:00100000:2.0:1790771166.700812:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953408 00000100:00100000:0.0:1790771166.700817:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.700821:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1714 00000100:00100000:1.0:1790771166.700834:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2398:x1877759533953024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.700835:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700846:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.700853:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.700860:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 125 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700863:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533931520 00000100:00100000:0.0:1790771166.700868:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533931520 00010000:00010000:1.0:1790771166.700874:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 125 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.700876:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953536 00000100:00100000:2.0:1790771166.700883:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953536 00010000:00010000:1.0:1790771166.700887:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.700892:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700899:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6205 00010000:00010000:1.0:1790771166.700900:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.700909:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 126 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.700910:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14579:x1877759533931520:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:1.0:1790771166.700910:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.700925:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.700931:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.700935:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0deec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35db5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.700947:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1715 00000100:00100000:2.0:1790771166.700956:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1716 00000100:00100000:3.0:1790771166.700961:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2398:x1877759533953408:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.700963:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2398:x1877759533953024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 131us (400us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.700964:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.700973:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.700977:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2397:x1877759533953536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.700984:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 126 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.700985:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1714 00010000:00010000:0.0:1790771166.701000:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701007:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.701009:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 125 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701011:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.701015:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701019:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 125 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701038:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701046:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701048:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 126 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.701054:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0dede lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701057:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701076:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771166.701081:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.701085:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 125 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.701096:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.701098:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.701100:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1e00, rc 0) 00010000:00010000:0.0:1790771166.701104:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701111:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701116:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.701122:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13265:x1877759533951616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 480us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.701128:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6204 00000004:00200000:0.0:1790771166.701136:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x61:0x0]: returning size 0 00000004:00200000:0.0:1790771166.701142:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.701153:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.701154:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701164:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701168:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701171:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.701181:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.701182:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701191:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701192:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.701202:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2398:x1877759533953408:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 243us (421us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.701214:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701218:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.701219:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.701224:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1715 00010000:00010000:0.0:1790771166.701233:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701238:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701240:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.701240:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954176 00000100:00100000:1.0:1790771166.701246:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954176 00010000:00010000:0.0:1790771166.701247:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701253:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.701257:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701267:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.701269:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.701271:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701277:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0def3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.701282:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1616 00000100:00100000:2.0:1790771166.701289:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2397:x1877759533953536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 315us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.701290:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c33480 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759104:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771166.701293:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.701299:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14199:x1877759533954176:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:3.0:1790771166.701309:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c30380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759232:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.701314:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1716 00010000:00010000:0.0:1790771166.701315:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701324:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701328:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfde00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.701331:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701336:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701343:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xea196397 (ffff8bfc3607a500) 00010000:00010000:0.0:1790771166.701345:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.701347:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701351:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0defa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701380:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0deec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 131 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701389:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 130 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701394:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00010000:00010000:0.0:1790771166.701395:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.701397:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfcc00, rc 0) 00000100:00100000:0.0:1790771166.701416:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14579:x1877759533931520:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 511us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.701424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6205 00000100:00100000:1.0:1790771166.701451:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14199:x1877759533954176:12345-192.168.204.50@tcp:35:cat.0 Request processed in 157us (238us total) trans 4294969383 rc 0/0 00000100:00100000:1.0:1790771166.701457:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1616 00000100:00100000:0.0:1790771166.701463:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.701483:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954304 00000100:00100000:1.0:1790771166.701510:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954304 00000100:00100000:1.0:1790771166.701547:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1617 00000100:00100000:1.0:1790771166.701556:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11375050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12252:x1877759533954304:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771166.701565:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c33b80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759360:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.701577:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c33800 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759488:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.701592:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c30700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759616:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.701606:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759744:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771166.701615:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539759872:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.701652:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:7771:1877759539760000:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.701679:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539760256:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.701688:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.701692:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.701700:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539760384:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.701726:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.701734:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954688 00000100:00100000:2.0:1790771166.701741:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954688 00000100:00100000:0.0:1790771166.701745:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.701765:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954944 00010000:00010000:2.0:1790771166.701766:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 95 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.701766:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa94a80 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539760128:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.701769:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954944 00000100:00100000:3.0:1790771166.701790:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa96300 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0000_UUID:13763:1877759539760512:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.701797:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6206 00000100:00100000:0.0:1790771166.701806:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14616:x1877759533954944:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.701814:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.701816:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1717 00010000:00010000:0.0:1790771166.701826:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0df08 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f28 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.701835:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:2397:x1877759533954688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.701836:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701850:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0d775 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000020 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701853:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.701863:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 95 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701869:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701870:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701877:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 95 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701891:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701892:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701904:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0d6e9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b8c expref: 95 pid: 13770 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.701915:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701916:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701929:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:3.0:1790771166.701936:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.701939:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701941:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.701957:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.701960:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.701966:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.701979:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.701982:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc29009b00) 00010000:00010000:3.0:1790771166.701986:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.701989:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.701996:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.701996:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0da4d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702009:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+94:2397:x1877759533954688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 182us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.702017:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1717 00000100:00100000:2.0:1790771166.702035:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955200 00000100:00100000:0.0:1790771166.702039:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.702042:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955200 00000100:00100000:3.0:1790771166.702057:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14358:x1877759533917952:12345-192.168.204.50@tcp:36:ln.0 Request processed in 213903us (214009us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771166.702064:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702074:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.702076:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6088 00000100:00100000:3.0:1790771166.702105:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533944192 00000100:00100000:3.0:1790771166.702109:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533944192 00000100:00100000:1.0:1790771166.702115:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1718 00000100:00100000:1.0:1790771166.702127:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2399:x1877759533955200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.702136:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955328 00010000:00010000:1.0:1790771166.702137:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.702141:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955328 00000100:00100000:2.0:1790771166.702142:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955584 00010000:00010000:1.0:1790771166.702145:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702149:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955584 00000100:00100000:0.0:1790771166.702159:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.702170:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 126 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.702178:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6207 00010000:00010000:1.0:1790771166.702185:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.702191:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702196:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.702197:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6208 00010000:00010000:1.0:1790771166.702206:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702211:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702217:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:14545:x1877759533955584:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771166.702219:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.702227:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.702232:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+95:13884:x1877759533955328:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.702242:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2399:x1877759533955200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 118us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.702242:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.702249:0:13773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.702250:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1718 00010000:00010000:3.0:1790771166.702255:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0df16 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f36 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702258:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.702271:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956480 00010000:00010000:2.0:1790771166.702271:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0d94a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c2d expref: 96 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702276:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956480 00000100:00100000:0.0:1790771166.702285:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.702292:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771166.702294:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 115 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.702300:0:13773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.702304:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702312:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.702317:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956096 00010000:00010000:3.0:1790771166.702321:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702322:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956096 00010000:00010000:2.0:1790771166.702324:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.702335:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.702341:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702342:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.702347:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 116 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.702361:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.702368:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.702368:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.702369:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:3.0:1790771166.702383:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702390:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956736 00000100:00100000:1.0:1790771166.702394:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956736 00010000:00010000:3.0:1790771166.702401:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0df16 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f36 expref: 96 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702410:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 126 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702421:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.702424:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f36 expref: 95 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.702431:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.702435:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.702436:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1719 00010000:00010000:3.0:1790771166.702439:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cae600, rc 0) 00000100:00100000:1.0:1790771166.702448:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2396:x1877759533956480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.702455:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.702456:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533936000 00010000:00010000:1.0:1790771166.702461:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.702462:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533936000 00010000:00010000:1.0:1790771166.702469:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 116 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702473:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533937280 00000100:00100000:0.0:1790771166.702479:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533937280 00010000:00010000:1.0:1790771166.702509:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 116 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702523:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0daa8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d0d expref: 116 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.702524:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533945600 00000100:00100000:0.0:1790771166.702530:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533945728 00000100:00100000:3.0:1790771166.702531:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533945600 00000100:00100000:0.0:1790771166.702537:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533945728 00010000:00010000:1.0:1790771166.702537:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.702543:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702549:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702554:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702560:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.702561:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533946240 00000100:00100000:3.0:1790771166.702567:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533946240 00000100:00100000:0.0:1790771166.702570:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6209 00010000:00010000:1.0:1790771166.702570:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702582:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14414:x1877759533936000:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.702591:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.702593:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.702598:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6210 00010000:00010000:0.0:1790771166.702601:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0df2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35dca expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.702610:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14432:x1877759533937280:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:1.0:1790771166.702617:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2396:x1877759533956480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 171us (427us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.702619:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.702622:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0df2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dca expref: 133 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702629:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1719 00010000:00010000:3.0:1790771166.702633:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0df32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ded expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702642:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0df2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dca expref: 133 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702651:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:1.0:1790771166.702652:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1720 00010000:00010000:0.0:1790771166.702670:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.702674:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ee00, rc 0) 00000100:00100000:1.0:1790771166.702679:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759533956096:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.702688:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.702692:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702696:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14414:x1877759533936000:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 113us (440us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.702696:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 117 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790771166.702712:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 88 off10024 00010000:00010000:3.0:1790771166.702714:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6209 00010000:00010000:1.0:1790771166.702729:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 117 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.702739:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702746:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0dd1e lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d22 expref: 117 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702751:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6211 00000004:00010000:2.0:1790771166.702763:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c887571 reply state 00000000468f0fbf transno 4294968772 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.702765:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.702766:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14512:x1877759533945600:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771166.702766:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:1.0:1790771166.702775:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702781:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.702792:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702793:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0df47 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e6b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702795:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.702797:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702820:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.702821:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.702823:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:2.0:1790771166.702832:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.702842:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.702849:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702852:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.702860:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702867:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702873:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759533956096:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 196us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.702879:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1720 00000004:00200000:0.0:1790771166.702882:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.702886:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.702897:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702898:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14545:x1877759533955584:12345-192.168.204.50@tcp:36:chown.0 Request processed in 683us (825us total) trans 4294968772 rc 0/0 00000100:00100000:1.0:1790771166.702911:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1721 00000100:00100000:2.0:1790771166.702918:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6208 00010000:00010000:0.0:1790771166.702922:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0df47 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e6b expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.702924:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2399:x1877759533956736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.702938:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.702942:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.702945:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 126 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702947:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e6b expref: 116 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702951:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6212 00010000:00010000:3.0:1790771166.702968:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.702971:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14830:x1877759533945728:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771166.702975:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.702975:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 126 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.702983:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.702987:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f400, rc 0) 00010000:00010000:3.0:1790771166.702990:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.702991:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.702996:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.703001:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703005:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0df5c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e72 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703009:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14512:x1877759533945600:12345-192.168.204.50@tcp:101:rm.0 Request processed in 246us (699us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.703009:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703026:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6211 00010000:00010000:1.0:1790771166.703032:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703038:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.703046:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6213 00000100:00100000:0.0:1790771166.703061:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14731:x1877759533946240:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:1.0:1790771166.703061:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2399:x1877759533956736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 137us (717us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.703064:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703073:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1790771166.703073:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.703079:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1721 00000004:00200000:3.0:1790771166.703082:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.703083:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0df6a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e79 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703091:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.703099:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703102:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703103:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955840 00010000:00010000:2.0:1790771166.703103:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703109:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955840 00010000:00010000:3.0:1790771166.703119:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703124:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703135:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1618 00010000:00010000:3.0:1790771166.703139:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703141:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703145:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703150:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:14071:x1877759533955840:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.703158:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703174:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703174:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703197:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.703200:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703200:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703215:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703225:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:3.0:1790771166.703227:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.703230:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703236:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0df6a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 118 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703237:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14071:x1877759533955840:12345-192.168.204.50@tcp:35:ls.0 Request processed in 88us (1080us total) trans 4294968773 rc 0/0 00010000:00010000:3.0:1790771166.703241:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0df39 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703255:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703257:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1618 00010000:00010000:3.0:1790771166.703267:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703273:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703281:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957632 00010000:00010000:2.0:1790771166.703282:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703286:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703287:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957632 00010000:00010000:0.0:1790771166.703297:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771166.703304:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.703309:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00010000:00010000:3.0:1790771166.703310:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703312:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703318:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 426 00010000:00010000:3.0:1790771166.703326:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fc00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.703330:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14731:x1877759533946240:12345-192.168.204.50@tcp:101:chown.0 Request processed in 275us (876us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.703333:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703338:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533957632:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:0.0:1790771166.703347:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6213 00000004:00200000:2.0:1790771166.703348:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.703350:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.703356:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.703369:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfc1040fd00) 00010000:00010000:3.0:1790771166.703372:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.703376:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.703377:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703389:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0df40 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703394:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.703402:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703411:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703414:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533946880 00000100:00100000:0.0:1790771166.703420:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533946880 00010000:00010000:2.0:1790771166.703422:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703424:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0df32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ded expref: 134 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703442:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6214 00010000:00010000:2.0:1790771166.703446:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703451:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ded expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.703454:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14924:x1877759533946880:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.703467:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.703468:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.703469:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:3.0:1790771166.703474:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.703476:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703477:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c72800, rc 0) 00010000:00010000:0.0:1790771166.703479:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0df86 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e87 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703517:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703525:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 3/1,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.703525:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14432:x1877759533937280:12345-192.168.204.50@tcp:101:rm.0 Request processed in 916us (1237us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.703531:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.703542:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.703542:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6210 00002000:00010000:1.0:1790771166.703545:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size from disk: 38336 -> 38336 00010000:00010000:0.0:1790771166.703546:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.703550:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb mtime from disk: 1674053537 -> 1790771165 00010000:00010000:2.0:1790771166.703551:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.703557:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:0.0:1790771166.703559:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.703564:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00010000:00010000:2.0:1790771166.703572:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104200/0xfa0c505d97f0df63 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.703573:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1790771166.703576:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+97:13884:x1877759533955328:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1389us (1538us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.703584:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.703593:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6207 00000100:00100000:1.0:1790771166.703599:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533957632:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 266us (1177us total) trans 4294967623 rc 0/0 00010000:00010000:0.0:1790771166.703605:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703605:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703611:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 426 00010000:00010000:0.0:1790771166.703624:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703626:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.703638:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6215 00010000:00010000:2.0:1790771166.703651:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.703669:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:13978:x1877759533944192:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1790771166.703675:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703683:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.703685:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703687:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.703691:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703696:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703697:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.703701:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0df9b lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e56 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703710:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703721:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703722:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703740:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.703740:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc0786e700) 00010000:00010000:3.0:1790771166.703741:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703747:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703748:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.703755:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703767:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703771:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104000/0xfa0c505d97f0df78 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703776:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3607a100) 00010000:00010000:0.0:1790771166.703781:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.703783:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 3/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703789:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0df8d lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703798:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.703801:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000036b87efe reply state 0000000023f7072f transno 4294968774 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703805:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703807:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0df5c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e72 expref: 120 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703824:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703827:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703844:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.703845:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:2.0:1790771166.703846:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e72 expref: 119 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703848:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703851:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1790771166.703852:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.703855:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.703871:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.703879:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00000100:00100000:1.0:1790771166.703882:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+98:14871:x1877759533944064:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 82297us (82490us total) trans 4294968774 rc 0/0 00010000:00010000:3.0:1790771166.703882:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703885:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0xd870248a (ffff8bfc3607af00) 00010000:00010000:2.0:1790771166.703886:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.703893:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105200, rc 0) 00010000:00010000:0.0:1790771166.703894:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.703898:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6177 00010000:00010000:0.0:1790771166.703899:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 2/0,0 mode: --/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703906:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0df94 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.703925:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14830:x1877759533945728:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 957us (1559us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.703927:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703930:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0df86 lrc: 1/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e87 expref: 119 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.703949:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.703950:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6212 00010000:00010000:0.0:1790771166.703955:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3607a100) 00010000:00010000:0.0:1790771166.703962:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.703967:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0df86 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e87 expref: 118 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.703975:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656e000, rc 0) 00000001:00080000:1.0:1790771166.703994:0:7771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968762 00000100:00100000:0.0:1790771166.703998:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14924:x1877759533946880:12345-192.168.204.50@tcp:101:cp.0 Request processed in 548us (607us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.704000:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6479:1877759539760640:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.704015:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0df9b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.704018:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003ae079ad reply state 000000006d4662e3 transno 4294968775 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704019:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6214 00010000:00010000:2.0:1790771166.704024:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.704040:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704047:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771166.704049:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 116 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704052:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.704054:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533947520:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 64280us (64485us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.704056:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704067:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.704078:0:7771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704079:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00000100:00100000:2.0:1790771166.704081:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1705 00010000:00010000:3.0:1790771166.704086:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771166.704092:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73000, rc 0) 00000100:00100000:0.0:1790771166.704094:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.704097:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704104:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.704118:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13978:x1877759533944192:12345-192.168.204.50@tcp:101:dd.0 Request processed in 467us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.704122:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.704128:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6215 00000100:00100000:0.0:1790771166.704130:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.704140:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704147:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.704150:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947392 00000100:00100000:3.0:1790771166.704154:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947392 00000100:00100000:2.0:1790771166.704155:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533949952 00000100:00100000:0.0:1790771166.704161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.704163:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533949952 00000001:00080000:1.0:1790771166.704175:0:12030:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968765 00000100:00100000:3.0:1790771166.704180:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6216 00000100:00100000:0.0:1790771166.704196:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.704196:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:11438:x1877759533947392:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000004:00010000:1.0:1790771166.704197:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037156d9e reply state 00000000fad34234 transno 4294968776 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.704206:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957760 00010000:00010000:1.0:1790771166.704210:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.704212:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957760 00010000:00010000:3.0:1790771166.704212:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.704214:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957888 00000100:00100000:0.0:1790771166.704220:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957888 00010000:00010000:1.0:1790771166.704222:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771166.704223:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dfa9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e95 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704227:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.704232:0:12030:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704238:0:12030:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704243:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.704254:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533958144 00010000:00010000:3.0:1790771166.704258:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704260:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.704261:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533958144 00000100:00100000:0.0:1790771166.704265:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6217 00010000:00010000:3.0:1790771166.704275:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704280:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14478:x1877759533949952:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1790771166.704286:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704290:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.704298:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6218 00010000:00010000:3.0:1790771166.704300:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704303:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0dfbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ecd expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704305:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:14822:x1877759533946112:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 80952us (81334us total) trans 4294968776 rc 0/0 00000100:00100000:2.0:1790771166.704316:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14890:x1877759533957760:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.704323:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704330:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6182 00010000:00010000:3.0:1790771166.704336:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.704338:0:12030:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771166.704346:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xa1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ecd expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704356:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f200/0xfa0c505d97f0dfbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xa1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ecd expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704368:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff8bfc310f1d00) 00010000:00010000:2.0:1790771166.704369:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704372:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6219 00010000:00010000:3.0:1790771166.704373:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dfcc lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704374:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771166.704380:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f200, rc 0) 00000100:00100000:1.0:1790771166.704391:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14765:x1877759533957888:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1790771166.704394:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dfcc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704402:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14478:x1877759533949952:12345-192.168.204.50@tcp:101:dd.0 Request processed in 124us (310us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.704402:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 133 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704410:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dfcc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704419:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6217 00010000:00010000:1.0:1790771166.704424:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.704434:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704440:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6220 00000004:00200000:3.0:1790771166.704444:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa8:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.704447:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0d3a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358e5 expref: 128 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.704449:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.704454:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14942:x1877759533958144:12345-192.168.204.50@tcp:44:fallocate.0 00000004:00010000:3.0:1790771166.704462:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dfcc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.704470:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 133 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704474:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.704474:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704518:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14942:x1877759533958144:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 66us (326us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.704518:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.704521:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.704528:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704534:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.704536:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6220 00010000:00010000:3.0:1790771166.704541:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704557:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704564:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704564:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.704566:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.704567:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539762048:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.704587:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.704591:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704592:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704609:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704617:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3607a100) 00000100:00100000:2.0:1790771166.704619:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113416c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.704621:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704622:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.704629:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 3/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.704633:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 126 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704645:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372800/0xfa0c505d97f0dfb0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704650:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539762176:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.704680:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704690:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.704695:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060803c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.704696:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704703:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.704706:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704712:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704721:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x510a92c1 (ffff8bfc3600d400) 00010000:00010000:3.0:1790771166.704724:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.704727:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 2/0,0 mode: --/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704734:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0dfb7 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704765:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0dfa9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e95 expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790771166.704770:0:13767:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 88 off9736 00000100:00100000:2.0:1790771166.704780:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:0.0:1790771166.704786:0:13767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 166910298926ns, next at 167910295878ns, rc = 0 00010000:00010000:3.0:1790771166.704791:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372a00/0xfa0c505d97f0dfcc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa8:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e95 expref: 117 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.704799:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x0 (ffff8bfc3600d300) 00010000:00010000:3.0:1790771166.704802:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790771166.704804:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372a00, rc 0) 00000100:00100000:2.0:1790771166.704827:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:0.0:1790771166.704833:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000737aaadd reply state 000000001ecff643 transno 4294968777 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.704835:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:11438:x1877759533947392:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 644us (771us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.704854:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.704856:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533958528 00000100:00100000:3.0:1790771166.704860:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6216 00000100:00100000:2.0:1790771166.704864:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533958528 00010000:00010000:0.0:1790771166.704869:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771166.704872:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.704874:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.704889:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533958400 00000100:00100000:3.0:1790771166.704896:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533958400 00002000:00100000:2.0:1790771166.704898:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x14:0x0] (8388608->12582911) req@ffff8bfc3fa94a80 x1877759533958528/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771166.704899:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.704912:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14452:x1877759533947776:12345-192.168.204.50@tcp:36:chown.0 Request processed in 65612us (65700us total) trans 4294968777 rc 0/0 00002000:00100000:2.0:1790771166.704914:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa94a80 with x1877759533958528 ext(8388608->12582911) 00002000:00010000:2.0:1790771166.704923:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa94a80 00000100:00100000:1.0:1790771166.704928:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.704944:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.704946:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533958784 00000100:00100000:2.0:1790771166.704952:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533958784 00000100:00100000:0.0:1790771166.704957:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6186 00000100:00100000:3.0:1790771166.704970:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959040 00002000:00100000:2.0:1790771166.704975:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x14:0x0] (12582912->14614527) req@ffff8bfb064bd500 x1877759533958784/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.704977:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959040 00000100:00100000:1.0:1790771166.704979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.704984:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6221 00002000:00100000:2.0:1790771166.704994:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064bd500 with x1877759533958784 ext(12582912->14614527) 00000100:00100000:0.0:1790771166.704999:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:14945:x1877759533958400:12345-192.168.204.50@tcp:36:ln.0 00002000:00010000:2.0:1790771166.705002:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb064bd500 00000100:00100000:3.0:1790771166.705009:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533944960 00000100:00100000:1.0:1790771166.705010:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.705014:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533944960 00010000:00010000:0.0:1790771166.705019:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.705033:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 427 00010000:00010000:0.0:1790771166.705035:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0d506 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x12:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b4d expref: 100 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.705045:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.705047:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959296 00000100:00100000:2.0:1790771166.705052:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533958528:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771166.705053:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0x0 (ffff8bfc0786ef00) 00000100:00100000:3.0:1790771166.705054:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959296 00010000:00010000:0.0:1790771166.705061:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.705081:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.705095:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959424 00000100:00100000:3.0:1790771166.705099:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959424 00000100:00100000:1.0:1790771166.705103:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959552 00000100:00100000:1.0:1790771166.705108:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959552 00000100:00100000:0.0:1790771166.705124:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14945:x1877759533958400:12345-192.168.204.50@tcp:36:ln.0 Request processed in 128us (349us total) trans 0 rc -17/-17 00000100:00100000:3.0:1790771166.705131:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6222 00000100:00100000:0.0:1790771166.705142:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6221 00000100:00100000:3.0:1790771166.705147:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14985:x1877759533959040:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.705153:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6223 00000100:00100000:1.0:1790771166.705163:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14618:x1877759533944960:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:0.0:1790771166.705169:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6224 00010000:00010000:3.0:1790771166.705169:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.705171:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.705184:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0dfda lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e5d expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.705185:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0b299 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34ec7 expref: 119 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705187:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14806:x1877759533959296:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:3.0:1790771166.705213:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771166.705216:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.705225:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.705233:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 98 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705237:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705243:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.705243:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705249:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705271:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.705274:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 98 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.705290:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 98 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705291:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.705310:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539762304:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.705313:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.705334:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113e06c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.705338:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705348:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.705349:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959168 00000100:00100000:3.0:1790771166.705354:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959168 00010000:00010000:0.0:1790771166.705361:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705367:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.705371:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.705377:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1619 00010000:00010000:0.0:1790771166.705378:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.705386:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:12241:x1877759533959168:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.705390:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:0.0:1790771166.705394:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.705397:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 2/0,0 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705401:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0dfe8 lrc: 0/0,0 mode: --/EX res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705411:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705420:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705427:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705431:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14806:x1877759533959296:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 249us (420us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771166.705440:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6224 00010000:00010000:1.0:1790771166.705449:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705456:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6225 00010000:00010000:1.0:1790771166.705465:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705466:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14763:x1877759533959424:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:1.0:1790771166.705478:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705529:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705534:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.705536:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705541:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705547:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705548:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.705554:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.705558:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705562:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705565:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0dfef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705573:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705577:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705584:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705589:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705593:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.705595:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705599:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705604:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfb03218f00) 00010000:00010000:1.0:1790771166.705606:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.705608:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705612:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0dff6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705631:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0dfda lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e5d expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.705637:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a8be5161 reply state 000000006c0d1e4a transno 4294969384 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705638:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.705645:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.705651:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0dfda lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e5d expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705653:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705679:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3600, rc 0) 00010000:00010000:0.0:1790771166.705680:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771166.705685:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.705687:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.705700:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14618:x1877759533944960:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 540us (725us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771166.705706:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6223 00000100:00100000:0.0:1790771166.705712:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14763:x1877759533959424:12345-192.168.204.50@tcp:36:cp.0 Request processed in 246us (672us total) trans 4294969384 rc 0/0 00000100:00100000:0.0:1790771166.705719:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6225 00000100:00100000:1.0:1790771166.705726:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6226 00000100:00100000:1.0:1790771166.705735:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14944:x1877759533959552:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771166.705741:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.705749:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0e004 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f75 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705771:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:14768:x1877759533943424:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 84547us (84658us total) trans 4294968775 rc 0/0 00000100:00100000:0.0:1790771166.705777:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6175 00010000:00010000:1.0:1790771166.705778:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771166.705780:0:7771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.705790:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.705796:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.705813:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.705815:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771166.705817:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.705828:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705830:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533945088 00000100:00100000:0.0:1790771166.705835:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533945088 00010000:00010000:1.0:1790771166.705844:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0e004 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705857:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6227 00010000:00010000:1.0:1790771166.705859:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 128 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.705867:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14382:x1877759533945088:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.705869:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771166.705875:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.705877:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0c00, rc 0) 00010000:00010000:0.0:1790771166.705879:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.705890:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e64 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.705897:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14944:x1877759533959552:12345-192.168.204.50@tcp:101:ln.0 Request processed in 161us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.705907:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6226 00010000:00010000:0.0:1790771166.705910:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705918:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705923:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705935:0:13767:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.705944:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.705950:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.705963:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 428 00000100:00100000:0.0:1790771166.705972:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947136 00000100:00100000:3.0:1790771166.705973:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759533958784:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771166.705977:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947136 00000100:00100000:1.0:1790771166.705982:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.706002:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533960192 00000100:00100000:1.0:1790771166.706005:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533960192 00000100:00100000:0.0:1790771166.706009:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6228 00000100:00100000:0.0:1790771166.706018:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14053:x1877759533947136:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771166.706025:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.706032:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6229 00010000:00010000:0.0:1790771166.706033:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e020 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e8e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.706042:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14306:x1877759533960192:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:0.0:1790771166.706048:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0e027 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706056:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0e027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706062:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0e027 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706062:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.706077:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0db49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d61 expref: 142 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706086:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb03218000) 00010000:00010000:1.0:1790771166.706091:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.706103:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706109:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706116:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706122:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e020 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e8e expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706134:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706135:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80600/0xfa0c505d97f0e027 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e8e expref: 141 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706150:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706165:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.706167:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706168:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.706172:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80600, rc 0) 00000100:00100000:0.0:1790771166.706190:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03020a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14053:x1877759533947136:12345-192.168.204.50@tcp:101:chown.0 Request processed in 174us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.706195:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6228 00010000:00010000:1.0:1790771166.706196:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706203:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706211:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.706225:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05795500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1877759539762432:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1790771166.706232:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.706260:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.706267:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.706270:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948288 00000100:00100000:0.0:1790771166.706274:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948288 00000100:00100000:0.0:1790771166.706297:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6230 00000100:00100000:1.0:1790771166.706298:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539762432 00000100:00100000:1.0:1790771166.706303:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539762432 00000100:00100000:0.0:1790771166.706304:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14813:x1877759533948288:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:0.0:1790771166.706317:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.706324:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e043 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35eaa expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.706335:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1790771166.706343:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:6495:x1877759539762432:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1790771166.706350:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706353:0:13776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.706359:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706365:0:13776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e051 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0e03c expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706367:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706395:0:13776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e051 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0e03c expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.706399:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 3407872 00000004:00200000:0.0:1790771166.706403:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.706405:0:13776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e051 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0e03c expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.706413:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706413:0:13776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfb03218d00) 00010000:00010000:1.0:1790771166.706418:0:13776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.706421:0:13776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00010000:00010000:0.0:1790771166.706426:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706440:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e043 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 121 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.706446:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6495:x1877759539762432:12345-0@lo:101:mdt00_002.0 Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.706456:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:0.0:1790771166.706457:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 120 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706463:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.706465:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.706467:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687c00, rc 0) 00000100:00100000:1.0:1790771166.706474:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06080840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.706507:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05795500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6495:1877759539762432:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1790771166.706513:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14813:x1877759533948288:12345-192.168.204.50@tcp:101:chown.0 Request processed in 182us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.706520:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6230 00010000:00010000:1.0:1790771166.706521:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706530:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.706568:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.706577:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962368 00000100:00100000:0.0:1790771166.706579:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962368 00000100:00100000:0.0:1790771166.706595:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6231 00000100:00100000:0.0:1790771166.706601:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14717:x1877759533962368:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:0.0:1790771166.706624:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706631:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706638:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771166.706647:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].40, 344 off56224 00000004:00010000:0.0:1790771166.706715:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000022a773a7 reply state 00000000074fc292 transno 4294969386 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706724:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706729:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.706730:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1790771166.706732:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790771166.706735:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.706760:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14717:x1877759533962368:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 159us (192us total) trans 4294969386 rc 0/0 00000100:00100000:0.0:1790771166.706765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6231 00000100:00100000:0.0:1790771166.706796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.706819:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.706834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.706843:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533965312 00000100:00100000:0.0:1790771166.706846:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533965312 00000100:00100000:1.0:1790771166.706852:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533965056 00000100:00100000:1.0:1790771166.706857:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533965056 00000100:00100000:0.0:1790771166.706865:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6232 00010000:00010000:1.0:1790771166.706875:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.706876:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+99:15001:x1877759533965312:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771166.706888:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.706898:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e05f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36078 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.706905:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1722 00000100:00100000:1.0:1790771166.706914:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2397:x1877759533965056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.706922:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.706927:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706928:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706952:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706952:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.706973:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.706978:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.706983:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.706991:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.706991:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.706996:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.707003:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.707008:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.707009:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707030:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e05f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 101 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707049:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 100 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707055:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.707057:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.707060:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00010000:00010000:1.0:1790771166.707064:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.707070:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.707080:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:15001:x1877759533965312:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 208us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.707086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6232 00010000:00010000:1.0:1790771166.707087:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.707111:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.707114:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2397:x1877759533965056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 198us (289us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.707123:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.707127:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1722 00000004:00200000:0.0:1790771166.707147:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790771166.707149:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.707157:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707172:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0df08 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f28 expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707177:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ce14 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35795 expref: 130 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707182:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f28 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707194:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771166.707196:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.707199:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd800, rc 0) 00000100:00100000:3.0:1790771166.707202:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539760768:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.707217:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14616:x1877759533954944:12345-192.168.204.50@tcp:101:cp.0 Request processed in 5414us (5474us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.707221:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.707225:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6206 00000100:00100000:0.0:1790771166.707271:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.707316:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533960576 00000100:00100000:0.0:1790771166.707319:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533960576 00000100:00100000:0.0:1790771166.707354:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1620 00000100:00100000:0.0:1790771166.707364:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13260:x1877759533960576:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.707369:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.707373:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962496 00000100:00100000:2.0:1790771166.707380:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962496 00010000:00010000:3.0:1790771166.707419:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707426:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.707427:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1014 00000100:00100000:2.0:1790771166.707444:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:15035:x1877759533962496:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:0.0:1790771166.707452:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13260:x1877759533960576:12345-192.168.204.50@tcp:35:ls.0 Request processed in 90us (1222us total) trans 4294969387 rc 0/0 00010000:00010000:2.0:1790771166.707455:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.707461:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1620 00010000:00010000:2.0:1790771166.707469:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fe5 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.707508:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966976 00000100:00100000:0.0:1790771166.707512:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966976 00010000:00010000:2.0:1790771166.707518:0:13787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 29 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707529:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1f:0x0].0x0 since=2s v=(1 0) 00000100:00100000:0.0:1790771166.707534:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948416 00010000:00010000:2.0:1790771166.707534:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(2 0) 00000100:00100000:0.0:1790771166.707537:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948416 00010000:00010000:2.0:1790771166.707544:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [8192->24575] (req 8192->24575) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fe5 expref: 24 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.707545:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790771166.707552:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.707558:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6233 00000004:00010000:3.0:1790771166.707566:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.707570:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+100:14067:x1877759533966976:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.707583:0:13787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 29 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707583:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707587:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.707599:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e074 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e80 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707602:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707617:0:13787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 29 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707623:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707642:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707645:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.707648:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539762560:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.707672:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.707682:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707683:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707700:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707702:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707722:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.707723:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707728:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.707733:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.707737:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707738:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707756:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707758:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0de0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707774:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000021bcdbc4 x1877759539760896) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707777:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.707796:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.707807:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707811:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0dd64 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e33 expref: 128 pid: 13764 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707821:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707829:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707833:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.707836:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539760896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.707840:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707842:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707857:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707862:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000fc6056db x1877759539761024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 127 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707863:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707871:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.707876:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707889:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc1040fa00) 00010000:00010000:0.0:1790771166.707897:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707897:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.707903:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0dd10 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e2c expref: 127 pid: 13766 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707905:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707909:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.707917:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.707922:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707925:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0de13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.707939:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa96680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.707941:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e07b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707959:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707970:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.707970:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000a984032e x1877759539761152) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.707971:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0de05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.707988:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708004:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.708005:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 140 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708008:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708011:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0dc14 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e25 expref: 126 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708025:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708031:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771166.708040:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:2.0:1790771166.708047:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761152:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.708048:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00010000:00010000:0.0:1790771166.708050:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.708056:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.708058:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.708063:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11375050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:12252:x1877759533954304:12345-192.168.204.50@tcp:37:ls.0 Request processed in 6506us (6599us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.708067:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e082 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.708079:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14573:x1877759533931136:12345-192.168.204.50@tcp:101:ln.0 Request processed in 65326us (65456us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.708086:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6194 00010000:00010000:0.0:1790771166.708099:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e074 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e80 expref: 102 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.708099:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1617 00000100:00100000:2.0:1790771166.708100:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6234 00010000:00010000:0.0:1790771166.708114:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.708117:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1790771166.708121:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14362:x1877759533948416:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.708123:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e074 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e80 expref: 102 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708138:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592400, rc 0) 00010000:00010000:2.0:1790771166.708138:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.708154:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e090 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35eb1 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708164:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14067:x1877759533966976:12345-192.168.204.50@tcp:101:ls.0 Request processed in 595us (892us total) trans 4294968778 rc 301/301 00000100:00100000:0.0:1790771166.708170:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6233 00000001:00080000:1.0:1790771166.708174:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969386 is committed 00000001:00080000:1.0:1790771166.708194:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969385 is committed 00010000:00010000:2.0:1790771166.708197:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708199:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708205:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708220:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708222:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708224:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708239:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708244:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771166.708246:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].40, 552 off63208 00010000:00010000:2.0:1790771166.708251:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.708258:0:6495:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb06080840 with version 82 00010000:00010000:3.0:1790771166.708267:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.708274:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708276:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.708282:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708284:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708295:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.708297:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 3407872 00010000:00010000:3.0:1790771166.708301:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000004:00200000:2.0:1790771166.708306:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.708307:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.708310:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa1:0x0].0x0 (ffff8bfc310f1d00) 00010000:00010000:3.0:1790771166.708312:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708314:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.708319:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708321:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0dcd8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.708325:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708332:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0dc61 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708348:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708354:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708355:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708360:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708377:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708379:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708395:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.708397:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708397:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e090 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708400:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.708409:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.708421:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.708423:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708426:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708435:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708436:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.708437:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708443:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771166.708447:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708469:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ddc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708470:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.708471:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.708479:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.708502:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708508:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0dd2c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.708517:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.708519:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.708524:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00010000:00010000:0.0:1790771166.708525:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708534:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708539:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708544:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.708547:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708552:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708557:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708560:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:1.0:1790771166.708562:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:2.0:1790771166.708565:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 82 rpc_version 82 00010000:00010000:0.0:1790771166.708568:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.708574:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708576:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708583:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e058 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708586:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1790771166.708592:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790771166.708603:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.708607:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb0552f480 x1877759539762816/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1528/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1790771166.708609:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfce00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.708616:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708625:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966592 00000100:00100000:0.0:1790771166.708630:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966592 00000100:00100000:2.0:1790771166.708639:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0552f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539762816:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771166.708642:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.708644:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708670:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966848 00000100:00100000:0.0:1790771166.708673:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966848 00010000:00010000:3.0:1790771166.708673:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771166.708680:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.708685:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.708693:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0dffd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708700:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1621 00000100:00100000:2.0:1790771166.708709:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.708714:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14824:x1877759533966592:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:1.0:1790771166.708718:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.708723:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1622 00000100:00100000:3.0:1790771166.708738:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:12121:x1877759533966848:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.708743:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.708746:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966336 00000100:00100000:1.0:1790771166.708751:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966336 00010000:00010000:1.0:1790771166.708768:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 131 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.708776:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6480:1877759539761920:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771166.708791:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966720 00000100:00100000:1.0:1790771166.708794:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966720 00010000:00010000:2.0:1790771166.708799:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.708807:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 115 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.708823:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2399:x1877759533950592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 8460us (8600us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.708829:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1723 00000100:00100000:0.0:1790771166.708836:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14824:x1877759533966592:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 128us (278us total) trans 4294969388 rc 0/0 00000100:00100000:2.0:1790771166.708842:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1713 00000100:00100000:1.0:1790771166.708844:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2397:x1877759533966336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.708853:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1621 00010000:00010000:1.0:1790771166.708856:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.708862:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:12121:x1877759533966848:12345-192.168.204.50@tcp:35:ls.0 Request processed in 125us (260us total) trans 4294969389 rc 0/0 00010000:00010000:1.0:1790771166.708864:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 131 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708883:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533947648 00000100:00100000:3.0:1790771166.708883:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1622 00010000:00010000:1.0:1790771166.708886:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 131 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708889:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533947648 00000100:00100000:2.0:1790771166.708902:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1724 00010000:00010000:1.0:1790771166.708903:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.708910:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.708916:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.708918:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966080 00000100:00100000:0.0:1790771166.708924:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966080 00000100:00100000:2.0:1790771166.708925:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:2397:x1877759533966720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.708927:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.708934:0:13796:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size: 0 -> 2097152 00010000:00010000:1.0:1790771166.708940:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1790771166.708940:0:13796:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb atime: 0 -> 1790771158 00010000:00010000:2.0:1790771166.708942:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790771166.708945:0:13796:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb blocks: 0 -> 1 00000100:00100000:0.0:1790771166.708947:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6235 00010000:00010000:2.0:1790771166.708955:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 115 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.708961:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539761792:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771166.708965:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14692:x1877759533947648:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:1.0:1790771166.708965:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2397:x1877759533966336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (319us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.708981:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.708985:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1723 00010000:00010000:3.0:1790771166.708986:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003777eef6/0xfa0c505d97f0ded7 lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ef0 expref: 24 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.708990:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 115 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.708991:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e09e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35e9c expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709017:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003777eef6/0xfa0c505d97f0ded7 lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ef0 expref: 24 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.709026:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771166.709034:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.709036:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709041:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.709045:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02600, rc 0) 00010000:00010000:0.0:1790771166.709056:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709058:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533967232 00010000:00010000:2.0:1790771166.709060:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709064:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533967232 00010000:00010000:0.0:1790771166.709072:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709077:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759533952128:12345-192.168.204.50@tcp:101:ln.0 Request processed in 8788us (8905us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771166.709088:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1623 00010000:00010000:2.0:1790771166.709098:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709100:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1012 00000100:00100000:1.0:1790771166.709103:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11377450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14506:x1877759533967232:12345-192.168.204.50@tcp:49:ln.0 00010000:00010000:0.0:1790771166.709109:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.709124:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709125:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709133:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6236 00010000:00010000:0.0:1790771166.709145:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.709147:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709148:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14629:x1877759533966080:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.709153:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11377450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14506:x1877759533967232:12345-192.168.204.50@tcp:49:ln.0 Request processed in 51us (113us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.709172:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1623 00010000:00010000:2.0:1790771166.709181:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.709189:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709197:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709200:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 133 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709209:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709213:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:2397:x1877759533966720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 294us (498us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.709216:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709227:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709227:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.709240:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1724 00010000:00010000:3.0:1790771166.709252:0:13770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 133 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.709255:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 5 00000004:00200000:0.0:1790771166.709261:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.709267:0:13770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 133 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.709272:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709273:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539762816 00000100:00100000:1.0:1790771166.709276:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.709282:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539762816 00010000:00010000:0.0:1790771166.709292:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709294:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb058b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539762944:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.709296:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966464 00000100:00100000:1.0:1790771166.709303:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966464 00010000:00010000:0.0:1790771166.709307:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709313:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.709321:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/16 (0->18446744073709551615) 00010000:00010000:0.0:1790771166.709322:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709328:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00002000:00100000:1.0:1790771166.709331:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562d880 with x1877759533966464 ext(0->18446744073709551615) 00000100:00100000:3.0:1790771166.709332:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f51180 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.709338:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709344:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593200 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:1.0:1790771166.709345:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0562d880. 00000100:00100000:2.0:1790771166.709346:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7768:x1877759539762816:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:0.0:1790771166.709347:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709360:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709368:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:0.0:1790771166.709370:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.709372:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533967360 00010000:00010000:0.0:1790771166.709373:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709379:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533967360 00010000:00010000:0.0:1790771166.709380:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709393:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709402:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709403:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:1.0:1790771166.709405:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (552960->557055) req@ffff8bfb0562c000 x1877759533967360/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.709419:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709424:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948544 00000100:00100000:3.0:1790771166.709432:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948544 00010000:00010000:0.0:1790771166.709437:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.709442:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.709442:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562c000 with x1877759533967360 ext(552960->557055) 00002000:00010000:1.0:1790771166.709451:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0562c000 00010000:00010000:0.0:1790771166.709453:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.709461:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6237 00010000:00010000:0.0:1790771166.709462:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0xb62e0cbf (ffff8bfc3607a800) 00010000:00010000:0.0:1790771166.709466:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.709469:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709477:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e0ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709478:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 429 00000100:00100000:3.0:1790771166.709478:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14940:x1877759533948544:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771166.709534:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533966464:12345-192.168.204.50@tcp:10:dir_create.sh.0 00010000:00010000:0.0:1790771166.709536:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e09e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 134 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709552:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 133 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.709560:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:3.0:1790771166.709561:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.709562:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.709566:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592600, rc 0) 00010000:00010000:3.0:1790771166.709573:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e0c1 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35eb8 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709585:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7768:x1877759539762816:12345-0@lo:1000:osp_up1-0.0 Request processed in 243us (878us total) trans 4294968779 rc 0/0 00000100:00100000:0.0:1790771166.709589:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14692:x1877759533947648:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 632us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.709603:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6235 00010000:00010000:3.0:1790771166.709605:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709610:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:3.0:1790771166.709617:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.709618:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x10:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790771166.709625:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x10:0x0] updating lvb mtime from disk: 1790771161 -> 1790771166 00002000:00010000:1.0:1790771166.709631:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x10:0x0] updating lvb atime from disk: 1790771161 -> 0 00002000:00010000:1.0:1790771166.709635:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x10:0x0] updating lvb ctime from disk: 1790771161 -> 1790771166 00002000:00010000:1.0:1790771166.709637:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x10:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1790771166.709637:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.709652:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 430 00000100:00100000:1.0:1790771166.709677:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533966464:12345-192.168.204.50@tcp:10:dir_create.sh.0 Request processed in 147us (454us total) trans 4294967624 rc 0/0 00000004:00200000:3.0:1790771166.709678:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 3407872 00000100:00100000:2.0:1790771166.709684:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533967360:12345-192.168.204.50@tcp:3:cat.0 00000004:00200000:3.0:1790771166.709686:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.709693:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 429 00002000:00010000:1.0:1790771166.709698:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/16 (0->18446744073709551615) 00002000:00100000:1.0:1790771166.709701:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562d880 with x1877759533966464 ext(0->18446744073709551615) 00002000:00010000:1.0:1790771166.709705:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0562d880. 00000004:00010000:3.0:1790771166.709705:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709717:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709737:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e0c1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 124 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709756:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.709765:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771166.709770:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.709774:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1a00, rc 0) 00000100:00100000:1.0:1790771166.709778:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552f480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539762816:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1790771166.709789:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759533967360:12345-192.168.204.50@tcp:3:cat.0 Request processed in 108us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.709802:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14940:x1877759533948544:12345-192.168.204.50@tcp:101:ln.0 Request processed in 329us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.709803:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 430 00010000:00010000:1.0:1790771166.709812:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@00000000277e558b x1877759539761280) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 114 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.709818:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (552960->557055) req@ffff8bfb0562c000 x1877759533967360/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.709832:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0dbf8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e1e expref: 114 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.709854:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0562c000 with x1877759533967360 ext(552960->557055) 00000100:00100000:1.0:1790771166.709856:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761280:192.168.204.50@tcp:104: 00002000:00010000:2.0:1790771166.709861:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0562c000 00010000:00010000:1.0:1790771166.709874:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@000000006df64346 x1877759539761408) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 1/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 113 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.709882:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0dbe3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e17 expref: 113 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709890:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761408:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.709899:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0dad9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ddf expref: 132 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709910:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa94380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761536:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.709914:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6237 00010000:00010000:1.0:1790771166.709925:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0dab6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dd1 expref: 112 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.709935:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:13761:1877759539761664:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.709968:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14362:x1877759533948416:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 1854us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.709976:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6234 00010000:00010000:1.0:1790771166.709981:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.709985:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.709990:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.709997:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.710003:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000abe90bc8 reply state 0000000019b02bfc transno 4294969385 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710004:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710023:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.710028:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.710040:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb03218900) 00010000:00010000:3.0:1790771166.710043:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.710047:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.710081:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710087:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710092:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710096:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.710099:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710104:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710111:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.710113:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.710115:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710120:0:13761:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710124:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710146:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710151:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0de91 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.710181:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14727:x1877759533951744:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 11123us (11414us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.710187:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6201 00010000:00010000:1.0:1790771166.710235:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710241:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.710257:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.710260:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.710269:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710287:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0dec9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710301:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 110 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710307:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771166.710309:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.710312:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03a00, rc 0) 00010000:00010000:3.0:1790771166.710333:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.710339:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:11969:x1877759533939456:12345-192.168.204.50@tcp:101:ls.0 Request processed in 10872us (11121us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.710346:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.710365:0:6495:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x2:0x0] 00000100:00100000:1.0:1790771166.710366:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6203 00000004:00010000:3.0:1790771166.710408:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000abe90bc8 reply state 0000000019b02bfc transno 4294969385 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.710417:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.710426:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb03218200) 00010000:00010000:3.0:1790771166.710428:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.710430:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:3.0:1790771166.710434:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00010000:00080000:3.0:1790771166.710466:0:6495:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771166.710526:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710533:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710538:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710543:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.710547:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710552:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710561:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfb03218200) 00010000:00010000:1.0:1790771166.710563:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.710566:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710571:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e02e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x8:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710584:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710589:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710594:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710599:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.710602:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710607:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710613:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb03218900) 00010000:00010000:1.0:1790771166.710615:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.710617:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710621:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e035 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.710784:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.710827:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533967616 00000100:00100000:1.0:1790771166.710831:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533967616 00000100:00100000:1.0:1790771166.710856:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6238 00000100:00100000:1.0:1790771166.710862:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:15000:x1877759533967616:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771166.710880:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.710891:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0d9d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b31 expref: 110 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710905:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:1.0:1790771166.710908:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.710914:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14306:x1877759533960192:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 4444us (4503us total) trans 4294969385 rc 0/0 00010000:00010000:1.0:1790771166.710938:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710951:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 130 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710956:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 4/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710972:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 130 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.710978:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 130 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.710985:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d806300 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539763072:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.711018:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f50300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.711130:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6229 00000100:00100000:0.0:1790771166.716781:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.716818:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955968 00000100:00100000:3.0:1790771166.716825:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955968 00000100:00100000:3.0:1790771166.716874:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6239 00000100:00100000:3.0:1790771166.716886:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14400:x1877759533955968:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771166.716902:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.716916:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0e0d6 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f3d expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.717035:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.717048:0:13763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.717056:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 4/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.717068:0:13763:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.717078:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.718547:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.718576:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533948032 00000100:00100000:0.0:1790771166.718582:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533948032 00000100:00100000:0.0:1790771166.718626:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6240 00000100:00100000:0.0:1790771166.718636:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14098:x1877759533948032:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771166.718645:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.718673:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e0e4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ea3 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718693:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97f0e0eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718700:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97f0e0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718708:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97f0e0eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718798:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e0e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ea3 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718808:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e85000/0xfa0c505d97f0e0eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ea3 expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.718814:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc3607a800) 00010000:00010000:0.0:1790771166.718816:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771166.718818:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e85000, rc 0) 00000100:00100000:0.0:1790771166.718837:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14098:x1877759533948032:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 206us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.718841:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6240 00000100:00100000:3.0:1790771166.719148:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:12241:x1877759533959168:12345-192.168.204.50@tcp:37:ls.0 Request processed in 13763us (14203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.719154:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1619 00000100:00100000:1.0:1790771166.719413:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.719433:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.719480:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533952768 00000100:00100000:0.0:1790771166.719501:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533952768 00000100:00100000:2.0:1790771166.719537:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533968384 00000100:00100000:0.0:1790771166.719544:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6241 00000100:00100000:2.0:1790771166.719545:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533968384 00000100:00100000:0.0:1790771166.719558:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14588:x1877759533952768:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.719573:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.719589:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e0f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ef7 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.719592:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6242 00000100:00100000:2.0:1790771166.719609:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:11335:x1877759533968384:12345-192.168.204.50@tcp:36:dir_create.sh.0 00010000:00010000:0.0:1790771166.719635:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719639:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771166.719652:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719677:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0dea6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dfb expref: 110 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719683:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719705:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719709:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0999b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346bd expref: 109 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719717:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719725:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771166.719729:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719731:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.719780:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0e107 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719790:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719798:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719837:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.719846:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.719853:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.719854:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771166.719867:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.719872:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0e107 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719882:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719887:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719892:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.719895:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719897:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.719902:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719916:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719935:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.719938:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 130 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719939:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.719944:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719957:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e0f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.719963:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1877759539763200:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.719967:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719976:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719981:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719985:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f73400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.719987:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719991:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.719996:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.719997:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.719999:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.720003:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e100 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.720023:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1af8d540 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.720030:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e0f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ef7 expref: 131 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.720041:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72a00/0xfa0c505d97f0e107 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ef7 expref: 130 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.720046:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc3607a800) 00010000:00010000:0.0:1790771166.720048:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.720050:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72a00, rc 0) 00000100:00100000:0.0:1790771166.720074:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03021180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14588:x1877759533952768:12345-192.168.204.50@tcp:101:ln.0 Request processed in 521us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.720080:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6241 00000100:00100000:2.0:1790771166.720636:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2397:x1877759533958784:12345-192.168.204.50@tcp:3:cat.0 Request processed in 14664us (15739us total) trans 0 rc 2031616/2031616 00000100:00100000:2.0:1790771166.720645:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 428 00002000:00100000:2.0:1790771166.720671:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x14:0x0] (12582912->14614527) req@ffff8bfb064bd500 x1877759533958784/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 2031616/2031616 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.720682:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb064bd500 with x1877759533958784 ext(12582912->14614527) 00002000:00010000:2.0:1790771166.720688:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb064bd500 00000100:00100000:3.0:1790771166.720961:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.721026:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533968640 00000100:00100000:0.0:1790771166.721032:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533968640 00000100:00100000:0.0:1790771166.721061:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6243 00000100:00100000:0.0:1790771166.721067:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+101:14808:x1877759533968640:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.721094:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721104:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 123 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721110:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 123 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721115:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721120:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721124:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 7/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721140:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 123 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721150:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 123 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.721157:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763328:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.721198:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 123 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721204:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 123 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.721211:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb54700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763456:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.721236:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 123 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721244:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 123 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.721251:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb55180 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763584:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.721276:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 123 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.721284:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 123 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.721295:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763712:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.721318:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.721748:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.721798:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533968768 00000100:00100000:0.0:1790771166.721804:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533968768 00000100:00100000:3.0:1790771166.721825:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.721843:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1624 00000100:00100000:0.0:1790771166.721856:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+102:13883:x1877759533968768:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.721862:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953152 00000100:00100000:1.0:1790771166.721867:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953152 00000100:00100000:1.0:1790771166.721908:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6244 00000100:00100000:1.0:1790771166.721916:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:11865:x1877759533953152:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.721927:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.721936:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e11c lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35efe expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.721967:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.721969:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:13883:x1877759533968768:12345-192.168.204.50@tcp:35:ls.0 Request processed in 115us (221us total) trans 4294968780 rc 0/0 00000100:00100000:0.0:1790771166.721984:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1624 00010000:00010000:1.0:1790771166.721985:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.721998:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.722017:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.722019:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.722029:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.722044:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e11c lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35efe expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.722055:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35efe expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.722061:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:1.0:1790771166.722063:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.722065:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00000100:00100000:1.0:1790771166.722090:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11865:x1877759533953152:12345-192.168.204.50@tcp:101:ls.0 Request processed in 176us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.722096:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6244 00000100:00100000:2.0:1790771166.725773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.725808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.725809:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533968896 00000100:00100000:3.0:1790771166.725817:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533968896 00000100:00100000:0.0:1790771166.725843:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956224 00000100:00100000:2.0:1790771166.725849:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.725850:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956224 00000100:00100000:1.0:1790771166.725877:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1625 00000100:00100000:0.0:1790771166.725882:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953280 00000100:00100000:0.0:1790771166.725886:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953280 00000100:00100000:1.0:1790771166.725888:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14512:x1877759533968896:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:0.0:1790771166.725916:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6245 00000100:00100000:0.0:1790771166.725929:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14833:x1877759533956224:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:2.0:1790771166.725929:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6246 00010000:00010000:0.0:1790771166.725943:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.725948:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11955:x1877759533953280:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.725953:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e12a lrc: 2/0,0 mode: --/CR res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f44 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.725961:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.725977:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0e131 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f05 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.726004:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e138 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.726013:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e138 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.726020:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.726021:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e138 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.726048:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xa1:0x0]: returning size 0 00010000:00010000:2.0:1790771166.726049:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.726051:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.726062:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e138 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.726065:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.726082:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e12a lrc: 0/0,0 mode: --/CR res: [0x240000402:0xa1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f44 expref: 127 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.726094:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73400/0xfa0c505d97f0e138 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xa1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f44 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.726097:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.726100:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00000004:00200000:2.0:1790771166.726102:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.726104:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.726108:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73400, rc 0) 00000004:00010000:2.0:1790771166.726120:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.726139:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14833:x1877759533956224:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 215us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.726146:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6245 00010000:00010000:2.0:1790771166.726146:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0e131 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f05 expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.726168:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f05 expref: 132 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.726177:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:2.0:1790771166.726180:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.726183:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83c00, rc 0) 00000100:00100000:2.0:1790771166.726222:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:11955:x1877759533953280:12345-192.168.204.50@tcp:101:ls.0 Request processed in 280us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.726230:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6246 00000100:00100000:3.0:1790771166.732670:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.732706:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956352 00000100:00100000:0.0:1790771166.732711:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956352 00000100:00100000:0.0:1790771166.732744:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6247 00000100:00100000:0.0:1790771166.732751:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14757:x1877759533956352:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.732763:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.732772:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0e146 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ebf expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.732825:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.732837:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.732843:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.732850:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00010000:00010000:0.0:1790771166.732915:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73800/0xfa0c505d97f0e146 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.732926:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.732931:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771166.732933:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.732934:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73600, rc 0) 00000100:00100000:0.0:1790771166.732963:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14757:x1877759533956352:12345-192.168.204.50@tcp:101:cp.0 Request processed in 214us (308us total) trans 4294968781 rc 0/0 00000100:00100000:0.0:1790771166.732968:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6247 00000100:00100000:1.0:1790771166.733202:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.733231:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.733234:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969280 00000100:00100000:3.0:1790771166.733239:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969280 00000100:00100000:3.0:1790771166.733271:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6248 00000100:00100000:3.0:1790771166.733281:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+103:14730:x1877759533969280:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:2.0:1790771166.733283:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969408 00000100:00100000:2.0:1790771166.733291:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969408 00000100:00100000:1.0:1790771166.733301:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.733336:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1015 00000100:00100000:0.0:1790771166.733338:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969536 00000100:00100000:0.0:1790771166.733344:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969536 00000100:00100000:2.0:1790771166.733349:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533969408:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:1.0:1790771166.733358:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.733385:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 841 00000100:00100000:0.0:1790771166.733395:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759533969536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.733404:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.733416:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105200/0xfa0c505d97f0df7f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e72 expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.733431:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:0.0:1790771166.733434:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.733463:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759533969536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 70us (163us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771166.733463:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size from disk: 38336 -> 38336 00002000:00010000:2.0:1790771166.733473:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000100:00100000:0.0:1790771166.733478:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 841 00002000:00010000:2.0:1790771166.733480:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771166.733514:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.733517:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:2.0:1790771166.733550:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759533969408:12345-192.168.204.50@tcp:2:chown.0 Request processed in 203us (318us total) trans 4294967625 rc 0/0 00000100:00100000:2.0:1790771166.733558:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1015 00000100:00100000:0.0:1790771166.733631:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957376 00000100:00100000:0.0:1790771166.733636:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957376 00000100:00100000:0.0:1790771166.733679:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6249 00000100:00100000:0.0:1790771166.733687:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13742:x1877759533957376:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.733694:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.733704:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e15b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f67 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.733731:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533958528:12345-192.168.204.50@tcp:3:cat.0 Request processed in 28684us (28903us total) trans 0 rc 4194304/4194304 00000100:00100000:2.0:1790771166.733741:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 427 00010000:00010000:0.0:1790771166.733744:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0e162 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.733752:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x14:0x0] (8388608->12582911) req@ffff8bfc3fa94a80 x1877759533958528/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 4194304/4194304 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771166.733754:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0e162 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.733770:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0e162 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.733775:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa94a80 with x1877759533958528 ext(8388608->12582911) 00002000:00010000:2.0:1790771166.733782:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa94a80 00000004:00200000:0.0:1790771166.733784:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.733788:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.733796:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0e162 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.733812:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e15b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f67 expref: 129 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.733823:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030200/0xfa0c505d97f0e162 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f67 expref: 128 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.733829:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc1040f000) 00010000:00010000:0.0:1790771166.733831:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.733834:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00030200, rc 0) 00000100:00100000:0.0:1790771166.733854:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13742:x1877759533957376:12345-192.168.204.50@tcp:101:ls.0 Request processed in 169us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.733860:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6249 00000100:00100000:1.0:1790771166.734004:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14512:x1877759533968896:12345-192.168.204.50@tcp:37:rm.0 Request processed in 8119us (8233us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.734011:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1625 00000100:00100000:0.0:1790771166.734764:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.734813:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957504 00000100:00100000:1.0:1790771166.734820:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957504 00000001:00080000:3.0:1790771166.734833:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968781 is committed 00010000:00010000:0.0:1790771166.734852:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771166.734854:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968780 is committed 00000100:00100000:1.0:1790771166.734860:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6250 00000001:00080000:3.0:1790771166.734864:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968779 is committed 00010000:00010000:0.0:1790771166.734867:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.734873:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14785:x1877759533957504:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.734878:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.734878:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 12 committed 00010000:00010000:1.0:1790771166.734883:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.734888:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.734892:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.734896:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e169 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ec6 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.734898:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.734922:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x510a92c1 (ffff8bfc3600d400) 00010000:00010000:0.0:1790771166.734925:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.734930:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.734939:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0d592 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.734951:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.734963:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 114 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.734964:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.734978:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 111 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.734983:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.734988:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 5/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.734988:0:7423:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 19 batchid updated 00010000:00010000:0.0:1790771166.734998:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735004:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.735007:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735013:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735016:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 108 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735026:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x0 (ffff8bfc3600d300) 00000020:00080000:2.0:1790771166.735027:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00010000:00010000:1.0:1790771166.735029:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 108 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735032:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.735036:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735044:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0d599 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.735045:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539763840:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.735062:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735072:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735077:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735082:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.735084:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.735092:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfc1af8db40 with version 40 00010000:00010000:0.0:1790771166.735093:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735093:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14730:x1877759533969280:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 1810us (1887us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.735105:0:13761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 107 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.735111:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 19 cancel update log [0x200000401:0x2:0x0].18: rc = 0 00010000:00010000:0.0:1790771166.735113:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa5:0x0].0xd6e9df9d (ffff8bfc3600dc00) 00000100:00100000:3.0:1790771166.735114:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6248 00010000:00010000:0.0:1790771166.735121:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.735125:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735129:0:13761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 107 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735134:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0d68e lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa5:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.735145:0:13761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539763968:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.735157:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735163:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.735164:0:13761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.735171:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735175:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.735178:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.735178:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 19 cancel update log [0x240000400:0x2:0x0].18: rc = 0 00010000:00010000:1.0:1790771166.735186:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.735193:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00010000:00010000:0.0:1790771166.735194:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735196:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735213:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:1.0:1790771166.735213:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735219:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.735223:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735225:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.735233:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0d951 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735234:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735247:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735249:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735260:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735268:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735274:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.735274:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x12:0x0].0xf7a5b27a (ffff8bfc3607a700) 00010000:00010000:0.0:1790771166.735280:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735282:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.735283:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539764096:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1790771166.735290:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735296:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735301:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0d369 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x12:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735306:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:0.0:1790771166.735309:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000004:00080000:2.0:1790771166.735309:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 40 rpc_version 40 00010000:00010000:0.0:1790771166.735314:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735320:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0dbff lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x9:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735326:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735327:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:2.0:1790771166.735332:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1790771166.735340:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735341:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735346:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3fa94380 x1877759539764480/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1790771166.735358:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735362:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735379:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735381:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.735388:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735389:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cafe00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.735391:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa94380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539764480:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1790771166.735394:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735406:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735408:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735423:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.735425:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.735429:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.735430:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.735434:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735435:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735438:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.735460:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735461:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735472:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829300 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.735474:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539764480 00000100:00100000:3.0:1790771166.735481:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539764480 00010000:00010000:0.0:1790771166.735506:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.735516:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0dda3 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735516:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735532:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1790771166.735533:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539764224:0@lo:2:osp-syn-0-1.0 00010000:00010000:1.0:1790771166.735538:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0d79f lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735546:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+6:7438:x1877759539764480:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1790771166.735556:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735562:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735567:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735577:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.735577:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.735582:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735588:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735596:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff8bfc1040f000) 00010000:00010000:1.0:1790771166.735598:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.735601:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735606:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0dd79 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735618:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735622:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735627:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735631:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.735634:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735635:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539764096 00010000:00010000:1.0:1790771166.735643:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735644:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539764096 00010000:00010000:1.0:1790771166.735671:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771166.735674:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.735678:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.735680:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539764224 00010000:00010000:1.0:1790771166.735683:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0df24 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x37:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735686:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+7:7438:x1877759539764480:12345-0@lo:1000:osp_up0-1.0 Request processed in 142us (248us total) trans 4294969391 rc 0/0 00000100:00100000:0.0:1790771166.735687:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539764224 00010000:00010000:1.0:1790771166.735699:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.735701:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1790771166.735707:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00010000:00010000:1.0:1790771166.735708:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735716:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735721:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05668600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.735722:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3625:x1877759539764096:12345-0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1790771166.735724:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.735734:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00010000:00010000:1.0:1790771166.735739:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.735747:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+6:3626:x1877759539764224:12345-0@lo:2:osp-syn-0-1.0 00002000:00080000:2.0:1790771166.735747:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:14 count 1 00010000:00010000:1.0:1790771166.735753:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa1:0x0].0x0 (ffff8bfc3607a400) 00010000:00010000:1.0:1790771166.735757:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.735759:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735765:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0dd33 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735770:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735775:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735790:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735796:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735802:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735803:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.735807:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735819:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735829:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xe:0x0].0x0 since=3s v=(1 0) 00010000:00010000:1.0:1790771166.735831:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.735838:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.735840:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735840:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 1) 00010000:00010000:2.0:1790771166.735852:0:8676:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735853:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735869:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0dd72 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735885:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735890:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735897:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735899:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 21 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735903:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533f000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.735908:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.735915:0:13788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 17258 -> 17258 00002000:00010000:0.0:1790771166.735922:0:13788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.735925:0:13788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 1790771165 -> 0 00010000:00010000:1.0:1790771166.735926:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.735927:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 21 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.735928:0:13788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.735934:0:13788:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771166.735946:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.735949:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.735951:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.735955:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539764608:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.735959:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.735966:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0dd25 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x6e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.735980:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+7:3626:x1877759539764224:12345-0@lo:2:osp-syn-0-1.0 Request processed in 237us (408us total) trans 4294967619 rc 0/0 00000100:00100000:0.0:1790771166.735987:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1790771166.736027:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35fcf180 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.736061:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539762176:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.736073:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967591 gen 2 00010000:00010000:0.0:1790771166.736079:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.736080:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb0562df80, transno 4294967590 00000004:00080000:2.0:1790771166.736098:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb0562c380, transno 4294967591 00000100:00100000:2.0:1790771166.736109:0:3626:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfc3fa95500 x1877759539764224/t4294967619(4294967619) o2->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790771166.736119:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fa95500/2, rc 0, transno 4294967619 00000100:00100000:0.0:1790771166.736122:0:7438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969318 gen 2 00000100:00100000:1.0:1790771166.736128:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:0.0:1790771166.736129:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969318 committed transno 4294969318 00000100:00100000:2.0:1790771166.736130:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539764224:0@lo:2:osp-syn-0-1.0 00000020:00080000:0.0:1790771166.736134:0:7438:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8bfb060800c0 refcount 2 committed 0 result 0 batchid 20 00000020:00080000:0.0:1790771166.736138:0:7438:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4cb00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06080300 00000020:00080000:0.0:1790771166.736141:0:7438:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000401:0x2:0x0].19 00000020:00080000:0.0:1790771166.736144:0:7438:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c700 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05d94400 00000020:00080000:0.0:1790771166.736146:0:7438:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000400:0x2:0x0].19 00000100:00100000:1.0:1790771166.736157:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.736166:0:7438:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfc3fa94380 x1877759539764480/t4294969391(4294969391) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1790771182 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790771166.736183:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa94380 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539764480:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1790771166.736190:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.736197:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969664 00000100:00100000:3.0:1790771166.736203:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969664 00000020:00080000:0.0:1790771166.736216:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 20 committed batchid 19 00000020:00080000:0.0:1790771166.736242:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 19 00000100:00100000:3.0:1790771166.736242:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1018 00000100:00100000:2.0:1790771166.736247:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969792 00000100:00100000:1.0:1790771166.736249:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.736255:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969792 00000100:00100000:3.0:1790771166.736256:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:14822:x1877759533969664:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:3.0:1790771166.736266:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.736269:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539762048:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.736277:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360a2 expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.736281:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533969920 00010000:00010000:0.0:1790771166.736284:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736286:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 132 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.736289:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533969920 00010000:00010000:3.0:1790771166.736308:0:13786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.736312:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.736323:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771166.736328:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(2 0) 00000100:00100000:2.0:1790771166.736335:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1725 00010000:00010000:3.0:1790771166.736335:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 23 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.736339:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953664 00000100:00100000:0.0:1790771166.736345:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953664 00000100:00100000:2.0:1790771166.736354:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759533969792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.736363:0:13786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 23 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.736367:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1726 00010000:00010000:2.0:1790771166.736367:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.736378:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6251 00010000:00010000:2.0:1790771166.736381:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.736384:0:13786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 23 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.736385:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:2396:x1877759533969920:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.736393:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:12238:x1877759533953664:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.736402:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.736409:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.736412:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.736421:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e185 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f0c expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736423:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 133 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.736441:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539764736:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.736443:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736468:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0da77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dc3 expref: 134 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.736469:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0dee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee9 expref: 110 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.736470:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.736480:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f51c00 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.736512:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736523:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:0.0:1790771166.736532:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736533:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.736534:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.736543:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.736559:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.736560:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.736564:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.736566:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.736575:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.736577:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736581:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.736600:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.736603:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.736609:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.736614:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e185 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f0c expref: 134 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.736620:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.736625:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:2396:x1877759533969920:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 244us (384us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.736629:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.736643:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1726 00010000:00010000:0.0:1790771166.736646:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f0c expref: 133 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.736668:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:0.0:1790771166.736670:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.736673:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00000100:00100000:2.0:1790771166.736679:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759533969792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 326us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.736689:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1725 00000100:00100000:0.0:1790771166.736702:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:12238:x1877759533953664:12345-192.168.204.50@tcp:101:ls.0 Request processed in 313us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.736709:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6251 00010000:00010000:2.0:1790771166.736757:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.736767:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.737030:0:13765:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc35fcfb40 with version 0 00010000:00010000:2.0:1790771166.737047:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737055:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737061:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737067:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.737071:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737078:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737088:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:2.0:1790771166.737091:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.737094:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737101:0:13765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737108:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737138:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737146:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0dfc5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x24:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.737158:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.737166:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.737201:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14890:x1877759533957760:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 32892us (33074us total) trans 0 rc -61/-61 00000100:00100000:2.0:1790771166.737210:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6218 00010000:00010000:2.0:1790771166.737302:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e64 expref: 132 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737318:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd600/0xfa0c505d97f0e019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e64 expref: 131 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.737331:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:2.0:1790771166.737334:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771166.737336:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd600, rc 0) 00000100:00100000:2.0:1790771166.737374:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14382:x1877759533945088:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 31502us (31550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.737386:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6227 00010000:00010000:0.0:1790771166.737473:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.737481:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737527:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737532:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790771166.737548:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04fe2c00/0xfa0c505d97f0e03c lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0e051 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.737562:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969392 is committed 00000100:00100000:2.0:1790771166.737565:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539764864:0@lo:103:jbd2/dm-0-8.0 00000001:00080000:0.0:1790771166.737567:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969391 is committed 00000001:00080000:0.0:1790771166.737576:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969388 is committed 00000004:00010000:3.0:1790771166.737606:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d520e224 reply state 00000000e9b1516e transno 4294969392 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.737607:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771166.737618:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.737624:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.737628:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771166.737631:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771166.737637:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.737645:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539764864 00000100:00100000:1.0:1790771166.737650:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539764864 00000100:00100000:1.0:1790771166.737693:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1790771166.737699:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+6:3627:x1877759539764864:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1790771166.737706:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.737715:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e051 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0e03c expref: 6 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.737723:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfb03218d00) 00010000:00010000:1.0:1790771166.737729:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.737759:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+5:3627:x1877759539764864:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 60us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.737764:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00010000:00080000:3.0:1790771166.737771:0:12030:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771166.737795:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14765:x1877759533957888:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 33408us (33634us total) trans 4294969392 rc 0/0 00000100:00100000:2.0:1790771166.737797:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539764864:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:3.0:1790771166.737807:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6219 00010000:00010000:0.0:1790771166.737816:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737827:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737834:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737841:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.737845:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737853:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737863:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.737867:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.737870:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.737877:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0dfd3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x18:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738096:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.738136:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.738140:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970048 00000100:00100000:2.0:1790771166.738147:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970048 00000100:00100000:0.0:1790771166.738162:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.738177:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970304 00000100:00100000:1.0:1790771166.738182:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970304 00000100:00100000:0.0:1790771166.738186:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.738191:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970560 00000100:00100000:2.0:1790771166.738192:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6252 00000100:00100000:3.0:1790771166.738197:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970560 00000100:00100000:2.0:1790771166.738207:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:15036:x1877759533970048:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:0.0:1790771166.738210:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970688 00000100:00100000:0.0:1790771166.738216:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970688 00000100:00100000:1.0:1790771166.738217:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1019 00000100:00100000:1.0:1790771166.738236:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14478:x1877759533970304:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:3.0:1790771166.738243:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1020 00010000:00010000:1.0:1790771166.738245:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.738248:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738249:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6253 00000100:00100000:3.0:1790771166.738257:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533970560:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:1.0:1790771166.738259:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd3eb182/0xfa0c505d97f0e19a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360b0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738265:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14601:x1877759533970688:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:2.0:1790771166.738275:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.738287:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790771166.738289:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.738300:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=166s v=(0 0) 00010000:00010000:2.0:1790771166.738301:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 63 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738304:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.738306:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771166.738320:0:8406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd3eb182/0xfa0c505d97f0e19a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b0 expref: 25 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738328:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 63 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.738350:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd3eb182/0xfa0c505d97f0e19a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b0 expref: 25 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738358:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 63 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738358:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 63 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.738361:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597800, rc 0) 00010000:00010000:0.0:1790771166.738382:0:13768:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738387:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738390:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 6/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.738394:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14478:x1877759533970304:12345-192.168.204.50@tcp:101:dd.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.738412:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1019 00010000:00010000:2.0:1790771166.738417:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 63 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738424:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738437:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 63 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738439:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 104 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738464:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 63 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738465:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539764992:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.738481:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.738500:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0001_UUID:13771:1877759539762304:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.738516:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738522:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738535:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738543:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738547:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 63 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.738561:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.738574:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 63 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738576:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 15/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738606:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539765120:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.738619:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738632:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 63 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.738642:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.738653:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765248:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.738674:0:13768:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 63 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.738688:0:13768:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 63 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738702:0:13768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539765376:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.738722:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.738729:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.738740:0:13768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633600 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.738744:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 104 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.738759:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.738769:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.738801:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533971072 00010000:00010000:2.0:1790771166.738802:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 63 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.738807:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533971072 00010000:00010000:2.0:1790771166.738819:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 64 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.738833:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765632:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.738839:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970944 00000100:00100000:0.0:1790771166.738854:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1626 00000100:00100000:0.0:1790771166.738865:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14017:x1877759533971072:12345-192.168.204.50@tcp:35:dd.0 00000100:00100000:1.0:1790771166.738866:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533971200 00000100:00100000:1.0:1790771166.738872:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533971200 00010000:00010000:2.0:1790771166.738882:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 64 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738896:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 64 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.738899:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1021 00000100:00100000:1.0:1790771166.738911:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:14768:x1877759533971200:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:2.0:1790771166.738916:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05ee2300 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765760:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.738921:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.738930:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360b7 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.738934:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970944 00010000:00010000:1.0:1790771166.738948:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771166.738954:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 26 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738960:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 66 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.738962:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(3 0) 00000001:00080000:0.0:1790771166.738969:0:13790:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968782 00010000:00010000:1.0:1790771166.738974:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.738984:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 67 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.738999:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765888:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.739004:0:12031:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 26 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739015:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739023:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596200, rc 0) 00000100:00100000:0.0:1790771166.739033:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14017:x1877759533971072:12345-192.168.204.50@tcp:35:dd.0 Request processed in 170us (393us total) trans 4294968783 rc 0/0 00000100:00100000:0.0:1790771166.739039:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1626 00000020:00080000:0.0:1790771166.739043:0:13790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1790771166.739051:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:14768:x1877759533971200:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 141us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.739059:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1021 00010000:00010000:2.0:1790771166.739060:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 66 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739075:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 66 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739087:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06192680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766144:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.739117:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 66 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739134:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 66 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739146:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 66 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.739149:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1727 00000100:00100000:3.0:1790771166.739163:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:2397:x1877759533970944:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.739178:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766272:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.739186:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533953792 00000100:00100000:1.0:1790771166.739190:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533953792 00000100:00100000:1.0:1790771166.739217:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6254 00010000:00010000:2.0:1790771166.739226:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 66 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.739228:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:11954:x1877759533953792:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.739241:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.739247:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 66 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739253:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e1af lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f13 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739260:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766400:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.739284:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739293:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739300:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.739310:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967625 is committed 00010000:00010000:2.0:1790771166.739312:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 66 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.739316:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000001:00080000:0.0:1790771166.739318:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967624 is committed 00010000:00010000:3.0:1790771166.739319:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:1.0:1790771166.739324:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.739331:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 66 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.739336:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739339:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 66 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739360:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766528:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.739363:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e1af lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f13 expref: 132 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.739374:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2399:x1877759533970560:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1121us (1210us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.739378:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f13 expref: 131 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739382:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 66 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.739391:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1020 00010000:00010000:2.0:1790771166.739400:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 66 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.739403:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:1.0:1790771166.739409:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.739414:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81800, rc 0) 00010000:00010000:3.0:1790771166.739415:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0d7ec lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c11 expref: 66 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739429:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 65 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739432:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771166.739440:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.739442:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11954:x1877759533953792:12345-192.168.204.50@tcp:101:ls.0 Request processed in 215us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.739459:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6254 00000100:00100000:2.0:1790771166.739459:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766656:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.739460:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739473:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739478:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739510:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739515:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739535:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.739547:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739555:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739564:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 65 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739582:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 65 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739596:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766784:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.739603:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2397:x1877759533970944:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 443us (1045us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.739612:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739622:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739630:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739638:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.739642:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739649:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739652:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 105 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739676:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771166.739679:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.739681:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739684:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 105 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739692:0:13771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739703:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739706:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766912:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.739725:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.739735:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0dfe1 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739746:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.739748:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1727 00000100:00100000:1.0:1790771166.739771:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.739777:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14985:x1877759533959040:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 34635us (34847us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771166.739783:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6222 00000100:00100000:2.0:1790771166.739800:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954432 00000100:00100000:2.0:1790771166.739807:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954432 00010000:00010000:3.0:1790771166.739826:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739836:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.739852:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6255 00000100:00100000:2.0:1790771166.739863:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13990:x1877759533954432:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.739873:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.739883:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e1bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ed4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.739913:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 9475 00000004:00200000:3.0:1790771166.739917:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.739922:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739934:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739947:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739963:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739971:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.739978:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.739979:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.739997:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.740014:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0e0d6 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f3d expref: 105 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740015:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740031:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.740036:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f3d expref: 104 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740041:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.740053:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:2.0:1790771166.740056:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.740059:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.740064:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aec00, rc 0) 00010000:00010000:2.0:1790771166.740067:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.740073:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740079:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740088:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.740092:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.740096:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.740100:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14400:x1877759533955968:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 23217us (23320us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.740114:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e1c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.740115:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6239 00010000:00010000:2.0:1790771166.740129:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740136:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740144:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740149:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.740153:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740159:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740167:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc0786e700) 00010000:00010000:2.0:1790771166.740169:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.740172:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740177:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e1cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740202:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e1bd lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ed4 expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740217:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.740220:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.740224:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e1bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ed4 expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.740233:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fc00, rc 0) 00000100:00100000:2.0:1790771166.740266:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13990:x1877759533954432:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 406us (497us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.740274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6255 00000100:00100000:1.0:1790771166.787396:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.787428:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.787461:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533975552 00000100:00100000:3.0:1790771166.787470:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533965824 00000100:00100000:0.0:1790771166.787472:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533975552 00000100:00100000:3.0:1790771166.787478:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533965824 00000100:00100000:0.0:1790771166.787544:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6256 00000100:00100000:3.0:1790771166.787556:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6257 00000100:00100000:0.0:1790771166.787559:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:14076:x1877759533975552:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.787569:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13672:x1877759533965824:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.787585:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.787588:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.787602:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e1d2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f98 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787605:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e1d9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360fd expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787695:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787697:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787719:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787728:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787732:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787742:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787746:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787750:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787772:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787775:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787786:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787792:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.787880:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.787880:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.787954:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787960:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787969:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787969:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787988:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.787993:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.787995:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.788000:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.788003:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788005:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788017:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788019:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788038:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.788041:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.788045:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788050:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.788051:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e1e0 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788059:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.788065:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788067:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788097:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e1e7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788098:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788114:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788119:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.788120:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788121:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788136:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788137:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788154:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788156:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc3607ac00) 00010000:00010000:0.0:1790771166.788162:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.788166:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.788167:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788172:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788177:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e1ee lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788180:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788192:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfc10471f00) 00010000:00010000:3.0:1790771166.788194:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.788196:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788201:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e1f5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788213:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e1d9 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360fd expref: 67 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788222:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.788224:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.788227:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e1d9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360fd expref: 67 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788233:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e1d2 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f98 expref: 106 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.788254:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8e00, rc 0) 00010000:00010000:3.0:1790771166.788258:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771166.788261:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.788265:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e1d2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f98 expref: 106 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.788274:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595a00, rc 0) 00000100:00100000:0.0:1790771166.788317:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14076:x1877759533975552:12345-192.168.204.50@tcp:101:ls.0 Request processed in 759us (922us total) trans 4294968784 rc 301/301 00000100:00100000:3.0:1790771166.788318:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13672:x1877759533965824:12345-192.168.204.50@tcp:101:ls.0 Request processed in 746us (881us total) trans 4294968785 rc 301/301 00000100:00100000:3.0:1790771166.788334:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6257 00000100:00100000:0.0:1790771166.788342:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6256 00000100:00100000:2.0:1790771166.797058:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0552f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:13787:1877759539762560:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.797073:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.797098:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [8192->24575] (req 8192->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fe5 expref: 21 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.797116:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82400, rc 0) 00000100:00100000:0.0:1790771166.797119:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533960704 00000100:00100000:0.0:1790771166.797127:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533960704 00000100:00100000:1.0:1790771166.797139:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.797162:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:15035:x1877759533962496:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 89722us (90362us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.797170:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533970816 00000100:00100000:2.0:1790771166.797175:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1014 00000100:00100000:0.0:1790771166.797176:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533970816 00000100:00100000:0.0:1790771166.797217:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6258 00000100:00100000:1.0:1790771166.797219:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.797229:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:14987:x1877759533960704:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.797242:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.797245:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533960320 00000100:00100000:1.0:1790771166.797251:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533960320 00010000:00010000:0.0:1790771166.797256:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e20a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f6e expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.797270:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.797283:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6259 00000100:00100000:1.0:1790771166.797291:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14967:x1877759533970816:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.797301:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.797315:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0e211 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36071 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.797317:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6260 00010000:00010000:0.0:1790771166.797339:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.797350:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.797360:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.797368:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.797370:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 9475 00000100:00100000:2.0:1790771166.797371:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.797377:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13736:x1877759533960320:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.797389:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.797401:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e22d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f8a expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.797414:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.797437:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0e211 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36071 expref: 112 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.797441:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533971968 00010000:00010000:0.0:1790771166.797446:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e20a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 113 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.797449:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533971968 00010000:00010000:1.0:1790771166.797451:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb0321a600) 00010000:00010000:1.0:1790771166.797459:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.797465:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0e211 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36071 expref: 112 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.797471:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 112 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.797480:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771166.797480:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596a00, rc 0) 00010000:00010000:0.0:1790771166.797482:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.797520:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9e00, rc 0) 00000100:00100000:2.0:1790771166.797526:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1627 00000100:00100000:1.0:1790771166.797542:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14967:x1877759533970816:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 248us (398us total) trans 4294968786 rc 301/301 00000100:00100000:2.0:1790771166.797544:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14067:x1877759533971968:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.797555:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14987:x1877759533960704:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 328us (484us total) trans 4294968787 rc 0/0 00000100:00100000:1.0:1790771166.797559:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6259 00000100:00100000:0.0:1790771166.797570:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6258 00000100:00100000:1.0:1790771166.797580:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533971712 00000100:00100000:1.0:1790771166.797584:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533971712 00010000:00010000:3.0:1790771166.797588:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.797599:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.797602:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979520 00000100:00100000:0.0:1790771166.797609:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979520 00000100:00100000:1.0:1790771166.797613:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6261 00000100:00100000:1.0:1790771166.797623:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:13260:x1877759533971712:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.797631:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.797643:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0e23b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.797645:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->2276) req@ffff8bfb069a9180 x1877759533979520/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 2768/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771166.797679:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.797681:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069a9180 with x1877759533979520 ext(0->2276) 00002000:00010000:0.0:1790771166.797689:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069a9180 00000100:00100000:2.0:1790771166.797701:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14067:x1877759533971968:12345-192.168.204.50@tcp:35:ls.0 Request processed in 163us (286us total) trans 4294968788 rc 0/0 00000004:00200000:3.0:1790771166.797708:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.797713:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.797715:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1627 00000100:00100000:0.0:1790771166.797716:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 431 00010000:00010000:1.0:1790771166.797716:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0e242 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.797727:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.797731:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759533979520:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:1.0:1790771166.797734:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.797754:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.797767:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.797771:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.797771:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e22d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 110 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.797783:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0e242 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.797789:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 109 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.797797:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.797800:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.797805:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597400/0xfa0c505d97f0e23b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360be expref: 106 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.797805:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.797806:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594600, rc 0) 00010000:00010000:1.0:1790771166.797822:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596400/0xfa0c505d97f0e242 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360be expref: 105 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.797829:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.797831:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1790771166.797834:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972224 00010000:00010000:1.0:1790771166.797835:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596400, rc 0) 00000100:00100000:2.0:1790771166.797841:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972224 00000100:00100000:1.0:1790771166.797858:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:13260:x1877759533971712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 238us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.797865:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6261 00000100:00100000:0.0:1790771166.797881:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6262 00000100:00100000:3.0:1790771166.797893:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13736:x1877759533960320:12345-192.168.204.50@tcp:101:ls.0 Request processed in 562us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.797898:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14506:x1877759533972224:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:3.0:1790771166.797912:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6260 00010000:00010000:0.0:1790771166.797926:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.797943:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0df1d lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f36 expref: 67 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.797956:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.797960:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.797974:0:13769:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000058fcad3c x1877759539763584) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.797975:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb058b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000_UUID:13770:1877759539762944:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.797992:0:13769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.797996:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798003:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798026:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 108 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.798031:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e04a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eaa expref: 108 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.798041:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.798042:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.798055:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb55180 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763584:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.798068:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb55c00 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763712:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.798072:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972864 00010000:00010000:0.0:1790771166.798074:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 107 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.798077:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972864 00010000:00010000:0.0:1790771166.798088:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 107 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.798100:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539767040:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.798117:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6263 00000100:00100000:2.0:1790771166.798127:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14254:x1877759533972864:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:2.0:1790771166.798154:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.798172:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0d7de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ca4 expref: 105 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.798174:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb060809c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.798191:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.798196:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.798265:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+104:14254:x1877759533972864:12345-192.168.204.50@tcp:36:ln.0 Request processed in 140us (231us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771166.798275:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6263 00000100:00100000:3.0:1790771166.798445:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.798451:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533979520:12345-192.168.204.50@tcp:4:cat.0 Request processed in 721us (1184us total) trans 4294967626 rc 0/0 00000100:00100000:1.0:1790771166.798457:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 431 00002000:00100000:1.0:1790771166.798463:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x1e:0x0] (0->2276) req@ffff8bfb069a9180 x1877759533979520/t4294967626(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 2768/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790771166.798470:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069a9180 with x1877759533979520 ext(0->2276) 00002000:00010000:1.0:1790771166.798474:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069a9180 00000100:00100000:0.0:1790771166.798509:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533973248 00000100:00100000:0.0:1790771166.798514:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533973248 00000100:00100000:0.0:1790771166.798544:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1628 00000100:00100000:0.0:1790771166.798550:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14362:x1877759533973248:12345-192.168.204.50@tcp:35:lfs.0 00000100:00100000:2.0:1790771166.798571:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.798604:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533973504 00000100:00100000:1.0:1790771166.798608:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533973504 00000100:00100000:1.0:1790771166.798635:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6264 00000100:00100000:1.0:1790771166.798644:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:13883:x1877759533973504:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.798666:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.798677:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597200/0xfa0c505d97f0e250 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360cc expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.798678:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d806300 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0000_UUID:13772:1877759539763072:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.798692:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1877759539763200:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.798705:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.798715:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.798727:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.798733:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14362:x1877759533973248:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 180us (286us total) trans 4294968789 rc 0/0 00010000:00010000:1.0:1790771166.798741:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.798745:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1628 00010000:00010000:1.0:1790771166.798754:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 4/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.798765:0:12128:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 4/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.798772:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798801:0:13769:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000047a76e4a x1877759539763328) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 108 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798812:0:13769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 108 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798825:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e0c8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb8 expref: 108 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.798834:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763328:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.798850:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb54700 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539763456:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.798859:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.798869:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.798874:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798880:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.798888:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.798888:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.798901:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533965568 00000100:00100000:2.0:1790771166.798908:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533965568 00000100:00100000:1.0:1790771166.798914:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.798917:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533975040 00000100:00100000:3.0:1790771166.798923:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533975040 00000100:00100000:0.0:1790771166.798939:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533975168 00000100:00100000:1.0:1790771166.798944:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.798945:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533975168 00000100:00100000:2.0:1790771166.798955:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533975680 00000100:00100000:2.0:1790771166.798962:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533975680 00000100:00100000:3.0:1790771166.798962:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1629 00000100:00100000:1.0:1790771166.798972:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.798987:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1630 00000100:00100000:1.0:1790771166.799000:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533955072 00000100:00100000:1.0:1790771166.799005:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533955072 00000100:00100000:2.0:1790771166.799009:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6265 00000100:00100000:2.0:1790771166.799021:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13737:x1877759533965568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.799032:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.799038:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14003:x1877759533975168:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.799039:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11375c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:13270:x1877759533975040:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.799047:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e25e lrc: 2/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3607f expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.799054:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6266 00000100:00100000:1.0:1790771166.799066:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:14485:x1877759533975680:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:2.0:1790771166.799113:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.799126:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.799138:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.799153:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:14485:x1877759533975680:12345-192.168.204.50@tcp:36:ln.0 Request processed in 86us (207us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771166.799154:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14003:x1877759533975168:12345-192.168.204.50@tcp:35:ls.0 Request processed in 154us (235us total) trans 4294969393 rc 0/0 00000004:00200000:2.0:1790771166.799156:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.799161:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11375c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+106:13270:x1877759533975040:12345-192.168.204.50@tcp:35:ls.0 Request processed in 186us (270us total) trans 4294969394 rc 0/0 00000004:00200000:2.0:1790771166.799165:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.799173:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6266 00000100:00100000:0.0:1790771166.799178:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1630 00000004:00010000:2.0:1790771166.799182:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.799188:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1629 00000100:00100000:1.0:1790771166.799194:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6267 00000100:00100000:1.0:1790771166.799204:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:12256:x1877759533955072:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.799211:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.799217:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e25e lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 110 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.799222:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e26c lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f2f expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.799239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.799241:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 109 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.799252:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:2.0:1790771166.799256:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.799260:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fa00, rc 0) 00010000:00010000:1.0:1790771166.799264:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.799273:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.799279:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.799291:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13737:x1877759533965568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 272us (431us total) trans 0 rc 0/0 00000004:00200000:1.0:1790771166.799295:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.799300:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.799301:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6265 00000100:00100000:0.0:1790771166.799309:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533976192 00000004:00010000:1.0:1790771166.799311:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.799315:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533976192 00010000:00010000:1.0:1790771166.799328:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e26c lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f2f expref: 134 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.799343:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f2f expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.799348:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1631 00010000:00010000:1.0:1790771166.799357:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00000100:00100000:0.0:1790771166.799361:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+105:11972:x1877759533976192:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:1.0:1790771166.799362:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.799368:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60000, rc 0) 00000100:00100000:1.0:1790771166.799400:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:12256:x1877759533955072:12345-192.168.204.50@tcp:101:ls.0 Request processed in 197us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.799405:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6267 00000100:00100000:1.0:1790771166.799439:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.799465:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.799517:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533976960 00000100:00100000:2.0:1790771166.799523:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533976960 00000100:00100000:1.0:1790771166.799534:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.799559:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533976576 00000100:00100000:1.0:1790771166.799560:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.799562:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956864 00000100:00100000:3.0:1790771166.799565:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533976576 00000100:00100000:2.0:1790771166.799569:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956864 00000100:00100000:1.0:1790771166.799587:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.799599:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1632 00000100:00100000:3.0:1790771166.799609:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:13888:x1877759533976576:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.799617:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.799622:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533956992 00000100:00100000:2.0:1790771166.799628:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533956992 00000100:00100000:1.0:1790771166.799636:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533973376 00000100:00100000:1.0:1790771166.799640:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533973376 00000100:00100000:2.0:1790771166.799671:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533954816 00002000:00100000:1.0:1790771166.799676:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (557056->561151) req@ffff8bfb03d92d80 x1877759533973376/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.799679:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533954816 00002000:00100000:1.0:1790771166.799686:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d92d80 with x1877759533973376 ext(557056->561151) 00002000:00010000:1.0:1790771166.799690:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d92d80 00000100:00100000:1.0:1790771166.799710:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 432 00000100:00100000:2.0:1790771166.799718:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6268 00000100:00100000:1.0:1790771166.799722:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533973376:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771166.799727:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:13888:x1877759533976576:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (283us total) trans 4294968790 rc 0/0 00000100:00100000:2.0:1790771166.799737:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:15010:x1877759533976960:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:3.0:1790771166.799744:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1632 00010000:00010000:2.0:1790771166.799766:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.799772:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6269 00010000:00010000:2.0:1790771166.799782:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8000/0xfa0c505d97f087f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34065 expref: 136 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.799787:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14667:x1877759533956864:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771166.799801:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.799803:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:1.0:1790771166.799810:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533973376:12345-192.168.204.50@tcp:3:cat.0 Request processed in 90us (191us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.799811:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.799815:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0e27a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f4b expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.799820:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 432 00010000:00010000:2.0:1790771166.799827:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.799828:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (557056->561151) req@ffff8bfb03d92d80 x1877759533973376/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771166.799849:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0e27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f4b expref: 136 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.799852:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d92d80 with x1877759533973376 ext(557056->561151) 00010000:00010000:2.0:1790771166.799856:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 105 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.799860:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d92d80 00010000:00010000:2.0:1790771166.799880:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 136 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.799885:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0e27a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f4b expref: 136 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.799902:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.799910:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.799912:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 5/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.799914:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.799918:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595400, rc 0) 00010000:00010000:2.0:1790771166.799944:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 136 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.799951:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14667:x1877759533956864:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 167us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.799952:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972352 00000100:00100000:0.0:1790771166.799959:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972352 00000100:00100000:1.0:1790771166.799959:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.799971:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6269 00010000:00010000:2.0:1790771166.799972:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 136 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.799983:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 23 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.799990:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539767168:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.799995:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6270 00000100:00100000:3.0:1790771166.800006:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14803:x1877759533956992:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:0.0:1790771166.800013:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972992 00010000:00010000:3.0:1790771166.800013:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.800018:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972992 00010000:00010000:3.0:1790771166.800028:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0e288 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f52 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800033:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 109 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.800050:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.800062:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 106 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.800073:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974144 00010000:00010000:2.0:1790771166.800076:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 106 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.800078:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974144 00000100:00100000:0.0:1790771166.800079:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1728 00000100:00100000:0.0:1790771166.800092:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2398:x1877759533972352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.800098:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 137 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800099:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539767296:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.800101:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.800105:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0e288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f52 expref: 137 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800121:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 23 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800131:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0e288 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f52 expref: 137 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800134:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1af8d540 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.800151:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.800153:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1729 00010000:00010000:3.0:1790771166.800157:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.800158:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 23 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800161:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594400, rc 0) 00000100:00100000:1.0:1790771166.800168:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2398:x1877759533972992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.800175:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1730 00010000:00010000:1.0:1790771166.800181:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.800184:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071b992f7/0xfa0c505d97f07402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e33adf expref: 23 pid: 13787 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800190:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 109 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800194:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14803:x1877759533956992:12345-192.168.204.50@tcp:101:cp.0 Request processed in 185us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.800195:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2398:x1877759533974144:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.800211:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=1s v=(2 0) 00000100:00100000:3.0:1790771166.800215:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6270 00010000:00010000:2.0:1790771166.800217:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.800218:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 109 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800220:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1790771166.800230:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 136 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800234:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fe5 expref: 20 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800236:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6271 00010000:00010000:1.0:1790771166.800241:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0dfa2 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e56 expref: 109 pid: 13771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800252:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:12253:x1877759533954816:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.800266:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 136 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800267:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.800270:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fe5 expref: 20 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800270:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771166.800276:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e28f lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f21 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800278:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800303:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800307:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e9c expref: 136 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800315:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.800319:0:7434:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006dac831b/0xfa0c505d97f0e06d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fe5 expref: 20 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800333:0:7434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539767424:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771166.800333:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:3.0:1790771166.800334:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.800340:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2398:x1877759533972992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (384us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.800345:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.800360:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1729 00010000:00010000:3.0:1790771166.800360:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800367:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800368:0:7434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef480 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.800373:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800384:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.800397:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.800401:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.800411:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800413:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.800416:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.800428:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800434:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e28f lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f21 expref: 137 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800437:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800448:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2398:x1877759533974144:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 258us (399us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.800457:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f21 expref: 136 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800466:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1730 00000100:00100000:1.0:1790771166.800469:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.800476:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:3.0:1790771166.800479:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.800481:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594000, rc 0) 00000001:00080000:0.0:1790771166.800512:0:6494:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969390 00000100:00100000:2.0:1790771166.800525:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974400 00000100:00100000:1.0:1790771166.800527:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972480 00000100:00100000:3.0:1790771166.800529:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:12253:x1877759533954816:12345-192.168.204.50@tcp:101:ls.0 Request processed in 281us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.800532:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974400 00000100:00100000:1.0:1790771166.800534:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972480 00000004:00010000:0.0:1790771166.800536:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005918a03a reply state 00000000ab0344b0 transno 4294969395 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800542:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6271 00010000:00010000:0.0:1790771166.800552:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800559:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771166.800562:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.800562:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 136 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800566:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.800582:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 843 00000100:00100000:3.0:1790771166.800588:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.800597:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2398:x1877759533974400:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.800607:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974016 00010000:00010000:2.0:1790771166.800609:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.800612:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974016 00010000:00010000:2.0:1790771166.800629:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e123 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35efe expref: 137 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800631:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+108:11335:x1877759533968384:12345-192.168.204.50@tcp:36:dir_create.sh.0 Request processed in 81023us (81190us total) trans 4294969395 rc 0/0 00010000:00010000:1.0:1790771166.800637:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 137 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800638:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.800668:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6242 00010000:00010000:2.0:1790771166.800675:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00000020:00080000:0.0:1790771166.800678:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.800682:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.800693:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974272 00000100:00100000:3.0:1790771166.800693:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.800700:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974272 00000100:00100000:2.0:1790771166.800709:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2398:x1877759533974400:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.800715:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1731 00010000:00010000:1.0:1790771166.800721:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 108 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800731:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 843 00000100:00100000:0.0:1790771166.800732:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2398:x1877759533972480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.800737:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.800748:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.800754:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.800763:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1732 00010000:00010000:0.0:1790771166.800770:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800771:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533977984 00000100:00100000:1.0:1790771166.800776:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1733 00000100:00100000:2.0:1790771166.800778:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2398:x1877759533974016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.800779:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533977984 00000100:00100000:1.0:1790771166.800792:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2398:x1877759533974272:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.800796:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.800797:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0dcca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d76 expref: 135 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800804:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.800809:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 134 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800812:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533978112 00010000:00010000:0.0:1790771166.800813:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771166.800813:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 108 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800819:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533978112 00010000:00010000:0.0:1790771166.800823:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800841:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 108 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800843:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800847:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 134 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800854:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6272 00010000:00010000:0.0:1790771166.800869:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800873:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e097 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35eb1 expref: 108 pid: 13774 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.800874:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14616:x1877759533977984:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:2.0:1790771166.800884:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0c921 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e357e2 expref: 134 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.800897:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.800902:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800903:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.800906:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771166.800911:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.800913:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800915:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800926:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2398:x1877759533972480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 197us (461us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.800930:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800931:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0df0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f28 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800941:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.800946:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1731 00010000:00010000:2.0:1790771166.800960:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.800963:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.800968:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.800971:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.800974:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.800984:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.800991:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.800992:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2398:x1877759533974272:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 202us (359us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.800998:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801003:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1733 00010000:00010000:3.0:1790771166.801015:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.801018:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533974016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 244us (427us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.801032:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.801036:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1732 00010000:00010000:0.0:1790771166.801046:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801053:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801059:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801064:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.801068:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 132 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801069:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.801079:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801091:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801098:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 132 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801101:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801106:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:0.0:1790771166.801114:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771166.801120:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.801122:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801137:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e0b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.801138:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539767552:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.801153:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.801185:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14629:x1877759533966080:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 92039us (92671us total) trans 0 rc -61/-61 00000100:00100000:3.0:1790771166.801185:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e89840 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.801197:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6236 00000004:00010000:2.0:1790771166.801205:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002a12aa9b reply state 00000000bda256f0 transno 4294969396 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801206:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.801209:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533978368 00000100:00100000:3.0:1790771166.801214:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533978368 00000100:00100000:0.0:1790771166.801216:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533957248 00000100:00100000:0.0:1790771166.801221:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533957248 00010000:00010000:2.0:1790771166.801223:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801227:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533978880 00000100:00100000:1.0:1790771166.801233:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533978880 00010000:00010000:2.0:1790771166.801237:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:2.0:1790771166.801241:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.801244:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.801249:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6273 00000100:00100000:0.0:1790771166.801259:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6274 00000100:00100000:1.0:1790771166.801263:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979008 00000100:00100000:3.0:1790771166.801264:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14978:x1877759533978112:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:1.0:1790771166.801267:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979008 00010000:00010000:3.0:1790771166.801274:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.801277:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:14948:x1877759533978368:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771166.801288:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801288:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e2a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36151 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801290:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.801297:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:15000:x1877759533967616:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 90430us (90508us total) trans 4294969396 rc 0/0 00010000:00010000:0.0:1790771166.801302:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e2ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36158 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801322:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1734 00000100:00100000:2.0:1790771166.801322:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6238 00010000:00010000:3.0:1790771166.801337:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801340:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2396:x1877759533979008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.801347:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0e2b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801348:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801355:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.801355:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6275 00010000:00010000:0.0:1790771166.801368:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801372:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801372:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.801375:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14595:x1877759533957248:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.801392:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801395:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.801400:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.801406:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x3:0x0]: returning size 1 00010000:00010000:1.0:1790771166.801406:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801413:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0e2c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f60 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801413:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.801419:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0e2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801433:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771166.801437:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801443:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801457:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e2ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36158 expref: 113 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801459:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0e2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f60 expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801462:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801482:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.801518:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cafe00/0xfa0c505d97f0e2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36158 expref: 112 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801518:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:2396:x1877759533979008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 182us (312us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.801524:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e2ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801527:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0e2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f60 expref: 134 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801537:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1734 00010000:00010000:0.0:1790771166.801546:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3:0x0].0x0 (ffff8bfc1ae7ff00) 00010000:00010000:3.0:1790771166.801549:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801555:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.801559:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 844 00010000:00010000:0.0:1790771166.801561:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cafe00, rc 0) 00000100:00100000:1.0:1790771166.801572:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2396:x1877759533978880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.801573:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.801575:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.801585:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.801588:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.801590:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e200, rc 0) 00000100:00100000:0.0:1790771166.801595:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14948:x1877759533978368:12345-192.168.204.50@tcp:101:chown.0 Request processed in 321us (519us total) trans 0 rc 0/0 00000004:00200000:3.0:1790771166.801598:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.801603:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e13f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f05 expref: 134 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.801604:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.801613:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6274 00000004:00010000:3.0:1790771166.801617:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e2ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.801621:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00000100:00100000:2.0:1790771166.801625:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14595:x1877759533957248:12345-192.168.204.50@tcp:101:ln.0 Request processed in 251us (505us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.801628:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.801642:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6275 00010000:00010000:3.0:1790771166.801642:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801649:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759533978880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (494us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.801665:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801671:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801682:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.801683:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 844 00010000:00010000:3.0:1790771166.801694:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801701:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801705:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.801709:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801714:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801724:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771166.801728:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.801732:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801739:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e2b2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.801749:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8ad00de reply state 00000000a4f8a7ad transno 4294968791 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801753:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801760:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801766:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.801769:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.801774:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771166.801779:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.801781:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801788:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.801794:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.801796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.801805:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.801810:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14808:x1877759533968640:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 80739us (80845us total) trans 4294968791 rc 0/0 00000100:00100000:0.0:1790771166.801824:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6243 00010000:00010000:3.0:1790771166.801829:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0xb62e0cbf (ffff8bfc10471f00) 00010000:00010000:3.0:1790771166.801834:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.801838:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.801851:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.801852:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e2c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.801864:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979264 00000100:00100000:0.0:1790771166.801868:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979264 00010000:00010000:3.0:1790771166.801899:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e2a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36151 expref: 113 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.801901:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1633 00000100:00100000:0.0:1790771166.801912:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:15045:x1877759533979264:12345-192.168.204.50@tcp:33:lfs.0 00010000:00010000:3.0:1790771166.801921:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80800/0xfa0c505d97f0e2ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36151 expref: 112 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.801928:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:3.0:1790771166.801931:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790771166.801934:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80800, rc 0) 00000100:00100000:2.0:1790771166.801941:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979136 00000004:00200000:0.0:1790771166.801946:0:13775:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.801947:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979136 00000004:00200000:0.0:1790771166.801949:0:13775:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.801962:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14978:x1877759533978112:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 704us (1234us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.801971:0:13761:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from blocking AST (req@0000000093964c5e x1877759539763840) - normal race ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 1/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.801972:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6273 00000100:00100000:0.0:1790771166.801985:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+111:15045:x1877759533979264:12345-192.168.204.50@tcp:33:lfs.0 Request processed in 72us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.801991:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6276 00000100:00100000:2.0:1790771166.802008:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:15040:x1877759533979136:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.802009:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e14d lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ebf expref: 107 pid: 13768 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.802010:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1633 00010000:00010000:2.0:1790771166.802028:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.802030:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539763840:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.802044:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e2d5 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36174 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802081:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0e2dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802090:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0e2dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802100:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0e2dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.802125:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000400:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.802129:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1790771166.802153:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e2d5 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36174 expref: 108 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802168:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668600/0xfa0c505d97f0e2dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36174 expref: 107 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802177:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x4:0x0].0x0 (ffff8bfc0786e700) 00010000:00010000:2.0:1790771166.802180:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.802183:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668600, rc 0) 00000100:00100000:2.0:1790771166.802218:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:15040:x1877759533979136:12345-192.168.204.50@tcp:101:cp.0 Request processed in 215us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.802225:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6276 00000100:00100000:2.0:1790771166.802307:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.802339:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979648 00000100:00100000:2.0:1790771166.802343:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.802345:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979648 00000100:00100000:0.0:1790771166.802371:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1634 00000100:00100000:0.0:1790771166.802380:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11375450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13742:x1877759533979648:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771166.802384:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533978624 00000100:00100000:2.0:1790771166.802390:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.802391:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533978624 00000100:00100000:3.0:1790771166.802421:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533979904 00000100:00100000:1.0:1790771166.802426:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6277 00000100:00100000:3.0:1790771166.802427:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533979904 00000100:00100000:1.0:1790771166.802436:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14757:x1877759533978624:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.802446:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.802457:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0e2e3 lrc: 2/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36166 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.802464:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1022 00000100:00100000:3.0:1790771166.802473:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533979904:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:1.0:1790771166.802476:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.802515:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539764608:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.802521:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.802530:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802538:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.802546:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533979904:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.802560:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1022 00000100:00100000:2.0:1790771166.802594:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.802616:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980032 00000100:00100000:3.0:1790771166.802620:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980032 00010000:00010000:1.0:1790771166.802622:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0e2e3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 110 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.802641:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 110 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.802642:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 110 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.802680:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771166.802683:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771166.802686:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5a00, rc 0) 00000100:00100000:2.0:1790771166.802695:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.802714:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14757:x1877759533978624:12345-192.168.204.50@tcp:101:cp.0 Request processed in 281us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.802720:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980160 00000100:00100000:1.0:1790771166.802721:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6277 00000100:00100000:2.0:1790771166.802727:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980160 00010000:00010000:2.0:1790771166.802748:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.802753:0:13761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0001_UUID:13761:1877759539763968:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.802772:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771166.802776:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.802782:0:13761:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.802789:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1735 00010000:00010000:1.0:1790771166.802792:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.802803:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2399:x1877759533980032:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.802813:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.802819:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 109 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.802823:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1736 00010000:00010000:2.0:1790771166.802842:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 109 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.802843:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759533980160:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.802860:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.802861:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.802871:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802875:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0b6c8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3522b expref: 109 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.802889:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.802906:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771166.802906:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802915:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.802922:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959680 00000100:00100000:0.0:1790771166.802926:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959680 00010000:00010000:2.0:1790771166.802926:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.802931:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005adb87ab/0xfa0c505d97f047cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e32ac4 expref: 26 pid: 13788 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.802947:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.802948:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.802957:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6278 00010000:00010000:3.0:1790771166.802957:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=1s v=(1 1) 00010000:00010000:3.0:1790771166.802965:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(1 1) 00010000:00010000:3.0:1790771166.802969:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.802970:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14622:x1877759533959680:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771166.802981:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.802985:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.802986:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.802988:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.802998:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e2f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f7c expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.803011:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.803016:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f7c expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803023:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2399:x1877759533980032:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.803026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.803041:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f7c expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803044:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1735 00000100:00100000:3.0:1790771166.803044:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759533980160:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 204us (345us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.803059:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.803063:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.803067:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1736 00010000:00010000:0.0:1790771166.803068:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84400, rc 0) 00000100:00100000:1.0:1790771166.803071:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.803071:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980288 00000100:00100000:2.0:1790771166.803078:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980288 00000100:00100000:0.0:1790771166.803094:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14622:x1877759533959680:12345-192.168.204.50@tcp:101:ln.0 Request processed in 126us (210us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.803100:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803105:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6278 00010000:00010000:2.0:1790771166.803105:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.803118:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803127:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980544 00000100:00100000:0.0:1790771166.803135:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980544 00010000:00010000:3.0:1790771166.803138:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.803147:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.803156:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.803169:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1737 00010000:00010000:3.0:1790771166.803169:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771166.803177:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.803184:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803185:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980672 00000100:00100000:2.0:1790771166.803186:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533980288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.803190:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980672 00010000:00010000:1.0:1790771166.803200:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.803203:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.803205:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803213:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803217:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980800 00000100:00100000:0.0:1790771166.803222:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980800 00010000:00010000:2.0:1790771166.803222:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803223:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803238:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981056 00000100:00100000:0.0:1790771166.803244:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981056 00010000:00010000:1.0:1790771166.803245:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6522c3/0xfa0c505d97f0e177 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803254:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803272:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771166.803273:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981184 00010000:00010000:1.0:1790771166.803276:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.803276:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(4 0) 00000100:00100000:0.0:1790771166.803278:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981184 00010000:00010000:1.0:1790771166.803280:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.803287:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(4 0) 00010000:00010000:2.0:1790771166.803295:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803306:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803317:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6279 00000100:00100000:3.0:1790771166.803329:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:3625:x1877759539764096:12345-0@lo:6:osp-syn-0-1.0 Request processed in 67610us (68004us total) trans 4294967620 rc 0/0 00000100:00100000:0.0:1790771166.803331:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:13263:x1877759533980544:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.803337:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6280 00010000:00010000:2.0:1790771166.803338:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.803347:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00010000:00010000:0.0:1790771166.803350:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.803355:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:13266:x1877759533980672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.803362:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e2f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36182 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803365:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.803365:0:13783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803377:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0e2ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36189 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.803386:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05c35c00/2, rc 0, transno 4294967620 00010000:00010000:0.0:1790771166.803387:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36182 expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.803396:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539764096:0@lo:6:osp-syn-0-1.0 00010000:00010000:1.0:1790771166.803419:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0e2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36189 expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803420:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539767680:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.803425:0:13786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f52c360/0xfa0c505d97f0bf42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3540e expref: 24 pid: 12031 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.803449:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:13786:1877759539764736:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.803457:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8e00/0xfa0c505d97f0e2f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36182 expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803460:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5400/0xfa0c505d97f0e2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36189 expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.803468:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771166.803472:0:13786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803473:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c540 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.803475:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.803479:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8e00, rc 0) 00010000:00010000:1.0:1790771166.803515:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00000100:00100000:0.0:1790771166.803521:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13263:x1877759533980544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 195us (576us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.803524:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.803529:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5400, rc 0) 00010000:00010000:3.0:1790771166.803536:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 24 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803537:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6281 00000100:00100000:0.0:1790771166.803548:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6279 00010000:00010000:3.0:1790771166.803551:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:2.0:1790771166.803557:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13271:x1877759533980800:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.803568:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6282 00000100:00100000:1.0:1790771166.803568:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13266:x1877759533980672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 215us (589us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.803572:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.803582:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13261:x1877759533981056:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.803582:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:14822:x1877759533969664:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 67324us (67454us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.803584:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6280 00010000:00010000:2.0:1790771166.803587:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe000/0xfa0c505d97f0e306 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36190 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.803597:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.803602:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1018 00010000:00010000:0.0:1790771166.803610:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0e30d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3619e expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.803619:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6283 00010000:00010000:2.0:1790771166.803623:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe000/0xfa0c505d97f0e306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36190 expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.803638:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13264:x1877759533981184:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.803639:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0e30d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3619e expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803674:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.803677:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a800/0xfa0c505d97f0e30d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3619e expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803678:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe000/0xfa0c505d97f0e306 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36190 expref: 117 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.803692:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0e314 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361a5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.803696:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:0.0:1790771166.803702:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.803706:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a800, rc 0) 00010000:00010000:2.0:1790771166.803707:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771166.803715:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.803720:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35ffe000, rc 0) 00000100:00100000:0.0:1790771166.803727:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:13261:x1877759533981056:12345-192.168.204.50@tcp:101:ls.0 Request processed in 152us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.803735:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6282 00010000:00010000:1.0:1790771166.803738:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0e314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361a5 expref: 118 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.803752:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13271:x1877759533980800:12345-192.168.204.50@tcp:101:ls.0 Request processed in 201us (730us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.803760:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4600/0xfa0c505d97f0e314 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361a5 expref: 117 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.803764:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539764992:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.803767:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6281 00000100:00100000:0.0:1790771166.803780:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056ce680 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539765120:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.803782:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:1.0:1790771166.803788:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.803792:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4600, rc 0) 00010000:00010000:2.0:1790771166.803805:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803816:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.803826:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:13264:x1877759533981184:12345-192.168.204.50@tcp:101:ls.0 Request processed in 191us (665us total) trans 0 rc 0/0 00000004:00200000:2.0:1790771166.803840:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 4360 00000100:00100000:1.0:1790771166.803842:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6283 00000100:00100000:3.0:1790771166.803877:0:13768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cd880 pname:cluuid:pid:xid:nid:opc:job mdt00_013:lustre-MDT0001_UUID:13768:1877759539765376:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.803878:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.803908:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533980416 00000100:00100000:1.0:1790771166.803915:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533980416 00010000:00010000:3.0:1790771166.803917:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803922:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e169 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 110 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803943:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 109 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.803952:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771166.803956:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.803959:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597e00, rc 0) 00000100:00100000:1.0:1790771166.803975:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 845 00000100:00100000:2.0:1790771166.803986:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14785:x1877759533957504:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 69114us (69219us total) trans 4294968792 rc 0/0 00000100:00100000:1.0:1790771166.803992:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2398:x1877759533980416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.804002:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6250 00010000:00010000:1.0:1790771166.804006:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.804024:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e18c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f0c expref: 133 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.804040:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:1.0:1790771166.804044:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.804056:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765248:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.804073:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765504:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.804084:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2398:x1877759533980416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.804095:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa97480 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765632:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.804096:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 845 00000100:00100000:2.0:1790771166.804120:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05ee2300 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765760:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.825242:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.825297:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533985536 00000100:00100000:3.0:1790771166.825304:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.825307:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533985536 00000100:00100000:0.0:1790771166.825324:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.825354:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.825374:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981952 00000100:00100000:1.0:1790771166.825379:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981952 00000100:00100000:0.0:1790771166.825383:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.825395:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533985792 00010000:00010000:1.0:1790771166.825401:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 109 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.825403:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533985792 00000100:00100000:3.0:1790771166.825410:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982208 00000100:00100000:0.0:1790771166.825416:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.825417:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982208 00000100:00100000:1.0:1790771166.825438:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982592 00010000:00010000:3.0:1790771166.825440:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 72 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825442:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982592 00000100:00100000:0.0:1790771166.825449:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.825459:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6284 00010000:00010000:1.0:1790771166.825460:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 73 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.825481:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.825511:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:14075:x1877759533985536:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.825513:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982720 00000100:00100000:1.0:1790771166.825518:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982720 00010000:00010000:1.0:1790771166.825536:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 74 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.825539:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.825541:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982080 00000100:00100000:3.0:1790771166.825547:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982080 00000100:00100000:0.0:1790771166.825553:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.825557:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1738 00010000:00010000:2.0:1790771166.825562:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e322 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361c8 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.825569:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 75 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825570:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2398:x1877759533981952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.825580:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.825590:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.825597:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 110 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825609:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 110 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825625:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ddfe lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ee2 expref: 110 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825648:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.825665:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825667:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.825672:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982464 00000100:00100000:3.0:1790771166.825679:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982464 00010000:00010000:1.0:1790771166.825689:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.825694:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825696:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.825704:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 110 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.825711:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.825734:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825740:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2398:x1877759533981952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 174us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.825749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.825752:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825757:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1738 00010000:00010000:2.0:1790771166.825769:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.825775:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533983360 00000100:00100000:1.0:1790771166.825776:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982336 00000100:00100000:0.0:1790771166.825779:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533983360 00000100:00100000:1.0:1790771166.825781:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982336 00010000:00010000:1.0:1790771166.825799:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 77 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.825814:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6285 00000100:00100000:1.0:1790771166.825819:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1739 00000100:00100000:0.0:1790771166.825829:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:11438:x1877759533985792:12345-192.168.204.50@tcp:101:dir_create.sh.0 00000100:00100000:1.0:1790771166.825832:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:2398:x1877759533982208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.825842:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.825845:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.825845:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1740 00010000:00010000:1.0:1790771166.825856:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 77 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.825858:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e337 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360a9 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.825864:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:2398:x1877759533982592:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00200000:2.0:1790771166.825869:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.825880:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 77 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825891:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e066 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36078 expref: 77 pid: 6494 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825900:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.825904:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825911:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.825916:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.825920:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,1 mode: --/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.825934:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.825936:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.825937:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+77:2398:x1877759533982208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.825948:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 77 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.825950:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825954:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1739 00010000:00010000:2.0:1790771166.825959:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825973:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1741 00010000:00010000:0.0:1790771166.825976:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.825988:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+76:2397:x1877759533982720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.825988:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.825995:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 76 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.825996:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826005:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.826016:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826018:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826018:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 76 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826041:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826054:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.826060:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826081:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826084:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 76 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826104:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.826109:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.826113:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826120:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e329 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826134:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826142:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826149:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826150:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0b82d lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35255 expref: 76 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826154:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0b826 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3524e expref: 76 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826164:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.826169:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826170:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.826177:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826183:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826185:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826207:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.826220:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc0786e900) 00010000:00010000:3.0:1790771166.826220:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.826228:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826230:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+74:2397:x1877759533982720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 243us (782us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.826230:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.826237:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826240:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1741 00010000:00010000:2.0:1790771166.826250:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e330 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826259:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1742 00000100:00100000:1.0:1790771166.826268:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+73:2398:x1877759533982080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.826279:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.826281:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826287:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 73 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826291:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.826297:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e322 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361c8 expref: 73 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826308:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 73 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826313:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.826318:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.826322:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0ddf0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35edb expref: 73 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.826324:0:13765:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x19:0x0], index 0: 0 00010000:00010000:2.0:1790771166.826327:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e322 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361c8 expref: 73 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826344:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.826349:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826351:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8800, rc 0) 00000100:00100000:3.0:1790771166.826358:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2398:x1877759533982592:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 498us (971us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.826360:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826370:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.826371:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1740 00000100:00100000:2.0:1790771166.826392:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14075:x1877759533985536:12345-192.168.204.50@tcp:101:ls.0 Request processed in 917us (1153us total) trans 4294968793 rc 301/301 00000100:00100000:3.0:1790771166.826394:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1743 00000100:00100000:1.0:1790771166.826397:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2398:x1877759533982080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 128us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.826410:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2397:x1877759533982464:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771166.826418:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1742 00000100:00100000:2.0:1790771166.826419:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6284 00010000:00010000:3.0:1790771166.826423:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.826430:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0e353 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826431:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 112 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826440:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1744 00000100:00100000:2.0:1790771166.826450:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6286 00010000:00010000:0.0:1790771166.826454:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0e353 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826455:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2398:x1877759533982336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.826458:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 112 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.826469:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14731:x1877759533983360:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771166.826472:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.826475:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0e353 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826504:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 68 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826513:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0d2c8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a89 expref: 112 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826525:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 68 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826528:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.826529:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826537:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826553:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826554:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826560:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826566:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f09a19 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34765 expref: 68 pid: 12128 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826573:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.826583:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.826585:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826594:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.826596:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.826599:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826605:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.826607:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2397:x1877759533982464:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (1054us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.826621:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826627:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.826627:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.826629:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1743 00010000:00010000:0.0:1790771166.826642:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x0 (ffff8bfc3600d300) 00010000:00010000:0.0:1790771166.826649:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.826650:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826669:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 2/0,0 mode: --/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826675:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e345 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.826686:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e07d397a reply state 00000000f6835f5b transno 4294968794 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.826687:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.826697:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.826699:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981568 00000100:00100000:3.0:1790771166.826705:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981568 00010000:00010000:0.0:1790771166.826706:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x510a92c1 (ffff8bfc3607ac00) 00000100:00100000:1.0:1790771166.826710:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:2398:x1877759533982336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 257us (1135us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.826711:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.826715:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.826720:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1744 00002000:00010000:3.0:1790771166.826733:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/38 (9633792->18446744073709551615) 00010000:00010000:0.0:1790771166.826738:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e337 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a9 expref: 111 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.826740:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cea00 with x1877759533981568 ext(9633792->18446744073709551615) 00010000:00010000:0.0:1790771166.826756:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b200/0xfa0c505d97f0e353 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a9 expref: 110 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.826756:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb056cea00. 00010000:00010000:0.0:1790771166.826766:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xab:0x0].0x0 (ffff8bfc3607a600) 00010000:00010000:0.0:1790771166.826768:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.826770:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b200, rc 0) 00000100:00100000:3.0:1790771166.826789:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 433 00000100:00100000:0.0:1790771166.826795:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:11438:x1877759533985792:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 970us (1492us total) trans 4294968794 rc 0/0 00000100:00100000:3.0:1790771166.826802:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759533981568:12345-192.168.204.50@tcp:10:dd.0 00000100:00100000:0.0:1790771166.826806:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6285 00000100:00100000:1.0:1790771166.826847:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.826867:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533959808 00000100:00100000:0.0:1790771166.826874:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533959808 00000100:00100000:0.0:1790771166.826908:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6287 00000100:00100000:1.0:1790771166.826915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.826920:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14552:x1877759533959808:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771166.826929:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.826940:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0e368 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f83 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.826956:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.826960:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0e368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f83 expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826970:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0e368 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f83 expref: 133 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.826976:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.826979:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.826981:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b400, rc 0) 00000100:00100000:1.0:1790771166.826994:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:2.0:1790771166.827001:0:13773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 88 off10112 00000100:00100000:0.0:1790771166.827008:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14552:x1877759533959808:12345-192.168.204.50@tcp:101:rm.0 Request processed in 88us (159us total) trans 0 rc 0/0 00000004:00080000:2.0:1790771166.827014:0:13773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 167032527260ns, next at 168032523562ns, rc = 0 00000100:00100000:0.0:1790771166.827016:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6287 00000100:00100000:1.0:1790771166.827031:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.827032:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987840 00000100:00100000:0.0:1790771166.827036:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987840 00000100:00100000:1.0:1790771166.827047:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982848 00000100:00100000:1.0:1790771166.827052:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982848 00000004:00010000:2.0:1790771166.827065:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000010f48c11 reply state 00000000449f93d7 transno 4294968795 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827066:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6288 00010000:00010000:1.0:1790771166.827070:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 67 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827080:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14634:x1877759533987840:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:2.0:1790771166.827095:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827103:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.827105:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00000100:00100000:1.0:1790771166.827106:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533983104 00010000:00010000:2.0:1790771166.827112:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.827113:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533983104 00010000:00010000:0.0:1790771166.827115:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e36f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361dd expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.827117:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x26:0x0] updating lvb size from disk: 0 -> 9633792 00000100:00100000:2.0:1790771166.827118:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00002000:00010000:3.0:1790771166.827125:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x26:0x0] updating lvb mtime from disk: 0 -> 1790771166 00010000:00010000:1.0:1790771166.827128:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 68 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.827131:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x26:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.827138:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x26:0x0] updating lvb ctime from disk: 0 -> 1790771166 00002000:00010000:3.0:1790771166.827144:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x26:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771166.827157:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1745 00000100:00100000:1.0:1790771166.827164:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2399:x1877759533982848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.827174:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.827178:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14731:x1877759533983360:12345-192.168.204.50@tcp:36:chown.0 Request processed in 715us (1431us total) trans 4294968795 rc 0/0 00010000:00010000:1.0:1790771166.827181:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 68 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.827183:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2398:x1877759533981568:12345-192.168.204.50@tcp:10:dd.0 Request processed in 382us (1768us total) trans 4294967621 rc 0/0 00010000:00010000:0.0:1790771166.827199:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.827201:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6286 00000100:00100000:3.0:1790771166.827204:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 433 00010000:00010000:1.0:1790771166.827208:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 68 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.827211:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/38 (9633792->18446744073709551615) 00002000:00100000:3.0:1790771166.827218:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cea00 with x1877759533981568 ext(9633792->18446744073709551615) 00010000:00010000:0.0:1790771166.827224:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.827227:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb056cea00. 00010000:00010000:1.0:1790771166.827233:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.827236:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.827236:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990400 00010000:00010000:1.0:1790771166.827238:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.827244:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990400 00010000:00010000:1.0:1790771166.827257:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.827262:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1746 00010000:00010000:0.0:1790771166.827267:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.827269:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1790771166.827277:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e:0x0] (4194304->4196580) req@ffff8bfb06730380 x1877759533990400/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 2768/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.827279:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2399:x1877759533983104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.827286:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.827290:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2399:x1877759533982848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 124us (332us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.827293:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.827304:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 68 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827311:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.827314:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1745 00002000:00100000:2.0:1790771166.827319:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06730380 with x1877759533990400 ext(4194304->4196580) 00002000:00010000:2.0:1790771166.827330:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06730380 00010000:00010000:3.0:1790771166.827335:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 67 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827348:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.827352:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827358:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827361:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827365:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.827367:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 434 00010000:00010000:0.0:1790771166.827378:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.827386:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759533990400:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:1.0:1790771166.827390:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.827395:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.827395:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:2399:x1877759533983104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.827409:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533982976 00000100:00100000:3.0:1790771166.827413:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1746 00000100:00100000:1.0:1790771166.827415:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533982976 00010000:00010000:0.0:1790771166.827416:0:13767:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827425:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.827431:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 67 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827442:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827450:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.827460:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1747 00000100:00100000:1.0:1790771166.827469:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:2399:x1877759533982976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.827473:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06190a80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539765888:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.827479:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.827511:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06192680 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766144:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.827514:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 67 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827525:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193100 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766272:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.827527:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 67 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827537:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191880 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766400:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.827542:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0b818 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35247 expref: 67 pid: 13761 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827549:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0b658 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35224 expref: 67 pid: 13762 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.827555:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.827564:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.827571:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827572:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766528:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.827583:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.827588:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0b651 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3521d expref: 65 pid: 13769 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827596:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766656:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.827604:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:2399:x1877759533982976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 134us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.827613:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766784:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.827614:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1747 00000100:00100000:0.0:1790771166.827632:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001_UUID:13766:1877759539766912:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.827698:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.827714:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:3.0:1790771166.827714:0:13768:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968796 00000100:00100000:0.0:1790771166.827738:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533983488 00000100:00100000:0.0:1790771166.827743:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533983488 00000100:00100000:1.0:1790771166.827763:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.827780:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 846 00000100:00100000:0.0:1790771166.827789:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2399:x1877759533983488:12345-192.168.204.50@tcp:103:ln.0 00010000:00010000:0.0:1790771166.827796:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.827807:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0e0dd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f3d expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.827815:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:0.0:1790771166.827817:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:3.0:1790771166.827842:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000356231d2 reply state 000000005272a948 transno 4294968797 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.827844:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2399:x1877759533983488:12345-192.168.204.50@tcp:103:ln.0 Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.827852:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.827867:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 846 00010000:00010000:3.0:1790771166.827868:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.827880:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771166.827884:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.827888:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.827895:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.827899:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533983872 00000100:00100000:0.0:1790771166.827904:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533983872 00000100:00100000:0.0:1790771166.827928:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984512 00000100:00100000:0.0:1790771166.827933:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984512 00000100:00100000:1.0:1790771166.827933:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.827957:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984000 00000100:00100000:0.0:1790771166.827962:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1635 00000100:00100000:1.0:1790771166.827962:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984000 00000100:00100000:0.0:1790771166.827974:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14942:x1877759533983872:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:1.0:1790771166.827982:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 65 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.827991:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14601:x1877759533970688:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 89729us (89804us total) trans 4294968797 rc 0/0 00000100:00100000:3.0:1790771166.827998:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6253 00000100:00100000:1.0:1790771166.828009:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1748 00000100:00100000:1.0:1790771166.828017:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2399:x1877759533984000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.828024:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.828027:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 65 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828036:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 65 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.828040:0:13768:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.828049:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0b6c1 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35240 expref: 65 pid: 6495 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.828053:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533960960 00010000:00010000:1.0:1790771166.828059:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771166.828060:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533960960 00010000:00010000:1.0:1790771166.828065:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828071:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828075:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.828093:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:2399:x1877759533984000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.828100:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1636 00000100:00100000:2.0:1790771166.828105:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6289 00000100:00100000:0.0:1790771166.828110:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14942:x1877759533983872:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 134us (343us total) trans 4294969397 rc 0/0 00000100:00100000:3.0:1790771166.828115:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14076:x1877759533984512:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.828116:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1748 00000100:00100000:2.0:1790771166.828123:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13878:x1877759533960960:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:0.0:1790771166.828134:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1635 00010000:00010000:2.0:1790771166.828137:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.828153:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0e38b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f9f expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.828174:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.828214:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+64:14076:x1877759533984512:12345-192.168.204.50@tcp:35:ls.0 Request processed in 102us (365us total) trans 4294968798 rc 0/0 00010000:00010000:2.0:1790771166.828222:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0e392 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828223:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1636 00000100:00100000:1.0:1790771166.828228:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.828242:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0e392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828252:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984256 00010000:00010000:2.0:1790771166.828255:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0e392 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828257:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984256 00010000:00010000:3.0:1790771166.828273:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 64 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.828284:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.828299:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984896 00000100:00100000:3.0:1790771166.828303:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984896 00000100:00100000:1.0:1790771166.828308:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984128 00000100:00100000:1.0:1790771166.828312:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984128 00010000:00010000:1.0:1790771166.828328:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 65 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828336:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1749 00000100:00100000:3.0:1790771166.828347:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2399:x1877759533984256:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.828353:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0e38b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f9f expref: 136 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828354:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.828360:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1750 00000100:00100000:1.0:1790771166.828374:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:2399:x1877759533984128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.828382:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.828384:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.828384:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339c00/0xfa0c505d97f0e392 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f9f expref: 135 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828389:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 65 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828398:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.828408:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 65 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828413:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.828414:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771166.828418:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 65 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.828423:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771166.828430:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05339c00, rc 0) 00000100:00100000:0.0:1790771166.828434:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533983232 00010000:00010000:3.0:1790771166.828438:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 65 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828439:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533983232 00010000:00010000:1.0:1790771166.828456:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0b6b3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35232 expref: 65 pid: 13772 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828462:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0b69e lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35239 expref: 65 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828473:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771166.828474:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13878:x1877759533960960:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 355us (576us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.828478:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828481:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1023 00010000:00010000:1.0:1790771166.828512:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.828524:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6289 00000100:00100000:0.0:1790771166.828530:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759533983232:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.828535:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.828536:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.828539:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.828541:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828548:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.828551:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000552214aa/0xfa0c505d97f0e399 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361ba expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828553:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.828559:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:2399:x1877759533984128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 185us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.828569:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1750 00000100:00100000:3.0:1790771166.828580:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:2399:x1877759533984256:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 235us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.828582:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984640 00000100:00100000:1.0:1790771166.828588:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984640 00000100:00100000:3.0:1790771166.828593:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1749 00000100:00100000:0.0:1790771166.828600:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539767808:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.828605:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 62 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.828621:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533985024 00000100:00100000:1.0:1790771166.828624:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533985024 00010000:00010000:1.0:1790771166.828636:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 113 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828641:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1751 00000100:00100000:3.0:1790771166.828669:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+62:2399:x1877759533984640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.828672:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05fffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.828677:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1752 00010000:00010000:3.0:1790771166.828682:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.828688:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2399:x1877759533985024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.828695:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 62 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828698:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.828706:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 113 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828713:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 62 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828723:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.828726:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 847 00010000:00010000:1.0:1790771166.828735:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 113 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.828744:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2399:x1877759533984896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.828745:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533985664 00000100:00100000:0.0:1790771166.828751:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533985664 00010000:00010000:3.0:1790771166.828756:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0b64a lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35216 expref: 62 pid: 7771 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828758:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f08781 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e340b9 expref: 114 pid: 13773 timeout: 266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.828762:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.828780:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6290 00010000:00010000:2.0:1790771166.828783:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e1b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f13 expref: 134 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828788:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771166.828793:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:15041:x1877759533985664:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771166.828796:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.828808:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:1.0:1790771166.828813:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.828815:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.828821:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.828829:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.828835:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.828838:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828844:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.828845:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2399:x1877759533984896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (620us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.828862:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 61 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.828867:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 847 00000100:00100000:3.0:1790771166.828869:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+61:2399:x1877759533984640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 212us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.828870:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2399:x1877759533985024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.828891:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1752 00010000:00010000:0.0:1790771166.828893:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 61 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.828902:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1751 00010000:00010000:0.0:1790771166.828904:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 112 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.828911:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 6/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828925:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.828931:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 112 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.828933:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.828950:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 112 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.828960:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539767936:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.828992:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 60 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829000:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 61 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.829011:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539768064:192.168.204.50@tcp:104: 00000001:00080000:1.0:1790771166.829019:0:13766:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968799 00010000:00010000:0.0:1790771166.829035:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 62 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.829044:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000096ed99bb reply state 00000000082dc051 transno 4294968800 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829045:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 62 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.829069:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.829071:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539768192:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.829083:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.829086:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771166.829088:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.829104:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.829109:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056ce300 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539767040:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.829127:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:15036:x1877759533970048:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 90925us (91030us total) trans 4294968800 rc 0/0 00010000:00010000:3.0:1790771166.829133:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.829136:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6252 00000020:00080000:1.0:1790771166.829142:0:13766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.829211:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.829251:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533985920 00000100:00100000:2.0:1790771166.829252:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.829259:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533985920 00000100:00100000:0.0:1790771166.829298:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1024 00000100:00100000:0.0:1790771166.829304:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:14987:x1877759533985920:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771166.829311:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.829320:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361cf expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829334:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(4 0) 00000100:00100000:1.0:1790771166.829338:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986048 00010000:00010000:0.0:1790771166.829342:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 24 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771166.829342:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967627 is committed 00000100:00100000:1.0:1790771166.829343:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986048 00010000:00010000:0.0:1790771166.829353:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x16:0x0].0x0 since=0s v=(5 0) 00010000:00010000:0.0:1790771166.829360:0:8406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [24576->57343] (req 24576->57343) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361cf expref: 27 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.829364:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.829374:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1637 00000100:00100000:1.0:1790771166.829385:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13260:x1877759533986048:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.829399:0:8406:0:(ldlm_lockd.c:949:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 24 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.829410:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.829419:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [24576->57343] (req 24576->57343) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361cf expref: 27 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829428:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996a00, rc 0) 00000100:00100000:2.0:1790771166.829447:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.829452:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:14987:x1877759533985920:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 147us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.829459:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1024 00000100:00100000:3.0:1790771166.829504:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759533990400:12345-192.168.204.50@tcp:4:cat.0 Request processed in 2103us (2570us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1790771166.829512:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 434 00000100:00100000:0.0:1790771166.829514:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986176 00002000:00100000:3.0:1790771166.829520:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e:0x0] (4194304->4196580) req@ffff8bfb06730380 x1877759533990400/t4294967627(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 2768/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.829521:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986176 00000100:00100000:2.0:1790771166.829533:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:3.0:1790771166.829536:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06730380 with x1877759533990400 ext(4194304->4196580) 00002000:00010000:3.0:1790771166.829540:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06730380 00000100:00100000:0.0:1790771166.829561:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986304 00000100:00100000:2.0:1790771166.829561:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986432 00000100:00100000:0.0:1790771166.829568:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986304 00000100:00100000:2.0:1790771166.829569:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986432 00010000:00010000:2.0:1790771166.829593:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 115 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.829597:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981312 00000100:00100000:0.0:1790771166.829604:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981312 00000100:00100000:3.0:1790771166.829605:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.829636:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1753 00000100:00100000:0.0:1790771166.829639:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986688 00000100:00100000:0.0:1790771166.829644:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986688 00000100:00100000:2.0:1790771166.829650:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2399:x1877759533986432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.829677:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.829683:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 115 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.829696:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6291 00010000:00010000:2.0:1790771166.829699:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 115 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829708:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.829711:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13736:x1877759533986176:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.829728:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.829734:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e234 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f8a expref: 115 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829742:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e3ae lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361d6 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829744:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.829762:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.829768:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.829777:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.829786:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.829794:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 4/0,1 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829798:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829805:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.829806:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829826:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981824 00010000:00010000:2.0:1790771166.829827:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829833:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981824 00010000:00010000:0.0:1790771166.829843:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.829855:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.829863:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987072 00010000:00010000:2.0:1790771166.829865:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.829869:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987072 00000100:00100000:2.0:1790771166.829895:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2399:x1877759533986432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 249us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.829904:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1753 00000100:00100000:3.0:1790771166.829910:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6292 00000100:00100000:3.0:1790771166.829920:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14755:x1877759533986304:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:1.0:1790771166.829929:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533986944 00000100:00100000:1.0:1790771166.829934:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533986944 00010000:00010000:3.0:1790771166.829942:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.829953:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539767168:192.168.204.50@tcp:104: 00002000:00100000:1.0:1790771166.829955:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (561152->565247) req@ffff8bfb06732680 x1877759533986944/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771166.829957:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0db96 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xa6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf8 expref: 115 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771166.829978:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06732680 with x1877759533986944 ext(561152->565247) 00010000:00010000:3.0:1790771166.829982:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc3607a100) 00002000:00010000:1.0:1790771166.829983:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06732680 00000100:00100000:2.0:1790771166.829991:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6293 00010000:00010000:3.0:1790771166.829997:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.830004:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13265:x1877759533981312:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.830010:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 435 00010000:00010000:2.0:1790771166.830015:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.830020:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759533986944:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771166.830031:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0e3c3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361ac expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830031:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 3/0,1 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830054:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830068:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.830069:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361ac expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830095:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830097:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759533986944:12345-192.168.204.50@tcp:3:cat.0 Request processed in 77us (357us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.830098:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b400/0xfa0c505d97f0e3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361ac expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830113:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830117:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 435 00010000:00010000:2.0:1790771166.830120:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00002000:00100000:1.0:1790771166.830128:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (561152->565247) req@ffff8bfb06732680 x1877759533986944/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.830129:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.830130:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.830136:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b400, rc 0) 00002000:00100000:1.0:1790771166.830150:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06732680 with x1877759533986944 ext(561152->565247) 00002000:00010000:1.0:1790771166.830154:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06732680 00000100:00100000:2.0:1790771166.830167:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13265:x1877759533981312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 164us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.830177:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6293 00000100:00100000:1.0:1790771166.830184:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6294 00000100:00100000:1.0:1790771166.830192:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14406:x1877759533986688:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:2.0:1790771166.830205:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6295 00000100:00100000:2.0:1790771166.830217:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13978:x1877759533981824:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:2.0:1790771166.830227:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.830237:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0e3d1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361b3 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830252:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14406:x1877759533986688:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 60us (650us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771166.830259:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830263:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6294 00010000:00010000:2.0:1790771166.830276:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830284:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6296 00010000:00010000:2.0:1790771166.830287:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830296:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14813:x1877759533987072:12345-192.168.204.50@tcp:36:chown.0 00000004:00200000:3.0:1790771166.830302:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xac:0x0]: returning size 2 00010000:00010000:3.0:1790771166.830309:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830315:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790771166.830316:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830321:0:13771:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0e0c8) 00010000:00010000:3.0:1790771166.830324:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830325:0:13771:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie fa0c505d97f0e04a) 00010000:00010000:3.0:1790771166.830333:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830339:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0dbea lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x19/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d06 expref: 116 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830340:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.830346:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830355:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830363:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ad9f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dc4 expref: 115 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830366:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc10471f00) 00010000:00010000:3.0:1790771166.830372:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.830376:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 3/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830378:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.830379:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0e3d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 115 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830386:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.830388:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0e3bc lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.830418:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070f39171 reply state 00000000f50bc169 transno 4294968801 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830419:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.830420:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830443:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830455:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.830457:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11375450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13742:x1877759533979648:12345-192.168.204.50@tcp:37:ls.0 Request processed in 28077us (28147us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.830460:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.830461:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.830471:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771166.830476:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0xcdd6ff3 (ffff8bfc10471100) 00010000:00010000:2.0:1790771166.830477:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00000100:00100000:0.0:1790771166.830478:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1634 00010000:00010000:3.0:1790771166.830482:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.830524:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771166.830538:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13978:x1877759533981824:12345-192.168.204.50@tcp:101:dd.0 Request processed in 323us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.830547:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6295 00000100:00100000:3.0:1790771166.830556:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14755:x1877759533986304:12345-192.168.204.50@tcp:36:ln.0 Request processed in 637us (1151us total) trans 4294968801 rc 0/0 00000100:00100000:3.0:1790771166.830563:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6292 00010000:00010000:3.0:1790771166.830590:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830596:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830609:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830616:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830623:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.830627:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.830648:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830677:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 112 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.830687:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.830698:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 4/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830721:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 112 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830733:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 112 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.830747:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562d180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539768448:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.830754:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12030:1877759539767296:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.830781:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.830793:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633600 going to sleep for 11 seconds 00000040:00080000:1.0:1790771166.830798:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 88 off10200 00000100:00100000:2.0:1790771166.830829:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771166.830835:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001a2df338 reply state 00000000b81d9faa transno 4294968802 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830844:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.830851:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771166.830853:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.830855:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.830869:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987200 00000100:00100000:3.0:1790771166.830875:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987200 00000100:00100000:1.0:1790771166.830894:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14813:x1877759533987072:12345-192.168.204.50@tcp:36:chown.0 Request processed in 602us (1093us total) trans 4294968802 rc 0/0 00000100:00100000:1.0:1790771166.830902:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6296 00010000:00010000:3.0:1790771166.830902:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 133 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.830918:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.830935:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987456 00000100:00100000:1.0:1790771166.830939:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987456 00000100:00100000:3.0:1790771166.830943:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1754 00000100:00100000:3.0:1790771166.830954:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2397:x1877759533987200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.830958:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 121 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.830967:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.830968:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.830978:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 133 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.830989:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 133 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.830998:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1755 00010000:00010000:3.0:1790771166.831005:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0c7ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35764 expref: 133 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831014:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2397:x1877759533987456:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.831014:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.831021:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771166.831025:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.831027:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831032:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 121 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831043:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961088 00010000:00010000:3.0:1790771166.831047:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831051:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961088 00010000:00010000:3.0:1790771166.831061:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.831065:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 121 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831079:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0beb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e353dd expref: 121 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831087:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2397:x1877759533987200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (461us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.831092:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:2.0:1790771166.831094:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6297 00010000:00010000:1.0:1790771166.831099:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831103:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1754 00000100:00100000:2.0:1790771166.831111:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13289:x1877759533961088:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.831124:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831128:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987328 00010000:00010000:2.0:1790771166.831129:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.831130:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831133:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987328 00010000:00010000:1.0:1790771166.831141:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831144:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0e3f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fa6 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831157:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988096 00010000:00010000:1.0:1790771166.831160:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.831161:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988096 00010000:00010000:2.0:1790771166.831168:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fa6 expref: 133 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.831180:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:11972:x1877759533976192:12345-192.168.204.50@tcp:37:ls.0 Request processed in 31820us (31946us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.831185:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0e3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fa6 expref: 133 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831187:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759533987456:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 176us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.831190:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1638 00000100:00100000:0.0:1790771166.831204:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1631 00000100:00100000:3.0:1790771166.831206:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13672:x1877759533987328:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.831207:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1755 00010000:00010000:2.0:1790771166.831217:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.831222:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.831226:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4aa00, rc 0) 00000100:00100000:2.0:1790771166.831253:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13289:x1877759533961088:12345-192.168.204.50@tcp:101:ls.0 Request processed in 146us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.831261:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6297 00000100:00100000:0.0:1790771166.831269:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1639 00000100:00100000:1.0:1790771166.831272:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533987968 00000100:00100000:1.0:1790771166.831276:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533987968 00000100:00100000:0.0:1790771166.831283:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11376050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13737:x1877759533988096:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771166.831299:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13672:x1877759533987328:12345-192.168.204.50@tcp:35:ls.0 Request processed in 97us (616us total) trans 4294968803 rc 0/0 00000100:00100000:1.0:1790771166.831305:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1025 00000100:00100000:3.0:1790771166.831309:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1638 00000100:00100000:1.0:1790771166.831316:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759533987968:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:2.0:1790771166.831321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.831340:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988224 00000100:00100000:3.0:1790771166.831344:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988224 00000100:00100000:2.0:1790771166.831366:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.831372:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6298 00000100:00100000:3.0:1790771166.831381:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+63:13888:x1877759533988224:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.831389:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961216 00010000:00010000:3.0:1790771166.831390:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1790771166.831395:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb size from disk: 5844 -> 5844 00000100:00100000:2.0:1790771166.831396:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961216 00010000:00010000:3.0:1790771166.831399:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0e3fb lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361e4 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771166.831402:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:1.0:1790771166.831407:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790771166.831413:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:1.0:1790771166.831416:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:2.0:1790771166.831430:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6299 00000100:00100000:1.0:1790771166.831436:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759533987968:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 121us (520us total) trans 4294967628 rc 0/0 00000100:00100000:1.0:1790771166.831442:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1025 00010000:00010000:3.0:1790771166.831446:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831448:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13193:x1877759533961216:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.831460:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831464:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.831468:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.831468:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831478:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0e409 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fad expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831511:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831535:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539767552:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.831549:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0e409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fad expref: 134 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.831549:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831574:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0e409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fad expref: 135 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.831577:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eb0fd8bc reply state 000000006548f42c transno 4294969398 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831590:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.831593:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831596:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.831602:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b800, rc 0) 00010000:00010000:1.0:1790771166.831603:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771166.831609:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.831611:0:12030:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831619:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.831624:0:12030:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831631:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13193:x1877759533961216:12345-192.168.204.50@tcp:101:ls.0 Request processed in 185us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.831632:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.831639:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988736 00000100:00100000:3.0:1790771166.831646:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988736 00000100:00100000:2.0:1790771166.831666:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6299 00000100:00100000:1.0:1790771166.831674:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.831692:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1640 00000100:00100000:1.0:1790771166.831702:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:15010:x1877759533976960:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 31971us (32234us total) trans 4294969398 rc 0/0 00000100:00100000:3.0:1790771166.831707:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14667:x1877759533988736:12345-192.168.204.50@tcp:37:lfs.0 00000100:00100000:1.0:1790771166.831715:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6268 00000100:00100000:2.0:1790771166.831739:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.831768:0:7434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539767424:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.831781:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.831800:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2398:x1877759533972352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 31712us (31903us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.831811:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831812:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1728 00000100:00100000:2.0:1790771166.831812:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.831824:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.831835:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.831843:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988480 00010000:00010000:0.0:1790771166.831846:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831849:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988480 00000100:00100000:1.0:1790771166.831855:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988352 00010000:00010000:0.0:1790771166.831860:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831860:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988352 00010000:00010000:0.0:1790771166.831872:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831877:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 137 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.831881:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04cae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.831887:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.831891:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 848 00010000:00010000:0.0:1790771166.831897:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.831907:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:2.0:1790771166.831908:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2399:x1877759533988480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.831912:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.831917:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831917:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1756 00010000:00010000:2.0:1790771166.831925:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.831926:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e384 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.831932:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2399:x1877759533988352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.831942:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831942:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.831944:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e273 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f2f expref: 137 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831952:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 137 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.831961:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831978:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:0.0:1790771166.831979:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.831982:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 136 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.831987:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.831998:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832003:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.832009:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832009:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0de4b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35da7 expref: 136 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832012:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2399:x1877759533988480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.832036:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 848 00010000:00010000:1.0:1790771166.832038:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771166.832040:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832045:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832052:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.832054:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832055:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.832060:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832063:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832066:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0e376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832083:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832088:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.832089:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832095:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832099:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.832102:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.832108:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2399:x1877759533988352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 179us (301us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.832118:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832118:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.832124:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1756 00010000:00010000:0.0:1790771166.832138:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfc3607ab00) 00000100:00100000:1.0:1790771166.832139:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988608 00010000:00010000:0.0:1790771166.832142:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.832144:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988608 00010000:00010000:0.0:1790771166.832148:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832160:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0e37d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.832169:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 849 00000100:00100000:1.0:1790771166.832182:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2399:x1877759533988608:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.832186:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e36f lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361dd expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.832196:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.832199:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.832203:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.832207:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e36f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361dd expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832210:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f21 expref: 134 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832226:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:1.0:1790771166.832231:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5b:0x0].0x0 (ffff8bfc2900a400) 00010000:00010000:1.0:1790771166.832235:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.832253:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14634:x1877759533987840:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 5175us (5257us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771166.832257:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2399:x1877759533988608:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.832269:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.832276:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6288 00000100:00100000:1.0:1790771166.832276:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 849 00000100:00100000:0.0:1790771166.832304:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988992 00000100:00100000:0.0:1790771166.832309:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988992 00000100:00100000:1.0:1790771166.832310:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533988864 00000100:00100000:1.0:1790771166.832314:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533988864 00000100:00100000:0.0:1790771166.832341:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6300 00000100:00100000:1.0:1790771166.832346:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1641 00000100:00100000:0.0:1790771166.832355:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14579:x1877759533988992:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.832360:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14558:x1877759533988864:12345-192.168.204.50@tcp:49:setfattr.0 00000100:00100000:2.0:1790771166.832372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.832389:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832400:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 135 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.832406:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14558:x1877759533988864:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 51us (226us total) trans 0 rc -61/-61 00010000:00010000:0.0:1790771166.832410:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.832418:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1641 00000100:00100000:2.0:1790771166.832432:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.832434:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533989120 00000100:00100000:1.0:1790771166.832438:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533989120 00010000:00010000:0.0:1790771166.832443:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 135 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832452:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 135 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.832457:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533989376 00000100:00100000:1.0:1790771166.832461:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533989376 00000100:00100000:0.0:1790771166.832464:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539768576:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.832477:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1642 00000100:00100000:1.0:1790771166.832527:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14763:x1877759533989120:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:0.0:1790771166.832556:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb04b8bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.832558:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1643 00000100:00100000:2.0:1790771166.832564:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.832571:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:13262:x1877759533989376:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.832589:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832591:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533989504 00010000:00010000:0.0:1790771166.832599:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832599:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533989504 00002000:00010000:2.0:1790771166.832622:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/20 (0->18446744073709551615) 00002000:00100000:2.0:1790771166.832629:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f919880 with x1877759533989504 ext(0->18446744073709551615) 00000100:00100000:1.0:1790771166.832636:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14763:x1877759533989120:12345-192.168.204.50@tcp:35:cp.0 Request processed in 151us (277us total) trans 4294969399 rc 0/0 00002000:00010000:2.0:1790771166.832638:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3f919880. 00000100:00100000:1.0:1790771166.832647:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1642 00000004:00010000:0.0:1790771166.832678:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000040a43a45 reply state 00000000813bb8a3 transno 4294969401 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.832688:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832688:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 436 00000100:00100000:3.0:1790771166.832692:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13262:x1877759533989376:12345-192.168.204.50@tcp:35:ls.0 Request processed in 121us (266us total) trans 4294969400 rc 0/0 00010000:00010000:0.0:1790771166.832704:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:2.0:1790771166.832706:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2399:x1877759533989504:12345-192.168.204.50@tcp:10:dir_create.sh.0 00010000:00010000:0.0:1790771166.832709:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.832710:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1643 00000100:00100000:0.0:1790771166.832713:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.832733:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.832755:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533989760 00000100:00100000:0.0:1790771166.832760:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533989760 00000100:00100000:1.0:1790771166.832772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.832796:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1644 00000100:00100000:3.0:1790771166.832802:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961472 00000100:00100000:0.0:1790771166.832807:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11377050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+65:13886:x1877759533989760:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.832809:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961472 00002000:00010000:2.0:1790771166.832812:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790771166.832816:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb mtime from disk: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.832820:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.832823:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:2.0:1790771166.832827:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771166.832833:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.832849:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961600 00000100:00100000:3.0:1790771166.832857:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961600 00000100:00100000:2.0:1790771166.832858:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533989504:12345-192.168.204.50@tcp:10:dir_create.sh.0 Request processed in 154us (300us total) trans 4294967622 rc 0/0 00000100:00100000:2.0:1790771166.832870:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 436 00002000:00010000:2.0:1790771166.832874:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/20 (0->18446744073709551615) 00002000:00100000:2.0:1790771166.832878:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f919880 with x1877759533989504 ext(0->18446744073709551615) 00000100:00100000:1.0:1790771166.832884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:2.0:1790771166.832885:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc3f919880. 00000100:00100000:0.0:1790771166.832906:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11377050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:13886:x1877759533989760:12345-192.168.204.50@tcp:35:ls.0 Request processed in 101us (172us total) trans 4294968804 rc 0/0 00000100:00100000:2.0:1790771166.832908:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533989888 00000100:00100000:3.0:1790771166.832908:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6301 00000100:00100000:2.0:1790771166.832916:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533989888 00000100:00100000:0.0:1790771166.832922:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1644 00000100:00100000:1.0:1790771166.832922:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6302 00000100:00100000:3.0:1790771166.832923:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13288:x1877759533961472:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.832936:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.832937:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13189:x1877759533961600:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.832946:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e417 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fb4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.832947:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.832957:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14616:x1877759533977984:12345-192.168.204.50@tcp:36:cp.0 Request processed in 32089us (32266us total) trans 4294969401 rc 0/0 00010000:00010000:1.0:1790771166.832960:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e41e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fbb expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.832960:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 437 00010000:00010000:3.0:1790771166.832970:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fb4 expref: 138 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.832971:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6272 00000100:00100000:2.0:1790771166.832980:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2398:x1877759533989888:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:1.0:1790771166.832994:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fbb expref: 139 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.833011:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e41e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fbb expref: 139 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833012:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e417 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fb4 expref: 139 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.833031:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.833036:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.833037:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.833040:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597000, rc 0) 00010000:00010000:3.0:1790771166.833041:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.833046:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.833050:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00000100:00100000:1.0:1790771166.833061:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:13189:x1877759533961600:12345-192.168.204.50@tcp:101:ls.0 Request processed in 126us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.833068:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6302 00000100:00100000:3.0:1790771166.833079:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13288:x1877759533961472:12345-192.168.204.50@tcp:101:ls.0 Request processed in 158us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.833091:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6301 00000100:00100000:0.0:1790771166.833096:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.833105:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990272 00000100:00100000:1.0:1790771166.833109:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990272 00000100:00100000:3.0:1790771166.833116:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990528 00000100:00100000:3.0:1790771166.833121:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990528 00002000:00010000:2.0:1790771166.833125:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb size from disk: 5844 -> 5844 00002000:00100000:1.0:1790771166.833129:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e:0x0] (2277->4194303) req@ffff8bfb056cd880 x1877759533990272/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00010000:2.0:1790771166.833131:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:2.0:1790771166.833140:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:1.0:1790771166.833143:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cd880 with x1877759533990272 ext(2277->4194303) 00002000:00010000:2.0:1790771166.833145:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:1.0:1790771166.833147:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb056cd880 00000100:00100000:3.0:1790771166.833149:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6303 00002000:00010000:2.0:1790771166.833153:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1f:0x0] updating lvb blocks from disk: 16 -> 32 00000100:00100000:0.0:1790771166.833160:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.833164:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:15067:x1877759533990528:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:1.0:1790771166.833172:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 438 00010000:00010000:3.0:1790771166.833173:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.833181:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759533990272:12345-192.168.204.50@tcp:4:cat.0 00010000:00010000:3.0:1790771166.833187:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e425 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361f9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.833189:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2398:x1877759533989888:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 212us (301us total) trans 4294967629 rc 0/0 00000100:00100000:2.0:1790771166.833207:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 437 00010000:00010000:3.0:1790771166.833236:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.833239:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961728 00000100:00100000:0.0:1790771166.833243:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.833246:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961728 00010000:00010000:3.0:1790771166.833252:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833260:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.833278:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x1b:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.833283:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6304 00000004:00200000:3.0:1790771166.833284:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.833297:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.833299:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13568:x1877759533961728:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.833303:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.833318:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.833331:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e433 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fc2 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.833346:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.833353:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc2 expref: 139 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833363:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0e425 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f9 expref: 119 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.833372:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e433 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc2 expref: 139 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.833382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.833383:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f9 expref: 118 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.833393:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.833395:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:2.0:1790771166.833401:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.833401:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.833406:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687e00, rc 0) 00010000:00010000:2.0:1790771166.833408:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81800, rc 0) 00000100:00100000:3.0:1790771166.833427:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:15067:x1877759533990528:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 266us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.833435:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:13568:x1877759533961728:12345-192.168.204.50@tcp:101:ls.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.833435:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6303 00000100:00100000:2.0:1790771166.833448:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6304 00000100:00100000:3.0:1790771166.833455:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533991040 00000100:00100000:2.0:1790771166.833470:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990016 00000100:00100000:2.0:1790771166.833476:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990016 00000100:00100000:0.0:1790771166.833508:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.833531:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961856 00000100:00100000:2.0:1790771166.833536:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961856 00000100:00100000:3.0:1790771166.833550:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533991040 00000100:00100000:0.0:1790771166.833571:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990912 00000100:00100000:0.0:1790771166.833575:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990912 00000100:00100000:2.0:1790771166.833627:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6305 00000100:00100000:2.0:1790771166.833640:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:15069:x1877759533990016:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:3.0:1790771166.833649:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6306 00010000:00010000:2.0:1790771166.833651:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.833670:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6307 00000100:00100000:3.0:1790771166.833676:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13292:x1877759533961856:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.833679:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e43a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361eb expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.833684:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:15040:x1877759533991040:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.833691:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.833698:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.833703:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e441 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fc9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833711:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e448 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36207 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833723:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e441 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc9 expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.833730:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833739:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e441 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc9 expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833741:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.833745:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833761:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833765:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.833770:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833774:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.833775:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833781:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687000, rc 0) 00000100:00100000:3.0:1790771166.833802:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13292:x1877759533961856:12345-192.168.204.50@tcp:101:ls.0 Request processed in 132us (424us total) trans 0 rc 0/0 00000004:00200000:0.0:1790771166.833805:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.833809:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.833812:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00200000:2.0:1790771166.833815:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.833818:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6306 00000004:00010000:2.0:1790771166.833834:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833841:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e448 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36207 expref: 142 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.833846:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6308 00000100:00100000:3.0:1790771166.833862:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14978:x1877759533990912:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771166.833866:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e43a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361eb expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833869:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36207 expref: 141 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833876:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.833891:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e45d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36200 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.833892:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc3607af00) 00010000:00010000:0.0:1790771166.833896:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.833900:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1bc00, rc 0) 00010000:00010000:2.0:1790771166.833902:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361eb expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.833917:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:0.0:1790771166.833921:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:15040:x1877759533991040:12345-192.168.204.50@tcp:101:cp.0 Request processed in 241us (619us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.833923:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.833929:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9400, rc 0) 00000100:00100000:0.0:1790771166.833932:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6307 00010000:00010000:3.0:1790771166.833935:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833947:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833954:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.833959:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:15069:x1877759533990016:12345-192.168.204.50@tcp:101:rm.0 Request processed in 321us (612us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.833968:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.833970:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6305 00010000:00010000:3.0:1790771166.833979:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.833986:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.834001:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.834021:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.834024:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa95f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539767680:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771166.834040:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.834050:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.834051:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.834076:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759533980288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 30894us (31217us total) trans 0 rc 0/0 00000004:00200000:3.0:1790771166.834081:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 0 00000004:00200000:3.0:1790771166.834086:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.834087:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1737 00000004:00010000:3.0:1790771166.834099:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834108:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834118:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834124:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834129:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834134:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834138:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fe00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.834142:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834147:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834155:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:3.0:1790771166.834158:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.834161:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834166:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0e464 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834176:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834181:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.834184:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990784 00010000:00010000:3.0:1790771166.834188:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.834191:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990784 00010000:00010000:3.0:1790771166.834197:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.834200:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834205:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834214:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0xb62e0cbf (ffff8bfc10471200) 00010000:00010000:3.0:1790771166.834216:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.834219:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834223:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0e46b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.834241:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1645 00010000:00010000:3.0:1790771166.834249:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e45d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 122 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.834257:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+66:14730:x1877759533990784:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:3.0:1790771166.834264:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 121 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834270:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:3.0:1790771166.834272:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.834275:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00000100:00100000:3.0:1790771166.834298:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14978:x1877759533990912:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 442us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.834306:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6308 00000100:00100000:0.0:1790771166.834356:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14730:x1877759533990784:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 105us (1117us total) trans 4294968805 rc 0/0 00000100:00100000:0.0:1790771166.834363:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1645 00000100:00100000:3.0:1790771166.834366:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533991168 00000100:00100000:3.0:1790771166.834433:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533991168 00002000:00010000:3.0:1790771166.834447:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (9475->18446744073709551615) 00002000:00100000:3.0:1790771166.834450:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d91500 with x1877759533991168 ext(9475->18446744073709551615) 00010000:00010000:3.0:1790771166.834457:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.834551:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.834720:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb03d91500. 00000100:00100000:3.0:1790771166.834748:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 97 00000100:00100000:3.0:1790771166.834839:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2399:x1877759533991168:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:0.0:1790771166.834884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.834901:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533961984 00000100:00100000:0.0:1790771166.834904:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533961984 00000100:00100000:2.0:1790771166.834912:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.834940:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533991808 00000100:00100000:2.0:1790771166.834946:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533991808 00000100:00100000:0.0:1790771166.834947:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6309 00000100:00100000:0.0:1790771166.834958:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13559:x1877759533961984:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.834966:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.834975:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e479 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fd0 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.834988:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6310 00010000:00010000:0.0:1790771166.834993:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd0 expref: 142 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.835003:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14073:x1877759533991808:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.835005:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e479 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd0 expref: 142 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.835016:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.835018:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.835021:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b800, rc 0) 00010000:00010000:2.0:1790771166.835021:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.835038:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e480 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3620e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.835051:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13559:x1877759533961984:12345-192.168.204.50@tcp:101:ls.0 Request processed in 94us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.835067:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6309 00010000:00010000:2.0:1790771166.835101:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.835109:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:3.0:1790771166.835116:0:13795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 17258 -> 9475 00010000:00010000:2.0:1790771166.835120:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.835121:0:13795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.835125:0:13795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.835130:0:13795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00000100:00100000:0.0:1790771166.835131:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533991552 00002000:00010000:3.0:1790771166.835138:0:13795:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771166.835139:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533991552 00010000:00010000:2.0:1790771166.835142:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835162:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.835163:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759533991168:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 407us (1163us total) trans 4294967623 rc 0/0 00000100:00100000:0.0:1790771166.835174:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1646 00000100:00100000:3.0:1790771166.835181:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 97 00010000:00010000:2.0:1790771166.835185:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.835185:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (9475->18446744073709551615) 00000100:00100000:0.0:1790771166.835188:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14075:x1877759533991552:12345-192.168.204.50@tcp:35:ls.0 00002000:00100000:3.0:1790771166.835191:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d91500 with x1877759533991168 ext(9475->18446744073709551615) 00010000:00010000:3.0:1790771166.835205:0:13795:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835206:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.835225:0:13795:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.835231:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfb03d91500. 00000004:00200000:2.0:1790771166.835277:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.835284:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14075:x1877759533991552:12345-192.168.204.50@tcp:35:ls.0 Request processed in 96us (176us total) trans 4294968806 rc 0/0 00000100:00100000:0.0:1790771166.835294:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1646 00010000:00010000:2.0:1790771166.835335:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835345:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835352:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835359:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.835363:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835376:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835387:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.835391:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.835395:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835401:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e487 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835413:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835420:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835426:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835434:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.835438:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835446:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835455:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc310f1700) 00010000:00010000:2.0:1790771166.835458:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.835461:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835473:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0e48e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835533:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e480 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3620e expref: 70 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835544:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.835547:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790771166.835552:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e480 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3620e expref: 70 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.835564:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8000, rc 0) 00000100:00100000:2.0:1790771166.835591:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14073:x1877759533991808:12345-192.168.204.50@tcp:101:ls.0 Request processed in 593us (682us total) trans 4294968807 rc 301/301 00000100:00100000:2.0:1790771166.835598:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6310 00000100:00100000:0.0:1790771166.836083:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11376050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:13737:x1877759533988096:12345-192.168.204.50@tcp:37:ls.0 Request processed in 4805us (5123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.836092:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1639 00000100:00100000:0.0:1790771166.836210:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.836273:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992064 00000100:00100000:3.0:1790771166.836278:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992064 00000100:00100000:3.0:1790771166.836309:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6311 00000100:00100000:3.0:1790771166.836316:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12241:x1877759533992064:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.836349:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.836359:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.836372:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e49c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360d3 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.836468:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.836577:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e49c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360d3 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.836586:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfc10471f00) 00010000:00010000:3.0:1790771166.836588:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.836592:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0e49c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360d3 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.836603:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fc00, rc 0) 00000100:00100000:3.0:1790771166.836629:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:12241:x1877759533992064:12345-192.168.204.50@tcp:101:ls.0 Request processed in 312us (419us total) trans 4294968808 rc 301/301 00000100:00100000:3.0:1790771166.836636:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6311 00000100:00100000:3.0:1790771166.836706:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.836821:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.836843:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962112 00000100:00100000:3.0:1790771166.836848:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962112 00000100:00100000:1.0:1790771166.836860:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992192 00000100:00100000:1.0:1790771166.836865:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992192 00000100:00100000:3.0:1790771166.836883:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6312 00000100:00100000:3.0:1790771166.836896:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13207:x1877759533962112:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.836897:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992320 00000100:00100000:1.0:1790771166.836901:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992320 00010000:00010000:3.0:1790771166.836910:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.836921:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0e4aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fd7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.836937:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0e4aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd7 expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.836947:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1026 00010000:00010000:3.0:1790771166.836948:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0e4aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd7 expref: 142 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.836956:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.836960:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:11438:x1877759533992192:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771166.836962:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.836966:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfce00, rc 0) 00010000:00010000:1.0:1790771166.836971:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.836983:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0e4b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36215 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.836994:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13207:x1877759533962112:12345-192.168.204.50@tcp:101:ls.0 Request processed in 103us (175us total) trans 0 rc 0/0 00002000:00010000:1.0:1790771166.836997:0:13782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1790771166.837002:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6312 00010000:00010000:1.0:1790771166.837009:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=167s v=(0 0) 00010000:00010000:1.0:1790771166.837014:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771166.837022:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0e4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36215 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.837033:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000209288e0/0xfa0c505d97f0e4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36215 expref: 27 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.837045:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597400, rc 0) 00000100:00100000:1.0:1790771166.837066:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:11438:x1877759533992192:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 110us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.837072:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1026 00000100:00100000:1.0:1790771166.837090:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1027 00000100:00100000:1.0:1790771166.837096:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2396:x1877759533992320:12345-192.168.204.50@tcp:2:chown.0 00002000:00010000:1.0:1790771166.837155:0:13782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 28259 -> 28259 00002000:00010000:1.0:1790771166.837158:0:13782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:1.0:1790771166.837161:0:13782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790771166.837163:0:13782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 1790771165 -> 1790771166 00002000:00010000:1.0:1790771166.837165:0:13782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1790771166.837192:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759533992320:12345-192.168.204.50@tcp:2:chown.0 Request processed in 97us (488us total) trans 4294967630 rc 0/0 00000100:00100000:1.0:1790771166.837199:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1027 00000100:00100000:0.0:1790771166.837235:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:13260:x1877759533986048:12345-192.168.204.50@tcp:37:ls.0 Request processed in 7850us (7983us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.837242:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1637 00000100:00100000:2.0:1790771166.837508:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb049e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14667:x1877759533988736:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 5805us (5891us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.837519:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1640 00000100:00100000:3.0:1790771166.838704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.838733:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992448 00000100:00100000:3.0:1790771166.838737:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.838738:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992448 00000100:00100000:0.0:1790771166.838769:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992576 00000100:00100000:0.0:1790771166.838772:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992576 00000100:00100000:1.0:1790771166.838786:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6313 00000100:00100000:0.0:1790771166.838794:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6314 00000100:00100000:1.0:1790771166.838799:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:11865:x1877759533992448:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.838807:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:11807:x1877759533992576:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.838811:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.838817:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.838822:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0e4b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360da expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.838830:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360e1 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838876:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e4c6 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838884:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e4c6 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.838889:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e4cd lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838892:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e4c6 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.838909:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e4cd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.838910:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.838920:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e4cd lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.838927:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.838957:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0e4b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360da expref: 123 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838970:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e4c6 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360da expref: 122 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838978:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.838979:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360e1 expref: 123 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.838982:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.838987:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00010000:00010000:0.0:1790771166.839001:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73a00/0xfa0c505d97f0e4cd lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360e1 expref: 122 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.839008:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.839011:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.839013:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73a00, rc 0) 00000100:00100000:1.0:1790771166.839020:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:11865:x1877759533992448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 225us (367us total) trans 4294968809 rc 0/0 00000100:00100000:1.0:1790771166.839026:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6313 00000100:00100000:0.0:1790771166.839038:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11807:x1877759533992576:12345-192.168.204.50@tcp:101:ls.0 Request processed in 235us (303us total) trans 4294968810 rc 0/0 00000100:00100000:0.0:1790771166.839045:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6314 00002000:00010000:1.0:1790771166.839108:0:13793:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1790771165 00000100:00100000:1.0:1790771166.839117:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539767808:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771166.839134:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000552214aa/0xfa0c505d97f0e399 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361ba expref: 26 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.839146:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000552214aa/0xfa0c505d97f0e399 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361ba expref: 26 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.839153:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00000100:00100000:1.0:1790771166.839177:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759533983232:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 10654us (10773us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771166.839182:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1023 00000100:00100000:3.0:1790771166.841321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.841345:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cf480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539767936:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.841359:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539768064:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.841366:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.841371:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539768192:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.841392:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992704 00010000:00010000:0.0:1790771166.841396:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.841399:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992704 00000100:00100000:3.0:1790771166.841400:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.841427:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 121 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.841427:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992832 00000100:00100000:0.0:1790771166.841435:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533992960 00000100:00100000:2.0:1790771166.841435:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992832 00000100:00100000:0.0:1790771166.841440:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533992960 00010000:00010000:0.0:1790771166.841462:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 70 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.841462:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1757 00010000:00010000:2.0:1790771166.841468:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 70 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.841477:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533992704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.841512:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.841518:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 121 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.841523:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1758 00000100:00100000:3.0:1790771166.841540:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759533992960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.841541:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 121 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.841554:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.841562:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0dc53 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cff expref: 121 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.841563:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 70 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.841568:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1759 00000100:00100000:0.0:1790771166.841583:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759533992832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.841590:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 70 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.841592:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.841601:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 70 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841602:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:1.0:1790771166.841610:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841617:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841621:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.841631:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0bab1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35319 expref: 70 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.841633:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 70 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.841666:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533992704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 178us (329us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.841672:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771166.841674:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0d6db lrc: 0/0,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b7e expref: 69 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.841678:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1757 00010000:00010000:3.0:1790771166.841681:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.841698:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.841704:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.841711:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771166.841715:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.841729:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.841735:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+68:2397:x1877759533992832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 157us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.841742:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1759 00010000:00010000:1.0:1790771166.841747:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841755:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.841764:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:2397:x1877759533992960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 226us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.841773:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1758 00000004:00010000:1.0:1790771166.841826:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dd4105c0 reply state 00000000a2ad4664 transno 4294968811 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841834:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.841839:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:1.0:1790771166.841841:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771166.841843:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.841887:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:15041:x1877759533985664:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 13098us (13168us total) trans 4294968811 rc 0/0 00000100:00100000:1.0:1790771166.841892:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6290 00000100:00100000:3.0:1790771166.845900:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.845927:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.845962:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533993344 00000100:00100000:2.0:1790771166.845962:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533993088 00000100:00100000:0.0:1790771166.845967:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533993344 00000100:00100000:2.0:1790771166.845970:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533993088 00000100:00100000:0.0:1790771166.845998:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6315 00002000:00100000:2.0:1790771166.846000:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (565248->569343) req@ffff8bfb05c32a00 x1877759533993088/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771166.846010:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:15001:x1877759533993344:12345-192.168.204.50@tcp:36:chmod.0 00002000:00100000:2.0:1790771166.846021:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c32a00 with x1877759533993088 ext(565248->569343) 00002000:00010000:2.0:1790771166.846027:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c32a00 00010000:00010000:0.0:1790771166.846046:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.846058:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 67 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.846059:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 439 00010000:00010000:0.0:1790771166.846070:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 4/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.846077:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533993088:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771166.846090:0:13769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 67 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.846098:0:13769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 67 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.846116:0:13769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539768704:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.846170:0:13769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.846192:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759533993088:12345-192.168.204.50@tcp:3:cat.0 Request processed in 119us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.846201:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 439 00002000:00100000:2.0:1790771166.846209:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (565248->569343) req@ffff8bfb05c32a00 x1877759533993088/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.846218:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c32a00 with x1877759533993088 ext(565248->569343) 00002000:00010000:2.0:1790771166.846223:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c32a00 00000100:00100000:2.0:1790771166.846869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.846901:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533993600 00000100:00100000:0.0:1790771166.846905:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533993600 00000100:00100000:2.0:1790771166.846937:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.846942:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6316 00000100:00100000:3.0:1790771166.846945:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d180 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0001_UUID:13764:1877759539768448:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.846953:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14413:x1877759533993600:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:3.0:1790771166.846968:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.846971:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533993728 00000100:00100000:1.0:1790771166.846978:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533993728 00010000:00010000:1.0:1790771166.846999:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 121 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.847027:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1760 00000100:00100000:0.0:1790771166.847035:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14413:x1877759533993600:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 84us (165us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771166.847037:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759533993728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.847047:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6316 00010000:00010000:1.0:1790771166.847050:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.847057:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 121 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847066:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 121 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847079:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0df71 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e79 expref: 121 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847087:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:1.0:1790771166.847091:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847097:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847102:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847117:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.847125:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.847143:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2396:x1877759533993728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.847148:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1760 00010000:00010000:3.0:1790771166.847182:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.847343:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000074d5b8fb reply state 000000008abf7f24 transno 4294968812 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847351:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847356:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771166.847358:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771166.847360:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771166.847363:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,1 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847368:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847372:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847376:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.847379:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847384:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847390:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.847391:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.847394:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847399:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847403:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847407:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847411:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847416:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847419:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847423:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847427:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847453:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 2/0,0 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847462:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e249 lrc: 0/0,0 mode: --/CW res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000020 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847464:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.847472:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847475:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.847477:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000074d5b8fb reply state 000000008abf7f24 transno 4294968812 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847513:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.847517:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.847520:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0xc8b04d25 (ffff8bfc10471000) 00010000:00010000:2.0:1790771166.847523:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.847525:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.847527:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.847530:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1790771166.847532:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.847542:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.847544:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00010000:1.0:1790771166.847549:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.847550:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.847565:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.847567:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14506:x1877759533972224:12345-192.168.204.50@tcp:36:ln.0 Request processed in 49676us (49767us total) trans 4294968812 rc 0/0 00010000:00010000:1.0:1790771166.847578:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0e3fb lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361e4 expref: 70 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.847578:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.847585:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6262 00000004:00200000:2.0:1790771166.847587:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.847596:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e3ae lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.847606:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847607:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361e4 expref: 68 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.847612:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 119 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.847633:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.847636:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.847638:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5e00, rc 0) 00010000:00010000:0.0:1790771166.847642:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.847647:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.847649:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd800, rc 0) 00000100:00100000:1.0:1790771166.847675:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:13888:x1877759533988224:12345-192.168.204.50@tcp:101:ls.0 Request processed in 16295us (16360us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.847675:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597200/0xfa0c505d97f0e250 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 69 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.847689:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13736:x1877759533986176:12345-192.168.204.50@tcp:101:ls.0 Request processed in 17981us (18329us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.847690:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6298 00000100:00100000:0.0:1790771166.847705:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6291 00010000:00010000:2.0:1790771166.847721:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 67 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.847730:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.847733:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.847736:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597600, rc 0) 00000100:00100000:2.0:1790771166.847768:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:13883:x1877759533973504:12345-192.168.204.50@tcp:101:ls.0 Request processed in 49125us (49199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.847776:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6264 00000100:00100000:3.0:1790771166.849887:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.849930:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962240 00000100:00100000:2.0:1790771166.849936:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962240 00000100:00100000:2.0:1790771166.849974:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6317 00000100:00100000:2.0:1790771166.849983:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13284:x1877759533962240:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.849993:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.850004:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e4e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fde expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850024:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fde expref: 142 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850035:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e4e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fde expref: 142 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850041:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.850044:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.850046:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391c00, rc 0) 00000100:00100000:2.0:1790771166.850078:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13284:x1877759533962240:12345-192.168.204.50@tcp:101:ls.0 Request processed in 96us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.850086:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6317 00000100:00100000:1.0:1790771166.850377:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.850419:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962624 00000100:00100000:2.0:1790771166.850425:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962624 00000100:00100000:0.0:1790771166.850439:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539768576:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.850451:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.850460:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6318 00000100:00100000:2.0:1790771166.850470:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13569:x1877759533962624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.850479:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.850512:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e4f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35fec expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850532:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fec expref: 143 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850542:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e4f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fec expref: 143 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.850549:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.850552:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.850554:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8800, rc 0) 00000100:00100000:2.0:1790771166.850581:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:13569:x1877759533962624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 113us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.850588:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6318 00000100:00100000:3.0:1790771166.850864:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.850897:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962752 00000100:00100000:0.0:1790771166.850901:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962752 00000100:00100000:0.0:1790771166.850925:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6319 00000100:00100000:0.0:1790771166.850930:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:13196:x1877759533962752:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.850937:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.850944:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0e4f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ff3 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.850957:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0e4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ff3 expref: 144 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.850964:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0e4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ff3 expref: 144 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.850969:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.850971:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.850973:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73c00, rc 0) 00000100:00100000:0.0:1790771166.850995:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:13196:x1877759533962752:12345-192.168.204.50@tcp:101:ls.0 Request processed in 66us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.851000:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6319 00000100:00100000:3.0:1790771166.851279:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.851312:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533962880 00000100:00100000:0.0:1790771166.851317:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533962880 00000100:00100000:0.0:1790771166.851339:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6320 00000100:00100000:0.0:1790771166.851344:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:13566:x1877759533962880:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.851350:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.851357:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0e4fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35ffa expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.851372:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ffa expref: 145 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.851378:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0e4fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ffa expref: 145 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.851383:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.851385:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.851386:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c73000, rc 0) 00000100:00100000:0.0:1790771166.851407:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13566:x1877759533962880:12345-192.168.204.50@tcp:101:ls.0 Request processed in 63us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.851411:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6320 00000100:00100000:1.0:1790771166.853950:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.854003:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533994368 00000100:00100000:0.0:1790771166.854009:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533994368 00000100:00100000:1.0:1790771166.854015:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.854046:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533995136 00000100:00100000:0.0:1790771166.854049:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533995136 00000100:00100000:0.0:1790771166.854067:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6321 00000100:00100000:0.0:1790771166.854073:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:12237:x1877759533994368:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.854084:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.854095:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360f6 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.854096:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6322 00000100:00100000:2.0:1790771166.854115:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:12239:x1877759533995136:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.854128:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.854140:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e50c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3610b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.854166:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e513 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.854177:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e513 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.854185:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e513 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.854193:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.854202:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e51a lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.854215:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e51a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.854227:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e51a lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.854236:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.854259:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360f6 expref: 124 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.854278:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e513 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360f6 expref: 124 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.854288:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.854291:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.854295:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:2.0:1790771166.854306:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0e50c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3610b expref: 125 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.854326:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e51a lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3610b expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.854328:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12237:x1877759533994368:12345-192.168.204.50@tcp:101:ls.0 Request processed in 253us (378us total) trans 4294968813 rc 0/0 00000100:00100000:0.0:1790771166.854343:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6321 00010000:00010000:2.0:1790771166.854348:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.854353:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771166.854357:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b8200, rc 0) 00000100:00100000:2.0:1790771166.854407:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12239:x1877759533995136:12345-192.168.204.50@tcp:101:ls.0 Request processed in 297us (394us total) trans 4294968814 rc 0/0 00000100:00100000:2.0:1790771166.854414:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6322 00000100:00100000:0.0:1790771166.857141:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.857177:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533994752 00000100:00100000:1.0:1790771166.857182:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533994752 00000100:00100000:1.0:1790771166.857217:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6323 00000100:00100000:1.0:1790771166.857226:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:14053:x1877759533994752:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771166.857256:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.857276:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0dafc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d5a expref: 145 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857292:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.857297:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.857325:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857333:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857339:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.857585:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:1.0:1790771166.857601:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].43, 88 off11568 00000004:00080000:1.0:1790771166.857608:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167063121996ns, next at 168063119746ns, rc = 0 00000100:00100000:0.0:1790771166.857626:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533995008 00000100:00100000:0.0:1790771166.857632:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533995008 00000100:00100000:2.0:1790771166.857636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771166.857643:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000285b7664 reply state 00000000dc3471d6 transno 4294969402 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857666:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857673:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.857675:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.857678:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.857682:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1647 00000100:00100000:0.0:1790771166.857689:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13672:x1877759533995008:12345-192.168.204.50@tcp:49:ls.0 00000100:00100000:2.0:1790771166.857710:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.857727:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14053:x1877759533994752:12345-192.168.204.50@tcp:36:chown.0 Request processed in 502us (587us total) trans 4294969402 rc 0/0 00000100:00100000:1.0:1790771166.857733:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6323 00000100:00100000:0.0:1790771166.857743:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13672:x1877759533995008:12345-192.168.204.50@tcp:49:ls.0 Request processed in 53us (159us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771166.857750:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1647 00000100:00100000:1.0:1790771166.857756:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533995264 00000100:00100000:1.0:1790771166.857760:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533995264 00010000:00010000:1.0:1790771166.857776:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 146 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.857803:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533994112 00000100:00100000:1.0:1790771166.857804:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1761 00000100:00100000:0.0:1790771166.857809:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533994112 00000100:00100000:1.0:1790771166.857816:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:2398:x1877759533995264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.857825:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.857829:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 146 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857839:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 146 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.857846:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1028 00000100:00100000:0.0:1790771166.857857:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759533994112:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:1.0:1790771166.857861:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0df01 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35db5 expref: 146 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857872:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00010000:00010000:1.0:1790771166.857876:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857882:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857887:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.857906:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.857925:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:2398:x1877759533995264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.857931:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1761 00002000:00010000:0.0:1790771166.857952:0:8676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 131072 -> 131072 00010000:00010000:1.0:1790771166.857955:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.857956:0:8676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:0.0:1790771166.857961:0:8676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771166.857967:0:8676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.857972:0:8676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 256 -> 256 00010000:00010000:1.0:1790771166.857973:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.857998:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759533994112:12345-192.168.204.50@tcp:2:chown.0 Request processed in 143us (367us total) trans 4294967631 rc 0/0 00000100:00100000:0.0:1790771166.858004:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1028 00010000:00010000:1.0:1790771166.858044:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858051:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858056:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858060:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfde00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.858062:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858067:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858076:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x61:0x0].0x0 (ffff8bfb0282a300) 00010000:00010000:1.0:1790771166.858079:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.858081:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.858086:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0e410 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x61:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.858127:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:14579:x1877759533988992:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 25776us (25867us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771166.858133:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6300 00000100:00100000:1.0:1790771166.865772:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.865825:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.865836:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533995648 00000100:00100000:0.0:1790771166.865845:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533995648 00000100:00100000:2.0:1790771166.865871:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996160 00000100:00100000:2.0:1790771166.865878:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996160 00000100:00100000:0.0:1790771166.865891:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6324 00000100:00100000:0.0:1790771166.865903:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12242:x1877759533995648:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.865911:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6325 00010000:00010000:0.0:1790771166.865917:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.865928:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:12252:x1877759533996160:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.865933:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e536 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36120 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.865942:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.865958:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0e53d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36119 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.865996:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e544 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.866007:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e544 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.866015:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e544 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.866018:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e54b lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.866022:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.866032:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e54b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.866041:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e54b lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.866047:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.866089:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0e536 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36120 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.866104:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e544 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36120 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.866108:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339a00/0xfa0c505d97f0e53d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36119 expref: 129 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.866125:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.866130:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.866133:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1be00, rc 0) 00010000:00010000:1.0:1790771166.866135:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e54b lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36119 expref: 128 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.866142:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.866144:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.866147:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00000100:00100000:0.0:1790771166.866179:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12242:x1877759533995648:12345-192.168.204.50@tcp:101:ls.0 Request processed in 278us (409us total) trans 4294968815 rc 0/0 00000100:00100000:0.0:1790771166.866191:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6324 00000100:00100000:1.0:1790771166.866192:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12252:x1877759533996160:12345-192.168.204.50@tcp:101:ls.0 Request processed in 266us (362us total) trans 4294968816 rc 0/0 00000100:00100000:1.0:1790771166.866202:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6325 00000001:00080000:3.0:1790771166.872037:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967632 is committed 00000001:00080000:3.0:1790771166.872049:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967631 is committed 00000100:00100000:2.0:1790771166.872233:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759533990272:12345-192.168.204.50@tcp:4:cat.0 Request processed in 39051us (39197us total) trans 4294967632 rc 0/0 00000100:00100000:2.0:1790771166.872245:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 438 00002000:00100000:2.0:1790771166.872256:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x1e:0x0] (2277->4194303) req@ffff8bfb056cd880 x1877759533990272/t4294967632(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/448 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.872267:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cd880 with x1877759533990272 ext(2277->4194303) 00002000:00010000:2.0:1790771166.872272:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb056cd880 00000100:00100000:1.0:1790771166.898436:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.898481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.898513:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000000 00000100:00100000:0.0:1790771166.898523:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000000 00000100:00100000:2.0:1790771166.898571:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.898576:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533995392 00000100:00100000:3.0:1790771166.898583:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533995392 00000100:00100000:0.0:1790771166.898586:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963136 00000100:00100000:0.0:1790771166.898590:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963136 00000100:00100000:1.0:1790771166.898600:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6326 00000100:00100000:1.0:1790771166.898614:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:12240:x1877759534000000:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.898621:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6327 00000100:00100000:0.0:1790771166.898632:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6328 00000100:00100000:2.0:1790771166.898638:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13565:x1877759533963136:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.898640:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.898647:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14642:x1877759533995392:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1790771166.898670:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.898675:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.898680:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e560 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3612e expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.898689:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0e56e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36231 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.898695:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e567 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 23 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36008 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.898705:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.898729:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.898738:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36008 expref: 146 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.898749:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.898750:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.898760:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e567 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36008 expref: 146 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.898763:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.898775:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.898781:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e57c lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.898782:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.898787:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.898792:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.898794:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963008 00010000:00010000:2.0:1790771166.898799:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60000, rc 0) 00000100:00100000:3.0:1790771166.898801:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963008 00010000:00010000:1.0:1790771166.898802:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e57c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.898813:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e57c lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.898819:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.898822:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:3.0:1790771166.898832:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996288 00010000:00010000:0.0:1790771166.898835:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.898836:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996288 00010000:00010000:0.0:1790771166.898849:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.898862:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13565:x1877759533963136:12345-192.168.204.50@tcp:101:ls.0 Request processed in 228us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.898862:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996416 00000100:00100000:3.0:1790771166.898866:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996416 00000100:00100000:2.0:1790771166.898879:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6327 00000100:00100000:3.0:1790771166.898896:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6329 00000100:00100000:3.0:1790771166.898905:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13555:x1877759533963008:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.898914:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6330 00010000:00010000:3.0:1790771166.898915:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.898924:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e560 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3612e expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.898926:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.898929:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e598 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 24 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36001 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.898931:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:15035:x1877759533996288:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:0.0:1790771166.898951:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.898959:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.898967:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e598 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36001 expref: 149 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.898968:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e57c lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3612e expref: 129 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.898989:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00010000:00010000:1.0:1790771166.898991:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000004:00200000:0.0:1790771166.898993:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.898996:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.898998:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e598 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36001 expref: 149 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.898999:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6331 00010000:00010000:1.0:1790771166.899001:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996000, rc 0) 00000004:00010000:0.0:1790771166.899009:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.899012:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771166.899018:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:14432:x1877759533996416:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:3.0:1790771166.899019:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.899025:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594600, rc 0) 00000100:00100000:1.0:1790771166.899032:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:12240:x1877759534000000:12345-192.168.204.50@tcp:101:ls.0 Request processed in 419us (603us total) trans 4294968817 rc 0/0 00010000:00010000:0.0:1790771166.899037:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899041:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6326 00010000:00010000:0.0:1790771166.899050:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899056:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13555:x1877759533963008:12345-192.168.204.50@tcp:101:ls.0 Request processed in 150us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.899058:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771166.899059:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899074:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6329 00010000:00010000:0.0:1790771166.899076:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.899082:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c72800/0xfa0c505d97f0df55 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ded expref: 149 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899085:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.899091:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899095:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000512 00000100:00100000:3.0:1790771166.899101:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000512 00010000:00010000:0.0:1790771166.899104:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899115:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.899119:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.899120:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0d584 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35aeb expref: 147 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899122:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899137:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e575 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899141:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6332 00010000:00010000:2.0:1790771166.899148:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00000100:00100000:3.0:1790771166.899155:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:12255:x1877759534000512:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.899156:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899166:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0b173 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34f0d expref: 146 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.899167:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.899168:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.899180:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e59f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36127 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899183:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.899188:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899200:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:0.0:1790771166.899203:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.899209:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899210:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.899224:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899227:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899231:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xb62e0cbf (ffff8bfc3607aa00) 00010000:00010000:0.0:1790771166.899240:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.899245:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899248:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899259:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.899267:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e583 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899270:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.899273:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e5ad lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899286:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.899296:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e5ad lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899304:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0e56e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36231 expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899312:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.899319:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36231 expref: 120 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899326:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.899328:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.899336:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1790771166.899336:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.899340:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372000, rc 0) 00000100:00100000:1.0:1790771166.899354:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997312 00010000:00010000:3.0:1790771166.899358:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e5ad lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.899360:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997312 00010000:00010000:2.0:1790771166.899360:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 120 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899372:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14642:x1877759533995392:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 730us (892us total) trans 0 rc 0/0 00000004:00200000:3.0:1790771166.899377:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.899394:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6333 00000100:00100000:2.0:1790771166.899400:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f918000 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539768832:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.899408:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6328 00000100:00100000:1.0:1790771166.899410:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+67:14075:x1877759533997312:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.899426:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.899437:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e59f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36127 expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899440:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e5bb lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36238 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899443:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996032 00000100:00100000:0.0:1790771166.899448:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996032 00010000:00010000:3.0:1790771166.899468:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e5ad lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36127 expref: 131 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.899475:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:0.0:1790771166.899478:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996544 00000100:00100000:2.0:1790771166.899478:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cc00 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.899478:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.899482:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899508:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996544 00010000:00010000:3.0:1790771166.899512:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595200, rc 0) 00010000:00010000:1.0:1790771166.899523:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899526:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996672 00000100:00100000:0.0:1790771166.899532:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996672 00010000:00010000:1.0:1790771166.899534:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899549:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533996928 00000100:00100000:3.0:1790771166.899550:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb058b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:12255:x1877759534000512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 396us (476us total) trans 4294968818 rc 0/0 00000100:00100000:0.0:1790771166.899553:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533996928 00010000:00010000:1.0:1790771166.899553:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899567:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899569:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997184 00000100:00100000:3.0:1790771166.899570:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6332 00000100:00100000:0.0:1790771166.899574:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997184 00010000:00010000:1.0:1790771166.899582:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.899592:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1648 00000100:00100000:0.0:1790771166.899599:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:15069:x1877759533996032:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:3.0:1790771166.899625:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.899630:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899638:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899643:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.899679:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x35:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.899682:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771166.899691:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771166.899693:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899703:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899708:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899713:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899718:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899722:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.899725:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899730:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899736:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.899739:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.899742:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899746:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0e5c2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899754:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899759:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899763:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899768:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.899771:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899775:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899783:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.899786:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfb0321a800) 00010000:00010000:1.0:1790771166.899789:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.899792:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899796:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e5c9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899810:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.899816:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e5bb lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36238 expref: 70 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899828:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36238 expref: 69 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.899833:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.899835:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790771166.899837:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00000100:00100000:1.0:1790771166.899857:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:14075:x1877759533997312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 456us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.899862:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6333 00000100:00100000:3.0:1790771166.899862:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997568 00000100:00100000:3.0:1790771166.899870:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997568 00000100:00100000:2.0:1790771166.899877:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997696 00000100:00100000:1.0:1790771166.899881:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963264 00000100:00100000:2.0:1790771166.899885:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997696 00000100:00100000:1.0:1790771166.899886:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963264 00000100:00100000:3.0:1790771166.899896:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963392 00000100:00100000:3.0:1790771166.899900:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963392 00000100:00100000:1.0:1790771166.899921:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6334 00000100:00100000:1.0:1790771166.899931:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13292:x1877759533997568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.899939:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.899939:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6335 00010000:00010000:1.0:1790771166.899949:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e5d7 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36246 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.899950:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6336 00000100:00100000:2.0:1790771166.899957:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13281:x1877759533963264:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.899967:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13559:x1877759533997696:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.899974:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.899977:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.899993:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e5e5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3624d expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.899994:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0e5de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 25 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3600f expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900000:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e5ec lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900022:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e5ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900029:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e5ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.900035:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0e5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 25 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3600f expref: 149 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.900045:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.900049:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.900050:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.900051:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0e5de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 25 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3600f expref: 149 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.900062:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e5ec lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.900070:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.900082:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.900087:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900097:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e5d7 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36246 expref: 136 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.900103:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.900107:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.900112:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593200/0xfa0c505d97f0e5ec lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36246 expref: 135 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900120:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000004:00010000:3.0:1790771166.900120:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900125:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.900130:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593200, rc 0) 00000100:00100000:0.0:1790771166.900139:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6337 00010000:00010000:3.0:1790771166.900147:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e5e5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3624d expref: 136 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.900149:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13285:x1877759533963392:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.900160:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13292:x1877759533997568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 229us (533us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.900163:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.900165:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.900172:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1c00, rc 0) 00010000:00010000:0.0:1790771166.900174:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0e5fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 26 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36016 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.900176:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3624d expref: 135 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.900178:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6334 00010000:00010000:3.0:1790771166.900199:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771166.900203:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.900208:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0e5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 26 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36016 expref: 150 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.900209:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:13281:x1877759533963264:12345-192.168.204.50@tcp:101:ls.0 Request processed in 255us (424us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.900209:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594e00, rc 0) 00010000:00010000:0.0:1790771166.900229:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0e5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 26 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36016 expref: 150 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.900231:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6335 00000100:00100000:1.0:1790771166.900233:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.900246:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771166.900247:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0627e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13559:x1877759533997696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 283us (553us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.900252:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.900259:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372c00, rc 0) 00000100:00100000:3.0:1790771166.900263:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6336 00000100:00100000:2.0:1790771166.900273:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1649 00000100:00100000:1.0:1790771166.900283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.900290:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11376c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:10887:x1877759533996544:12345-192.168.204.50@tcp:35:dir_create.sh.0 00000100:00100000:0.0:1790771166.900296:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13285:x1877759533963392:12345-192.168.204.50@tcp:101:ls.0 Request processed in 147us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.900299:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998336 00000100:00100000:3.0:1790771166.900304:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998336 00000100:00100000:0.0:1790771166.900305:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6337 00010000:00010000:3.0:1790771166.900328:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 69 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.900340:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1650 00000100:00100000:0.0:1790771166.900350:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14785:x1877759533996672:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:3.0:1790771166.900354:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998208 00000100:00100000:3.0:1790771166.900358:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998208 00000100:00100000:1.0:1790771166.900359:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.900378:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.900403:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.900434:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1762 00000100:00100000:1.0:1790771166.900444:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:2396:x1877759533998336:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.900448:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1763 00000100:00100000:0.0:1790771166.900452:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14785:x1877759533996672:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 102us (1194us total) trans 4294968819 rc 0/0 00000100:00100000:0.0:1790771166.900462:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1650 00010000:00010000:1.0:1790771166.900463:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.900467:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759533998208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.900474:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 5/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 69 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.900479:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998976 00010000:00010000:3.0:1790771166.900480:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.900483:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998976 00010000:00010000:1.0:1790771166.900507:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 70 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.900519:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.900524:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1651 00010000:00010000:1.0:1790771166.900526:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771166.900529:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11376c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:10887:x1877759533996544:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 243us (1348us total) trans 4294969403 rc 0/0 00010000:00010000:1.0:1790771166.900535:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.900537:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:14073:x1877759533996928:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771166.900554:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1649 00010000:00010000:1.0:1790771166.900555:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.900560:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.900566:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.900582:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1652 00010000:00010000:1.0:1790771166.900592:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.900596:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:11335:x1877759533997184:12345-192.168.204.50@tcp:35:dir_create.sh.0 00010000:00010000:3.0:1790771166.900596:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e17e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360a2 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.900618:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2396:x1877759533998336:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 175us (390us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.900621:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(6 0) 00000100:00100000:0.0:1790771166.900625:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:14073:x1877759533996928:12345-192.168.204.50@tcp:35:ls.0 Request processed in 88us (1340us total) trans 4294968820 rc 0/0 00000100:00100000:1.0:1790771166.900631:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1762 00000100:00100000:0.0:1790771166.900635:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1651 00000100:00100000:0.0:1790771166.900667:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1653 00000100:00100000:0.0:1790771166.900676:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+69:13889:x1877759533998976:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.900718:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(6 0) 00010000:00010000:3.0:1790771166.900725:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.900736:0:13791:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60080000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.900738:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:2.0:1790771166.900744:0:13790:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969404 00000100:00100000:0.0:1790771166.900754:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:13889:x1877759533998976:12345-192.168.204.50@tcp:35:ls.0 Request processed in 79us (396us total) trans 4294968821 rc 0/0 00000100:00100000:0.0:1790771166.900760:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1653 00010000:00010000:3.0:1790771166.900772:0:13791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.900789:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.900794:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999104 00000100:00100000:0.0:1790771166.900798:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999104 00002000:00100000:0.0:1790771166.900824:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (569344->573439) req@ffff8bfb0552f800 x1877759533999104/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.900827:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:11335:x1877759533997184:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 233us (1512us total) trans 4294969405 rc 0/0 00000100:00100000:2.0:1790771166.900852:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1652 00000100:00100000:1.0:1790771166.900853:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.900853:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.900863:0:13790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00100000:0.0:1790771166.900881:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552f800 with x1877759533999104 ext(569344->573439) 00000100:00100000:2.0:1790771166.900885:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999872 00002000:00010000:0.0:1790771166.900887:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0552f800 00000100:00100000:1.0:1790771166.900893:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.900893:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999872 00000100:00100000:0.0:1790771166.900906:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 440 00000100:00100000:0.0:1790771166.900917:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759533999104:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771166.900920:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000384 00000100:00100000:2.0:1790771166.900925:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000384 00000100:00100000:1.0:1790771166.900931:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.900951:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1654 00000100:00100000:3.0:1790771166.900957:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:13791:1877759539768960:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.900966:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:11973:x1877759533999872:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.900983:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.901019:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.901052:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0552f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759533999104:12345-192.168.204.50@tcp:3:cat.0 Request processed in 135us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.901062:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 440 00000100:00100000:3.0:1790771166.901067:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633180 going to sleep for 11 seconds 00002000:00100000:0.0:1790771166.901073:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (569344->573439) req@ffff8bfb0552f800 x1877759533999104/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771166.901076:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:11973:x1877759533999872:12345-192.168.204.50@tcp:35:ls.0 Request processed in 114us (285us total) trans 4294969406 rc 0/0 00000100:00100000:1.0:1790771166.901077:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.901088:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998592 00000100:00100000:3.0:1790771166.901095:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998592 00002000:00100000:0.0:1790771166.901097:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0552f800 with x1877759533999104 ext(569344->573439) 00000100:00100000:1.0:1790771166.901098:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998848 00000100:00100000:2.0:1790771166.901101:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1654 00000100:00100000:1.0:1790771166.901104:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998848 00002000:00010000:0.0:1790771166.901107:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0552f800 00000100:00100000:2.0:1790771166.901130:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1655 00000100:00100000:1.0:1790771166.901136:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998080 00000100:00100000:1.0:1790771166.901139:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998080 00000100:00100000:0.0:1790771166.901140:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000128 00000100:00100000:2.0:1790771166.901145:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11376850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13265:x1877759534000384:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771166.901147:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000128 00000100:00100000:1.0:1790771166.901157:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6338 00000100:00100000:1.0:1790771166.901170:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:13886:x1877759533998848:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.901170:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1029 00010000:00010000:1.0:1790771166.901181:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.901185:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2399:x1877759533998592:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771166.901191:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 850 00010000:00010000:1.0:1790771166.901193:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e601 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36270 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.901204:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759534000128:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.901215:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.901229:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0e4c6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360da expref: 135 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901235:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901245:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.901246:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771166.901254:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11376850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13265:x1877759534000384:12345-192.168.204.50@tcp:35:ls.0 Request processed in 111us (357us total) trans 4294969407 rc 0/0 00010000:00010000:0.0:1790771166.901255:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.901258:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.901275:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1655 00000004:00200000:1.0:1790771166.901278:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.901282:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.901287:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2396:x1877759534000128:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (438us total) trans 0 rc 0/0 00000004:00010000:1.0:1790771166.901292:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.901298:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 850 00010000:00010000:1.0:1790771166.901316:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e601 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36270 expref: 72 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901327:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36270 expref: 71 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901332:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771166.901335:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1790771166.901335:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001024 00010000:00010000:1.0:1790771166.901337:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593800, rc 0) 00000100:00100000:2.0:1790771166.901343:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001024 00000100:00100000:0.0:1790771166.901353:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001280 00000100:00100000:0.0:1790771166.901358:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001280 00002000:00010000:3.0:1790771166.901359:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790771166.901363:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1790771166 -> 1674053537 00000100:00100000:1.0:1790771166.901365:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:13886:x1877759533998848:12345-192.168.204.50@tcp:101:ls.0 Request processed in 200us (967us total) trans 0 rc 0/0 00002000:00010000:3.0:1790771166.901367:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.901373:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.901378:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771166.901379:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6338 00000100:00100000:2.0:1790771166.901390:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6339 00000100:00100000:0.0:1790771166.901398:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6340 00000100:00100000:2.0:1790771166.901405:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13288:x1877759533998080:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.901412:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2399:x1877759533998592:12345-192.168.204.50@tcp:2:cp.0 Request processed in 228us (423us total) trans 4294967633 rc 0/0 00000100:00100000:0.0:1790771166.901413:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14495:x1877759534001024:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:1.0:1790771166.901413:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6341 00010000:00010000:2.0:1790771166.901421:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.901429:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.901433:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1029 00000100:00100000:1.0:1790771166.901434:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14508:x1877759534001280:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:2.0:1790771166.901436:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e60f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36262 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.901440:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0e616 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362a8 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.901481:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.901516:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14508:x1877759534001280:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 90us (444us total) trans 0 rc -17/-17 00010000:00010000:0.0:1790771166.901519:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.901526:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6341 00000100:00100000:3.0:1790771166.901527:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963520 00010000:00010000:0.0:1790771166.901531:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.901535:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963520 00010000:00010000:0.0:1790771166.901539:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.901545:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.901558:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x5b:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.901559:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.901563:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.901575:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.901575:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6342 00010000:00010000:2.0:1790771166.901577:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.901591:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13194:x1877759533963520:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.901596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.901601:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0e616 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a8 expref: 128 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.901607:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.901616:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a8 expref: 127 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.901619:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.901620:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e62b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 27 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3601d expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.901626:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5b:0x0].0x0 (ffff8bfc3607d400) 00000004:00200000:2.0:1790771166.901628:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.901634:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:1.0:1790771166.901639:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.901640:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373600, rc 0) 00000004:00010000:2.0:1790771166.901647:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.901667:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 27 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3601d expref: 150 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.901680:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14495:x1877759534001024:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 273us (658us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.901685:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 27 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3601d expref: 150 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.901690:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6340 00010000:00010000:2.0:1790771166.901697:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e60f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36262 expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.901702:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.901702:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.901710:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.901713:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001664 00010000:00010000:3.0:1790771166.901714:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594c00, rc 0) 00000100:00100000:0.0:1790771166.901718:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001664 00010000:00010000:2.0:1790771166.901728:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36262 expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.901739:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.901742:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.901747:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0200, rc 0) 00000100:00100000:3.0:1790771166.901747:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:13194:x1877759533963520:12345-192.168.204.50@tcp:101:ls.0 Request processed in 160us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.901750:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1656 00000100:00100000:1.0:1790771166.901757:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.901766:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13736:x1877759534001664:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771166.901767:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6342 00000100:00100000:2.0:1790771166.901785:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13288:x1877759533998080:12345-192.168.204.50@tcp:101:ls.0 Request processed in 384us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.901790:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533998464 00000100:00100000:3.0:1790771166.901794:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533998464 00000100:00100000:2.0:1790771166.901795:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6339 00000100:00100000:1.0:1790771166.901803:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.901821:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963776 00000100:00100000:2.0:1790771166.901827:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963776 00000100:00100000:3.0:1790771166.901830:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963648 00000100:00100000:3.0:1790771166.901834:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963648 00000100:00100000:1.0:1790771166.901838:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6343 00000100:00100000:1.0:1790771166.901847:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13189:x1877759533998464:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.901856:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.901865:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e632 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36269 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.901869:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6344 00000100:00100000:3.0:1790771166.901881:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6345 00000100:00100000:2.0:1790771166.901887:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13290:x1877759533963776:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.901893:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13563:x1877759533963648:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.901901:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.901903:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.901906:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901914:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.901919:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e647 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 30 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36024 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.901920:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0e640 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 29 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3602b expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901921:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.901951:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.901954:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 29 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36024 expref: 153 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.901955:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.901965:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.901973:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0e640 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 29 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3602b expref: 153 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901983:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e632 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36269 expref: 137 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.901994:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36269 expref: 136 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.902000:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.902001:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.902003:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593e00, rc 0) 00000100:00100000:1.0:1790771166.902020:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13189:x1877759533998464:12345-192.168.204.50@tcp:101:ls.0 Request processed in 176us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.902025:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6343 00010000:00010000:3.0:1790771166.902041:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e647 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 30 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36024 expref: 153 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.902043:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0e640 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 30 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3602b expref: 153 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.902059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.902063:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.902068:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.902072:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0c00, rc 0) 00000100:00100000:1.0:1790771166.902074:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533963904 00000100:00100000:1.0:1790771166.902078:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533963904 00000100:00100000:1.0:1790771166.902103:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6346 00000100:00100000:2.0:1790771166.902105:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13290:x1877759533963776:12345-192.168.204.50@tcp:101:ls.0 Request processed in 219us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.902112:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13192:x1877759533963904:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.902124:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.902128:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6344 00010000:00010000:1.0:1790771166.902134:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e64e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 31 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36032 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.902139:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.902145:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.902147:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594a00, rc 0) 00010000:00010000:1.0:1790771166.902154:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 30 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36032 expref: 154 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.902161:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001536 00010000:00010000:1.0:1790771166.902164:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e64e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 30 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36032 expref: 154 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.902169:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001536 00000100:00100000:3.0:1790771166.902169:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13563:x1877759533963648:12345-192.168.204.50@tcp:101:ls.0 Request processed in 278us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.902185:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6345 00010000:00010000:1.0:1790771166.902189:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.902192:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.902194:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592800, rc 0) 00000100:00100000:2.0:1790771166.902206:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 851 00000100:00100000:1.0:1790771166.902211:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13192:x1877759533963904:12345-192.168.204.50@tcp:101:ls.0 Request processed in 101us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.902218:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+71:2397:x1877759534001536:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.902228:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.902236:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6346 00010000:00010000:2.0:1790771166.902244:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0e402 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361e4 expref: 71 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.902260:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771166.902264:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.902288:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+70:2397:x1877759534001536:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.902296:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 851 00000100:00100000:3.0:1790771166.902323:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.902335:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104400/0xfa0c505d97f0c85d lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x10/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3578e expref: 69 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.902348:0:13769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d92300 pname:cluuid:pid:xid:nid:opc:job mdt00_014:lustre-MDT0001_UUID:13769:1877759539768704:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.902354:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002432 00000100:00100000:1.0:1790771166.902360:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002432 00000100:00100000:3.0:1790771166.902360:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.902367:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.902375:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.902380:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.902391:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002688 00000100:00100000:1.0:1790771166.902397:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002688 00000100:00100000:3.0:1790771166.902418:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.902429:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002560 00000100:00100000:1.0:1790771166.902435:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002560 00000100:00100000:3.0:1790771166.902462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.902474:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:1.0:1790771166.902481:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759534002432:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.902510:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.902515:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 853 00010000:00010000:1.0:1790771166.902521:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e544 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36120 expref: 139 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.902531:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759534002688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.902533:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.902540:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.902550:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.902560:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:2396:x1877759534002432:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.902566:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 852 00000100:00100000:2.0:1790771166.902578:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.902583:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:1.0:1790771166.902591:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:2398:x1877759534002560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.902602:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.902610:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8200/0xfa0c505d97f0e51a lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3610b expref: 137 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.902615:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e513 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360f6 expref: 137 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.902628:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.902630:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.902635:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.902636:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.902641:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.902673:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759534002688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 149us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.902682:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2398:x1877759534002560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 91us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.902683:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 853 00000100:00100000:2.0:1790771166.902695:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.902700:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 854 00000100:00100000:1.0:1790771166.902718:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003200 00000100:00100000:1.0:1790771166.902721:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003200 00000100:00100000:2.0:1790771166.902741:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.902756:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 855 00000100:00100000:1.0:1790771166.902765:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2398:x1877759534003200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.902773:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.902778:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002176 00000100:00100000:0.0:1790771166.902784:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002176 00010000:00010000:1.0:1790771166.902785:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e54b lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36119 expref: 134 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.902789:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.902803:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.902806:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.902823:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1030 00000100:00100000:1.0:1790771166.902831:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2398:x1877759534003200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.902838:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2398:x1877759534002176:12345-192.168.204.50@tcp:2:chown.0 00000100:00100000:1.0:1790771166.902840:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 855 00000100:00100000:1.0:1790771166.902872:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999616 00000100:00100000:1.0:1790771166.902876:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999616 00000100:00100000:1.0:1790771166.902904:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003328 00000100:00100000:1.0:1790771166.902906:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003328 00002000:00010000:0.0:1790771166.902921:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 14473 -> 14473 00002000:00010000:0.0:1790771166.902924:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.902927:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.902930:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00000100:00100000:1.0:1790771166.902931:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000640 00002000:00010000:0.0:1790771166.902933:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771166.902935:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000640 00000100:00100000:3.0:1790771166.902952:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6347 00000100:00100000:0.0:1790771166.902961:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2398:x1877759534002176:12345-192.168.204.50@tcp:2:chown.0 Request processed in 128us (498us total) trans 4294967624 rc 0/0 00000100:00100000:2.0:1790771166.902964:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6348 00000100:00100000:3.0:1790771166.902966:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13289:x1877759533999616:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771166.902976:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6349 00000100:00100000:0.0:1790771166.902977:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1030 00000100:00100000:2.0:1790771166.902984:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:14692:x1877759534003328:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.902991:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13193:x1877759534000640:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.903000:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.903005:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003584 00010000:00010000:1.0:1790771166.903009:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e655 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36293 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.903010:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003584 00002000:00100000:0.0:1790771166.903032:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e:0x0] (4194304->4198399) req@ffff8bfb06790700 x1877759534003584/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.903033:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903033:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.903045:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e663 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3628c expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.903052:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903060:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.903067:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.903086:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903092:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 126 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771166.903102:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790700 with x1877759534003584 ext(4194304->4198399) 00000004:00200000:1.0:1790771166.903102:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.903109:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00010000:0.0:1790771166.903112:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790700 00010000:00010000:2.0:1790771166.903113:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 5/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.903119:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.903131:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 441 00010000:00010000:1.0:1790771166.903139:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e655 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36293 expref: 137 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903139:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903142:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 126 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.903143:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534003584:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:3.0:1790771166.903166:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903173:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 126 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903178:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.903180:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36293 expref: 136 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.903201:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.903204:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.903206:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593000, rc 0) 00000100:00100000:2.0:1790771166.903206:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539769088:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.903213:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534003584:12345-192.168.204.50@tcp:3:cat.0 Request processed in 73us (427us total) trans 0 rc 4096/4096 00000004:00200000:3.0:1790771166.903217:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.903221:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 441 00000004:00200000:3.0:1790771166.903225:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00100000:0.0:1790771166.903229:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x1e:0x0] (4194304->4198399) req@ffff8bfb06790700 x1877759534003584/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/4536 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771166.903240:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06790700 with x1877759534003584 ext(4194304->4198399) 00000004:00010000:3.0:1790771166.903243:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.903245:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06790700 00000100:00100000:1.0:1790771166.903253:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13193:x1877759534000640:12345-192.168.204.50@tcp:101:ls.0 Request processed in 265us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.903262:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6349 00010000:00010000:3.0:1790771166.903277:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e663 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3628c expref: 136 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903291:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903296:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3628c expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903310:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.903315:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 126 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.903315:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.903317:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594000, rc 0) 00000100:00100000:2.0:1790771166.903332:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539769216:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.903345:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13289:x1877759533999616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 385us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.903352:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6347 00000100:00100000:2.0:1790771166.903366:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c300 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.903470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.903605:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964032 00000100:00100000:3.0:1790771166.903610:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964032 00000100:00100000:2.0:1790771166.903689:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6350 00000100:00100000:2.0:1790771166.903702:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13552:x1877759533964032:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.903713:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.903724:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0e678 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 31 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36039 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903743:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0e678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 31 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36039 expref: 155 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903755:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0e678 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 31 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36039 expref: 155 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.903763:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.903766:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.903769:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56000, rc 0) 00000100:00100000:2.0:1790771166.903804:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+155:13552:x1877759533964032:12345-192.168.204.50@tcp:101:ls.0 Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.903813:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6350 00000100:00100000:3.0:1790771166.903967:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:2.0:1790771166.903983:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968822 is committed 00000100:00100000:3.0:1790771166.904002:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.904004:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000768 00000100:00100000:0.0:1790771166.904009:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000768 00000001:00080000:2.0:1790771166.904017:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968819 is committed 00000100:00100000:0.0:1790771166.904044:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6351 00000100:00100000:0.0:1790771166.904060:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13568:x1877759534000768:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.904065:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.904072:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.904082:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e67f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3629a expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904088:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003968 00000004:00080000:2.0:1790771166.904093:0:7423:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 13 committed 00000100:00100000:3.0:1790771166.904093:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003968 00010000:00010000:0.0:1790771166.904122:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904127:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004224 00010000:00010000:0.0:1790771166.904131:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904131:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004224 00010000:00010000:0.0:1790771166.904140:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.904147:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 126 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.904148:0:7423:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0001: 20 batchid updated 00000004:00200000:0.0:1790771166.904154:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.904160:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.904169:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904180:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1764 00010000:00010000:0.0:1790771166.904187:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0e67f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3629a expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904191:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2396:x1877759534004224:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.904202:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 856 00010000:00010000:0.0:1790771166.904207:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3629a expref: 113 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.904208:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.904218:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771166.904220:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 126 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904221:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.904225:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373400, rc 0) 00000100:00100000:2.0:1790771166.904233:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2396:x1877759534003968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.904255:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 126 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.904259:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.904265:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:13568:x1877759534000768:12345-192.168.204.50@tcp:101:ls.0 Request processed in 209us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.904267:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:15069:x1877759533996032:12345-192.168.204.50@tcp:37:rm.0 Request processed in 4666us (5563us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.904271:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:2.0:1790771166.904279:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e57c lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3612e expref: 113 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.904281:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.904287:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1648 00000100:00100000:0.0:1790771166.904296:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6351 00010000:00010000:3.0:1790771166.904305:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.904312:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.904314:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771166.904320:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.904326:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.904327:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904334:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904340:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904345:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ba00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904348:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904353:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2396:x1877759534003968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 132us (350us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.904354:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904357:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2396:x1877759534004224:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.904361:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904379:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1764 00010000:00010000:1.0:1790771166.904383:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904385:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa8:0x0].0x510a92c1 (ffff8bfc3607ac00) 00000100:00100000:2.0:1790771166.904390:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 856 00010000:00010000:0.0:1790771166.904392:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.904398:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904402:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904405:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e34c lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa8:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904422:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.904428:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.904430:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 20 00010000:00010000:0.0:1790771166.904433:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904437:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904446:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904454:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.904456:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904457:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.904463:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904465:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904471:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904474:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e115 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904480:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904513:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904514:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771166.904519:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.904523:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904525:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904529:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539769472:0@lo:2:osp-syn-1-1.0 00000004:00080000:2.0:1790771166.904534:0:7446:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfb0668c780 with version 41 00010000:00010000:0.0:1790771166.904535:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e361 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904547:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.904551:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 20 cancel update log [0x200000401:0x2:0x0].19: rc = 0 00010000:00010000:1.0:1790771166.904553:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904555:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904559:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904571:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904573:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904583:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.904588:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904594:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.904595:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b9200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904601:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904601:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.904605:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.904614:0:7446:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 20 cancel update log [0x240000400:0x2:0x0].19: rc = 0 00000100:00100000:3.0:1790771166.904615:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790771166.904626:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539769344:0@lo:6:osp-syn-1-1.0 00010000:00010000:1.0:1790771166.904631:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0e193 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.904631:0:7446:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 20 00010000:00010000:0.0:1790771166.904632:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904667:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.904671:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.904674:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1790771166.904674:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539769728:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1790771166.904675:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904679:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904695:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904696:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9200/0xfa0c505d97f0e1a1 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x26:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904699:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539769600:0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1790771166.904713:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904719:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904721:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904725:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904728:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.904740:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904742:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904746:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539769472 00010000:00010000:0.0:1790771166.904753:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904753:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539769472 00010000:00010000:1.0:1790771166.904759:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0xc8b04d25 (ffff8bfc10471000) 00010000:00010000:0.0:1790771166.904761:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.904763:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.904766:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904767:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904782:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904783:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0e3e6 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.904784:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 41 rpc_version 41 00000100:00100000:3.0:1790771166.904789:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539769344 00000100:00100000:3.0:1790771166.904793:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539769344 00010000:00010000:0.0:1790771166.904803:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0xcdd6ff3 (ffff8bfc10471100) 00010000:00010000:0.0:1790771166.904806:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.904809:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1790771166.904810:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1790771166.904813:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904816:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539769728 00000100:00100000:3.0:1790771166.904821:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539769728 00000100:00100000:2.0:1790771166.904824:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb049e9500 x1877759539769984/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1790771166.904826:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80c00/0xfa0c505d97f0e3ca lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904829:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904843:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00010000:00010000:1.0:1790771166.904851:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.904856:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3625:x1877759539769472:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1790771166.904863:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.904864:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904868:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb049e9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539769984:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1790771166.904869:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904882:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904883:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904899:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904902:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771166.904906:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.904906:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.904913:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.904913:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904924:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.904933:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0e3ed lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904934:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904953:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c000 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.904959:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771166.904963:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.904965:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904970:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0e3df lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.904984:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.904986:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00010000:00010000:0.0:1790771166.904994:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905000:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905005:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+8:3625:x1877759539769344:12345-0@lo:6:osp-syn-1-1.0 00002000:00010000:3.0:1790771166.905006:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 28259 -> 28259 00010000:00010000:0.0:1790771166.905007:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.905013:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.905014:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:3.0:1790771166.905020:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00010000:00010000:0.0:1790771166.905024:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.905024:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00080000:2.0:1790771166.905030:0:13781:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000400:15 count 1 00002000:00010000:3.0:1790771166.905032:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 24 -> 24 00010000:00010000:0.0:1790771166.905044:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771166.905046:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.905048:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905052:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0e3a0 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x7:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.905063:0:13781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790771166.905072:0:13781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 3/0,1 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.905084:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=167s v=(0 0) 00000100:00100000:3.0:1790771166.905089:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+8:3625:x1877759539769472:12345-0@lo:2:osp-syn-1-1.0 Request processed in 233us (510us total) trans 4294967634 rc 0/0 00010000:00010000:2.0:1790771166.905092:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0xf:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1790771166.905097:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00010000:00010000:2.0:1790771166.905100:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905114:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00010000:00010000:2.0:1790771166.905115:0:13781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905126:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:3627:x1877759539769728:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:2.0:1790771166.905129:0:13781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 3/0,1 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.905140:0:13781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.905163:0:13781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771166.905180:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.905237:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f08d54 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e342f0 expref: 124 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.905266:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f918000 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539768832:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.905281:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905282:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3625:x1877759539769344:12345-0@lo:6:osp-syn-1-1.0 Request processed in 281us (630us total) trans 4294967635 rc 0/0 00002000:00010000:3.0:1790771166.905292:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb size from disk: 38336 -> 38336 00002000:00010000:3.0:1790771166.905297:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000100:00100000:2.0:1790771166.905302:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00002000:00010000:3.0:1790771166.905302:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.905309:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.905312:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0xd:0x0] updating lvb blocks from disk: 80 -> 80 00010000:00010000:1.0:1790771166.905313:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905319:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905328:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539769600 00010000:00010000:1.0:1790771166.905335:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905335:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539769600 00010000:00010000:1.0:1790771166.905344:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905351:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905373:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1790771166.905383:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539769600:12345-0@lo:2:osp-syn-1-1.0 00010000:00010000:1.0:1790771166.905422:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905441:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905447:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 4/0,1 mode: --/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905449:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+9:3627:x1877759539769728:12345-0@lo:2:osp-syn-1-1.0 Request processed in 325us (727us total) trans 4294967636 rc 0/0 00000100:00100000:3.0:1790771166.905460:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00010000:00010000:1.0:1790771166.905471:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905480:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.905481:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771166.905511:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.905521:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:1.0:1790771166.905528:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f918000 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539770112:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.905529:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 2/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.905543:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.905561:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 1/0,0 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.905570:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1d022d1/0xfa0c505d97f0e68d lrc: 0/0,0 mode: --/PW res: [0x2c0000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.905578:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87000 going to sleep for 11 seconds 00010000:00010000:3.0:1790771166.905593:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.905597:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.905600:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790771166.905620:0:13781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 131072 -> 131072 00002000:00010000:2.0:1790771166.905625:0:13781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00000100:00100000:3.0:1790771166.905627:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967593 gen 2 00000001:00080000:1.0:1790771166.905628:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969402 is committed 00002000:00010000:2.0:1790771166.905631:0:13781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00000004:00080000:1.0:1790771166.905634:0:6473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1790771166.905635:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05794a80, transno 4294967593 00002000:00010000:2.0:1790771166.905636:0:13781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.905642:0:13781:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 256 -> 256 00000001:00080000:1.0:1790771166.905666:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969401 is committed 00000100:00100000:3.0:1790771166.905667:0:3627:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb06792680 x1877759539769728/t4294967636(4294967636) o2->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1790771166.905678:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06792680/2, rc 0, transno 4294967636 00000100:00100000:3.0:1790771166.905685:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539769728:0@lo:2:osp-syn-1-1.0 00000020:00080000:1.0:1790771166.905698:0:6473:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc07f36c00 refcount 2 committed 0 result -61 batchid 52 00000020:00080000:1.0:1790771166.905703:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb03d2ce00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result -61 sub_th ffff8bfc35fcfb40 00000020:00080000:1.0:1790771166.905706:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfb03d2c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb073e1000 00000100:00100000:2.0:1790771166.905712:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539769600:12345-0@lo:2:osp-syn-1-1.0 Request processed in 329us (530us total) trans 4294967637 rc 0/0 00000100:00100000:0.0:1790771166.905719:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13736:x1877759534001664:12345-192.168.204.50@tcp:37:ls.0 Request processed in 3957us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.905726:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1790771166.905731:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1656 00000100:00080000:2.0:1790771166.905764:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1790771166.905764:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06792a00/2, rc 0, transno 4294967635 00010000:00010000:0.0:1790771166.905768:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905777:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905779:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539769344:0@lo:6:osp-syn-1-1.0 00000100:00100000:2.0:1790771166.905787:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539769984 00010000:00010000:0.0:1790771166.905790:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.905794:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539769984 00000004:00080000:3.0:1790771166.905796:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06790000/2, rc 0, transno 4294967634 00010000:00010000:0.0:1790771166.905806:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.905806:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539769472:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771166.905812:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905821:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905824:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770368:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790771166.905831:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905840:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905841:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00000100:00100000:2.0:1790771166.905847:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00010000:00010000:0.0:1790771166.905849:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.905853:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905856:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905863:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.905865:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7438:x1877759539769984:12345-0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1790771166.905871:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533f000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.905878:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905883:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905885:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905886:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770880:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790771166.905901:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e10e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905907:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771166.905911:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.905914:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905916:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905922:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771166.905934:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0e281 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905935:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905939:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790771166.905951:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770240:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790771166.905954:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905961:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aa600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.905962:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.905964:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905979:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.905988:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.905991:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.905996:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.906002:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05339000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.906004:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00000100:00100000:2.0:1790771166.906006:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:7438:x1877759539769984:12345-0@lo:1000:osp_up0-1.0 Request processed in 144us (1084us total) trans 4294969408 rc 0/0 00010000:00010000:0.0:1790771166.906009:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.906009:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906014:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770752:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790771166.906015:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.906028:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:1.0:1790771166.906030:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906032:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0e0cf lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906048:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.906060:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.906061:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771166.906068:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771166.906072:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770368 00010000:00010000:1.0:1790771166.906073:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906074:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906078:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770880 00000100:00100000:2.0:1790771166.906080:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770368 00000100:00100000:3.0:1790771166.906085:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770880 00010000:00010000:0.0:1790771166.906096:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.906097:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e52f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x45:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906108:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.906113:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.906116:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770240 00010000:00010000:0.0:1790771166.906120:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.906122:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770240 00000100:00100000:3.0:1790771166.906126:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770752 00000100:00100000:3.0:1790771166.906131:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770752 00010000:00010000:0.0:1790771166.906132:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771166.906136:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.906139:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.906147:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000d2b1161 reply state 0000000020ad02e3 transno 4294968822 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906148:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e29d lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.906165:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00010000:00010000:1.0:1790771166.906170:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906175:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1790771166.906181:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3625:x1877759539770368:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1790771166.906184:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.906188:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.906192:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771166.906193:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3625:x1877759539770880:12345-0@lo:6:osp-syn-0-0.0 00000004:00200000:1.0:1790771166.906198:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00002000:00080000:3.0:1790771166.906213:0:13796:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:33 count 1 00010000:00080000:1.0:1790771166.906230:0:13769:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1790771166.906231:0:13796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.906244:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:15001:x1877759533993344:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 60237us (60314us total) trans 4294968822 rc 0/0 00010000:00010000:3.0:1790771166.906252:0:13796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.906253:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6315 00010000:00010000:0.0:1790771166.906272:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906282:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906289:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906294:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.906298:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.906298:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00010000:00010000:0.0:1790771166.906307:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.906311:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3625:x1877759539770240:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1790771166.906319:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.906323:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.906326:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1790771166.906326:0:13788:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:24 count 1 00010000:00010000:3.0:1790771166.906330:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x21:0x0].0x0 since=2s v=(0 0) 00002000:00010000:2.0:1790771166.906334:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1790771166.906340:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.906341:0:13788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.906344:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00010000:00010000:0.0:1790771166.906345:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e4e2 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.906349:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.906354:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771166.906363:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.906370:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771166.906374:0:13788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.906386:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x18:0x0].0x0 since=4s v=(0 0) 00000100:00100000:0.0:1790771166.906396:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00010000:00010000:1.0:1790771166.906397:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.906406:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.906410:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539770752:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1790771166.906419:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539770368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (558us total) trans 4294967625 rc 0/0 00010000:00010000:3.0:1790771166.906421:0:13796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1790771166.906428:0:13793:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:25 count 1 00000100:00100000:2.0:1790771166.906441:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00010000:00010000:0.0:1790771166.906444:0:13793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.906445:0:13796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 25 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.906449:0:13788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 26 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.906474:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967594 gen 2 00010000:00010000:0.0:1790771166.906476:0:13793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906482:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539771008:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.906483:0:13788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906511:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x19:0x0].0x0 since=2s v=(5 2) 00010000:00010000:0.0:1790771166.906514:0:13793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(6 2) 00010000:00010000:0.0:1790771166.906518:0:13793:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.906519:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05a0dc00, transno 4294967586 00000004:00080000:2.0:1790771166.906536:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05a0d180, transno 4294967587 00000100:00100000:1.0:1790771166.906541:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539771136:192.168.204.50@tcp:104: 00000004:00080000:2.0:1790771166.906545:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb05a0df80, transno 4294967588 00010000:00010000:0.0:1790771166.906547:0:13793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.906554:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc08b00700, transno 4294967589 00000100:00100000:3.0:1790771166.906556:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05633600 going to sleep for 11 seconds 00000004:00080000:2.0:1790771166.906561:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb0562e300, transno 4294967592 00010000:00010000:0.0:1790771166.906562:0:13793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771166.906570:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb0562dc00, transno 4294967594 00000100:00100000:1.0:1790771166.906571:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771166.906577:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539771264:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.906584:0:3625:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfc08b03480 x1877759539770368/t4294967625(4294967625) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771182 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790771166.906595:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b03480/2, rc 0, transno 4294967625 00000100:00100000:2.0:1790771166.906604:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770368:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790771166.906605:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63180 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.906620:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539770624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790771166.906633:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:15035:x1877759533996288:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 7710us (7883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.906641:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6330 00000100:00100000:0.0:1790771166.906667:0:7438:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969391 gen 2 00000100:00100000:3.0:1790771166.906671:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1790771166.906674:0:7438:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969391 committed transno 4294969391 00000020:00080000:1.0:1790771166.906681:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 50 00000100:00100000:0.0:1790771166.906697:0:7438:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb049e9500 x1877759539769984/t4294969408(4294969408) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1790771182 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790771166.906701:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539770496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790771166.906713:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770624 00000100:00100000:3.0:1790771166.906718:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770624 00000100:00100000:0.0:1790771166.906722:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb049e9500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539769984:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1790771166.906745:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790771166.906756:0:8669:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 5 changes, 6 in progress, 5 in flight, 6 done 00000100:00100000:3.0:1790771166.906761:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539770496 00000100:00100000:3.0:1790771166.906765:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539770496 00000100:00100000:0.0:1790771166.906772:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1790771166.906775:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539771392:0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1790771166.906783:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3627:x1877759539770624:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790771166.906795:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00002000:00080000:0.0:1790771166.906797:0:8676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:18 count 1 00000100:00100000:1.0:1790771166.906804:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.906809:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539770496:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790771166.906812:0:8676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.906826:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.906833:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06791f80/2, rc 0, transno 4294967637 00010000:00010000:0.0:1790771166.906835:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x12:0x0].0x0 since=1s v=(2 10) 00010000:00010000:0.0:1790771166.906841:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(3 10) 00000100:00100000:1.0:1790771166.906844:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539769600:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771166.906848:0:8676:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906851:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539771392 00000100:00100000:3.0:1790771166.906856:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539771392 00010000:00010000:0.0:1790771166.906885:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906892:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00010000:00010000:0.0:1790771166.906900:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 25 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.906906:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+9:3626:x1877759539771392:12345-0@lo:2:osp-syn-1-1.0 00000100:00100000:0.0:1790771166.906918:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539771520:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.906946:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa630c0 going to sleep for 11 seconds 00002000:00010000:2.0:1790771166.907047:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13255 -> 13255 00002000:00010000:2.0:1790771166.907052:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.907056:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771166.907058:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.907061:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:2.0:1790771166.907109:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3626:x1877759539770496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (365us total) trans 4294967626 rc 0/0 00000100:00100000:2.0:1790771166.907119:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000004:00080000:1.0:1790771166.907140:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b00380/2, rc 0, transno 4294967626 00000100:00100000:1.0:1790771166.907156:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539770496:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790771166.907159:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb size from disk: 28259 -> 28259 00002000:00010000:3.0:1790771166.907163:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb mtime from disk: 1790771164 -> 1790771164 00002000:00010000:3.0:1790771166.907166:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.907168:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.907170:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x9:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:1.0:1790771166.907217:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539771648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771166.907225:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+10:3626:x1877759539771392:12345-0@lo:2:osp-syn-1-1.0 Request processed in 322us (422us total) trans 4294967638 rc 0/0 00000100:00100000:2.0:1790771166.907236:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1790771166.907242:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539771776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790771166.907254:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.907269:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539771904:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790771166.907274:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539772032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790771166.907283:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.907300:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539771648 00000100:00100000:1.0:1790771166.907305:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539771648 00000100:00100000:2.0:1790771166.907319:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771166.907345:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539771776 00000100:00100000:1.0:1790771166.907348:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539771776 00000100:00100000:0.0:1790771166.907354:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539771904 00000100:00100000:0.0:1790771166.907360:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539771904 00000100:00100000:3.0:1790771166.907364:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1790771166.907376:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3627:x1877759539771648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790771166.907380:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:1.0:1790771166.907397:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3624:x1877759539771776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771166.907397:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771166.907403:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1790771166.907414:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3625:x1877759539771904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790771166.907426:0:13787:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:26 count 1 00000004:00080000:2.0:1790771166.907437:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc3fb4dc00/2, rc 0, transno 4294967638 00002000:00010000:0.0:1790771166.907444:0:13787:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x6abcffda, atime: 0x6abcffda, ctime: 0x6abcffda, blocks: 0x0 00010000:00010000:0.0:1790771166.907451:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.907451:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3626:1877759539771392:0@lo:2:osp-syn-1-1.0 00010000:00010000:0.0:1790771166.907465:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=167s v=(0 0) 00010000:00010000:0.0:1790771166.907467:0:13787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790771166.907471:0:13787:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.907478:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539772032 00010000:00010000:0.0:1790771166.907480:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.907514:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.907520:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.907521:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539772032 00010000:00010000:0.0:1790771166.907538:0:13787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790771166.907553:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771166.907561:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.907562:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00010000:00010000:3.0:1790771166.907575:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:2.0:1790771166.907577:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3626:x1877759539772032:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790771166.907582:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.907595:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790771166.907601:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:34 count 1 00010000:00010000:3.0:1790771166.907606:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.907613:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006abb9439/0xfa0c505d97f0e6be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.907621:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3625:x1877759539771904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 204us (300us total) trans 4294967627 rc 0/0 00010000:00010000:2.0:1790771166.907621:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.907631:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771166.907632:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000004:00080000:1.0:1790771166.907632:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb069ab100/2, rc 0, transno 4294967627 00010000:00010000:3.0:1790771166.907635:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.907640:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771166.907647:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539771904:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790771166.907649:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.907677:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=2s v=(1 0) 00010000:00010000:2.0:1790771166.907681:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1790771166.907688:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.907710:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539772160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1790771166.907717:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 25 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.907730:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 25 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.907742:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771166.907749:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539772288:192.168.204.50@tcp:104: 00002000:00010000:3.0:1790771166.907751:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13255 -> 13255 00002000:00010000:3.0:1790771166.907757:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.907759:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771166.907761:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.907763:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 24 -> 24 00000100:00100000:0.0:1790771166.907765:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539772160 00000100:00100000:0.0:1790771166.907769:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539772160 00000100:00100000:0.0:1790771166.907800:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1790771166.907809:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3627:x1877759539772160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790771166.907816:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3627:x1877759539771648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 443us (562us total) trans 4294967628 rc 0/0 00000100:00100000:2.0:1790771166.907819:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.907824:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000004:00080000:3.0:1790771166.907864:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb069a9500/2, rc 0, transno 4294967628 00000100:00100000:3.0:1790771166.907869:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539771648:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790771166.908096:0:13782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 28314 -> 28314 00002000:00010000:0.0:1790771166.908099:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size from disk: 14473 -> 14473 00002000:00010000:2.0:1790771166.908102:0:13782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.908103:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.908111:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771166.908111:0:13782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.908117:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.908119:0:13782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771166.908120:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:2.0:1790771166.908126:0:13782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1790771166.908156:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3627:x1877759539772160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 350us (417us total) trans 4294967630 rc 0/0 00000100:00100000:0.0:1790771166.908162:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000004:00080000:3.0:1790771166.908181:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb069ab800/2, rc 0, transno 4294967630 00000100:00100000:2.0:1790771166.908188:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3624:x1877759539771776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 795us (904us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1790771166.908190:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539772160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1790771166.908204:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb069aad80/2, rc 0, transno 4294967629 00000100:00100000:1.0:1790771166.908211:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539771776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790771166.908211:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1790771166.912981:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.913003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.913021:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004736 00000100:00100000:0.0:1790771166.913026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.913028:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004736 00000100:00100000:1.0:1790771166.913046:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534005120 00000100:00100000:1.0:1790771166.913051:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534005120 00000100:00100000:3.0:1790771166.913058:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534005504 00000100:00100000:3.0:1790771166.913063:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534005504 00000100:00100000:0.0:1790771166.913086:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6352 00000100:00100000:1.0:1790771166.913097:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6353 00000100:00100000:0.0:1790771166.913100:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14715:x1877759534004736:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:2.0:1790771166.913109:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6354 00010000:00010000:0.0:1790771166.913110:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.913113:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14075:x1877759534005120:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.913122:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e6cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362d9 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.913129:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14645:x1877759534005504:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:1.0:1790771166.913132:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.913146:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.913147:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e6d3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362e0 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913160:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e6da lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362e7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913188:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913193:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913199:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913205:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913208:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913214:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913224:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913230:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913232:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913241:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913252:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913253:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913260:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913279:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913282:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913306:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913315:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.913317:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.913327:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913331:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913340:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913347:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.913352:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.913360:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913365:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913367:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913372:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913373:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913385:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913388:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03f72000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.913393:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913400:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913412:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913412:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913436:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913437:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913438:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.913445:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.913450:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913459:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592c00 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:2.0:1790771166.913461:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.913462:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72000/0xfa0c505d97f0e70b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913464:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913476:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913481:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913520:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913524:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913536:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913539:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913549:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.913557:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.913558:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.913561:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913563:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913563:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913584:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.913586:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913588:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e6e1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913590:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913601:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.913608:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.913612:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913616:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913618:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913620:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e6e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913642:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913645:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:0.0:1790771166.913646:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913649:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913669:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.913669:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.913673:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913675:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913677:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913687:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913693:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913702:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e719 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913706:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a02800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.913713:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913714:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfb0321a900) 00010000:00010000:1.0:1790771166.913721:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.913724:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913725:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913725:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913748:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfc113f3f00) 00010000:00010000:1.0:1790771166.913749:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e6ef lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913750:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913754:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.913759:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913780:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e6f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913780:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913790:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e6d3 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362e0 expref: 52 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913806:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913809:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:0.0:1790771166.913811:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e6cc lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362d9 expref: 116 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.913814:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.913822:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e6d3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362e0 expref: 52 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913831:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.913840:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913842:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.913843:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592000, rc 0) 00010000:00010000:0.0:1790771166.913850:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.913857:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.913860:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e6cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362d9 expref: 116 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913876:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.913878:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:14075:x1877759534005120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 770us (873us total) trans 4294968823 rc 301/301 00010000:00010000:0.0:1790771166.913880:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00010000:00010000:2.0:1790771166.913883:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.913890:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.913893:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6353 00010000:00010000:2.0:1790771166.913904:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e6fd lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.913912:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14715:x1877759534004736:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 817us (931us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771166.913918:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.913923:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6352 00010000:00010000:2.0:1790771166.913932:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913940:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913947:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.913951:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913958:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913966:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc34224100) 00010000:00010000:2.0:1790771166.913969:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.913972:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.913979:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e704 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914004:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e6da lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362e7 expref: 50 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914014:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771166.914017:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.914022:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e6da lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362e7 expref: 50 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914031:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00000100:00100000:2.0:1790771166.914068:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14645:x1877759534005504:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 947us (1042us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.914077:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6354 00000100:00100000:0.0:1790771166.914311:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.914330:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.914343:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004352 00000100:00100000:1.0:1790771166.914348:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004352 00000100:00100000:0.0:1790771166.914352:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.914378:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001408 00000100:00100000:0.0:1790771166.914382:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.914383:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001408 00000100:00100000:2.0:1790771166.914389:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6355 00000100:00100000:3.0:1790771166.914390:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004480 00000100:00100000:3.0:1790771166.914397:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004480 00000100:00100000:2.0:1790771166.914406:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14512:x1877759534004352:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:1.0:1790771166.914416:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534000896 00000100:00100000:1.0:1790771166.914420:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534000896 00000100:00100000:0.0:1790771166.914424:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6356 00000100:00100000:0.0:1790771166.914435:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13196:x1877759534001408:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.914440:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:3.0:1790771166.914441:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1657 00010000:00010000:0.0:1790771166.914448:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.914452:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6357 00000100:00100000:3.0:1790771166.914457:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13292:x1877759534004480:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771166.914459:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0e720 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362af expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914466:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9800/0xfa0c505d97eff3a1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30c78 expref: 106 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.914467:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13207:x1877759534000896:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.914507:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.914518:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e727 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362a1 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914523:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3a:0x0].0x0 (ffff8bfb03146800) 00010000:00010000:0.0:1790771166.914540:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914550:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05104600/0xfa0c505d97f07893 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33be9 expref: 107 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.914551:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.914569:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.914570:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914574:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771166.914584:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.914594:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.914599:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.914601:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.914602:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.914603:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.914614:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914632:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 48 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.914635:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.914639:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73200/0xfa0c505d97f0e720 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362af expref: 107 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.914641:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.914668:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 4/0,1 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.914669:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.914673:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362af expref: 106 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.914694:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.914696:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.914698:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f73600, rc 0) 00010000:00010000:1.0:1790771166.914707:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e727 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a1 expref: 107 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.914714:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 48 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.914724:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a1 expref: 106 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.914728:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13196:x1877759534001408:12345-192.168.204.50@tcp:101:ls.0 Request processed in 294us (393us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.914731:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 48 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.914745:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6356 00010000:00010000:1.0:1790771166.914747:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.914753:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.914757:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592400, rc 0) 00000100:00100000:2.0:1790771166.914763:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562d500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539772416:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.914783:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13207:x1877759534000896:12345-192.168.204.50@tcp:101:ls.0 Request processed in 321us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.914784:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.914794:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6357 00000100:00100000:1.0:1790771166.914823:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004864 00000100:00100000:2.0:1790771166.914826:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.914827:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004864 00000100:00100000:1.0:1790771166.914855:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 857 00000100:00100000:1.0:1790771166.914862:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:2396:x1877759534004864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.914870:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.914876:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.914883:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e5ad lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36127 expref: 105 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.914893:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.914896:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.914913:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2396:x1877759534004864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 53us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.914919:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 857 00000100:00100000:1.0:1790771166.914951:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964160 00000100:00100000:1.0:1790771166.914954:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964160 00000100:00100000:0.0:1790771166.914963:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.914988:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6358 00000100:00100000:1.0:1790771166.915002:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13564:x1877759533964160:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.915003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.915013:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.915024:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964288 00010000:00010000:1.0:1790771166.915024:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e743 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 32 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36040 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.915030:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964288 00010000:00010000:1.0:1790771166.915044:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 32 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36040 expref: 147 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915054:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 32 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36040 expref: 147 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.915061:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6359 00010000:00010000:1.0:1790771166.915062:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.915066:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.915072:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13190:x1877759533964288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.915072:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593a00, rc 0) 00010000:00010000:0.0:1790771166.915083:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.915093:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e74a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 33 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36047 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.915109:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e74a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 33 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36047 expref: 148 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.915121:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13564:x1877759533964160:12345-192.168.204.50@tcp:101:ls.0 Request processed in 121us (244us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.915122:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e74a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 33 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36047 expref: 148 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.915138:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771166.915143:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6358 00010000:00010000:0.0:1790771166.915144:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.915149:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03f72e00, rc 0) 00000100:00100000:0.0:1790771166.915171:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13190:x1877759533964288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 102us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.915174:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534005248 00000100:00100000:0.0:1790771166.915179:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6359 00000100:00100000:1.0:1790771166.915181:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534005248 00000100:00100000:1.0:1790771166.915218:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 858 00000100:00100000:1.0:1790771166.915227:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:2399:x1877759534005248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.915233:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.915244:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e5d0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36238 expref: 49 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915252:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.915255:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.915274:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:2399:x1877759534005248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.915281:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 858 00000100:00100000:3.0:1790771166.915510:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.915532:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001792 00000100:00100000:1.0:1790771166.915537:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001792 00000100:00100000:1.0:1790771166.915566:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6360 00000100:00100000:1.0:1790771166.915574:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13284:x1877759534001792:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.915581:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.915590:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e751 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362b6 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915622:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915632:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.915640:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.915645:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.915669:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.915672:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.915680:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915696:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05339000/0xfa0c505d97f0e751 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362b6 expref: 107 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915708:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362b6 expref: 106 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.915714:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.915716:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.915719:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ba00, rc 0) 00000100:00100000:0.0:1790771166.915728:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534005632 00000100:00100000:0.0:1790771166.915733:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534005632 00000100:00100000:3.0:1790771166.915737:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.915753:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13284:x1877759534001792:12345-192.168.204.50@tcp:101:ls.0 Request processed in 179us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.915760:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6360 00000100:00100000:3.0:1790771166.915762:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964416 00000100:00100000:0.0:1790771166.915766:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 859 00000100:00100000:3.0:1790771166.915767:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964416 00000100:00100000:0.0:1790771166.915777:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:2396:x1877759534005632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.915785:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.915797:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e5f3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3624d expref: 106 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.915804:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6361 00010000:00010000:0.0:1790771166.915810:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:2.0:1790771166.915815:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.915816:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.915820:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13553:x1877759533964416:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.915830:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.915841:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e75f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 34 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3604e expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.915842:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006016 00000100:00100000:0.0:1790771166.915848:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:2396:x1877759534005632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.915849:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006016 00000100:00100000:0.0:1790771166.915864:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 859 00000100:00100000:2.0:1790771166.915865:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.915867:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e75f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 34 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3604e expref: 148 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.915877:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1658 00010000:00010000:3.0:1790771166.915882:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e75f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 34 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3604e expref: 148 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.915890:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13882:x1877759534006016:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.915892:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.915897:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.915900:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595a00, rc 0) 00000100:00100000:2.0:1790771166.915911:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.915927:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13553:x1877759533964416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 110us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.915932:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006144 00000100:00100000:3.0:1790771166.915936:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6361 00000100:00100000:0.0:1790771166.915937:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006144 00000100:00100000:3.0:1790771166.915965:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534005760 00000100:00100000:3.0:1790771166.915970:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534005760 00000100:00100000:0.0:1790771166.915971:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1659 00000100:00100000:0.0:1790771166.915980:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:15003:x1877759534006144:12345-192.168.204.50@tcp:35:chmod.0 00000100:00100000:1.0:1790771166.915989:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13882:x1877759534006016:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (181us total) trans 4294968824 rc 0/0 00000100:00100000:1.0:1790771166.915996:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1658 00000100:00100000:3.0:1790771166.916012:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 442 00000100:00100000:3.0:1790771166.916023:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+21:2399:x1877759534005760:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771166.916055:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06793800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0000_UUID:13791:1877759539768960:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771166.916068:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:15003:x1877759534006144:12345-192.168.204.50@tcp:35:chmod.0 Request processed in 88us (159us total) trans 4294969409 rc 0/0 00010000:00010000:1.0:1790771166.916068:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.916077:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1659 00000100:00100000:1.0:1790771166.916099:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759533998208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 15638us (15816us total) trans 0 rc 0/0 00002000:00010000:3.0:1790771166.916101:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 4360 -> 4360 00002000:00010000:3.0:1790771166.916106:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771165 -> 1790771165 00002000:00010000:3.0:1790771166.916111:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.916114:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771165 -> 1790771165 00000100:00100000:1.0:1790771166.916118:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1763 00002000:00010000:3.0:1790771166.916119:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 16 -> 16 00000100:00100000:3.0:1790771166.916146:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2399:x1877759534005760:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 126us (285us total) trans 4294967639 rc 0/0 00000100:00100000:3.0:1790771166.916151:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 442 00000100:00100000:0.0:1790771166.916527:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.916551:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006272 00000100:00100000:2.0:1790771166.916557:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006272 00002000:00010000:2.0:1790771166.916577:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (14368->18446744073709551615) 00002000:00100000:2.0:1790771166.916581:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb55f80 with x1877759534006272 ext(14368->18446744073709551615) 00010000:00010000:2.0:1790771166.916591:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.916606:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.916614:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3fb55f80. 00000100:00100000:2.0:1790771166.916637:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 98 00000100:00100000:2.0:1790771166.916645:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759534006272:12345-192.168.204.50@tcp:10:truncate.0 00002000:00010000:2.0:1790771166.916785:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 9475 -> 14368 00002000:00010000:2.0:1790771166.916790:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.916793:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 1790771165 -> 0 00002000:00010000:2.0:1790771166.916795:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771166.916797:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771166.916833:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759534006272:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 188us (303us total) trans 4294967631 rc 0/0 00000100:00100000:2.0:1790771166.916843:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 98 00002000:00010000:2.0:1790771166.916847:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419264/22 (14368->18446744073709551615) 00002000:00100000:2.0:1790771166.916850:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb55f80 with x1877759534006272 ext(14368->18446744073709551615) 00010000:00010000:2.0:1790771166.916859:0:13794:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 27 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.916876:0:13794:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 27 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771166.916884:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3fb55f80. 00000100:00100000:3.0:1790771166.918292:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.918329:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007168 00000100:00100000:1.0:1790771166.918334:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007168 00000100:00100000:1.0:1790771166.918366:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6362 00000100:00100000:1.0:1790771166.918375:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:11733:x1877759534007168:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:1.0:1790771166.918386:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.918388:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790771166.918403:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0e61d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a8 expref: 115 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918419:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5b:0x0].0x0 (ffff8bfc3607d400) 00010000:00010000:1.0:1790771166.918423:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.918431:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e766 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362f5 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918482:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918512:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918519:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918529:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918534:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918539:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918578:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e77b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x65:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918585:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e77b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918589:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e77b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.918596:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x65:0x0]: returning size 5 00010000:00010000:1.0:1790771166.918630:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918636:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918640:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918644:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918647:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.918664:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918672:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918678:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5b:0x0].0x0 (ffff8bfc3607d400) 00010000:00010000:1.0:1790771166.918680:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.918683:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918688:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e76d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918695:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918699:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918703:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918706:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.918708:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918712:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918716:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5b:0x0].0x9b50d0cc (ffff8bfb0321ac00) 00010000:00010000:1.0:1790771166.918718:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.918720:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918724:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e774 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918746:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e766 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362f5 expref: 117 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918754:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e77b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362f5 expref: 116 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.918759:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x65:0x0].0x0 (ffff8bfb03146600) 00010000:00010000:1.0:1790771166.918760:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.918762:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996e00, rc 0) 00000100:00100000:1.0:1790771166.918789:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:11733:x1877759534007168:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 417us (498us total) trans 4294969410 rc 0/0 00000100:00100000:1.0:1790771166.918794:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6362 00000100:00100000:0.0:1790771166.925912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.925950:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.925960:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006400 00000100:00100000:2.0:1790771166.925967:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006400 00000100:00100000:0.0:1790771166.925985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.925993:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006528 00000100:00100000:1.0:1790771166.925999:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006528 00002000:00100000:2.0:1790771166.926000:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (573440->577535) req@ffff8bfc3fb55180 x1877759534006400/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771166.926013:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb55180 with x1877759534006400 ext(573440->577535) 00002000:00010000:2.0:1790771166.926019:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb55180 00000100:00100000:0.0:1790771166.926029:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.926035:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006784 00000100:00100000:1.0:1790771166.926042:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007424 00000100:00100000:3.0:1790771166.926042:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006784 00000100:00100000:1.0:1790771166.926048:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007424 00000100:00100000:2.0:1790771166.926057:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 443 00000100:00100000:0.0:1790771166.926058:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6363 00000100:00100000:0.0:1790771166.926071:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14508:x1877759534006528:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:2.0:1790771166.926077:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534006400:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771166.926084:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.926091:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6364 00000100:00100000:3.0:1790771166.926091:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1660 00010000:00010000:0.0:1790771166.926095:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 35 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362ee expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926106:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11374c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13742:x1877759534006784:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.926109:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14616:x1877759534007424:12345-192.168.204.50@tcp:55:cp.0 00010000:00010000:0.0:1790771166.926130:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 36 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926139:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926149:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.926150:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.926172:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926182:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.926184:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926202:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926210:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534006400:12345-192.168.204.50@tcp:3:cat.0 Request processed in 137us (297us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.926214:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.926219:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926228:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 443 00000100:00100000:3.0:1790771166.926236:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11374c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13742:x1877759534006784:12345-192.168.204.50@tcp:35:ls.0 Request processed in 132us (248us total) trans 4294968825 rc 0/0 00010000:00010000:1.0:1790771166.926240:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 118 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771166.926245:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (573440->577535) req@ffff8bfc3fb55180 x1877759534006400/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771166.926252:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1660 00010000:00010000:0.0:1790771166.926260:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.926269:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b01500 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539772544:192.168.204.50@tcp:104: 00002000:00100000:2.0:1790771166.926281:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb55180 with x1877759534006400 ext(573440->577535) 00002000:00010000:2.0:1790771166.926291:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb55180 00010000:00010000:0.0:1790771166.926292:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926303:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.926304:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.926320:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.926323:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc113416c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771166.926329:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926332:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007552 00000100:00100000:2.0:1790771166.926339:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007552 00010000:00010000:0.0:1790771166.926340:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926348:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926353:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926362:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.926364:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.926368:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926373:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926382:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.926387:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.926388:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 860 00010000:00010000:0.0:1790771166.926390:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926397:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e790 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926402:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:2398:x1877759534007552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.926406:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964544 00010000:00010000:0.0:1790771166.926409:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926412:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964544 00010000:00010000:2.0:1790771166.926416:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.926418:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926426:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926430:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.926433:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.926437:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e608 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36270 expref: 49 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926440:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926447:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6365 00010000:00010000:0.0:1790771166.926461:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x59d92b11 (ffff8bfc113f3f00) 00010000:00010000:0.0:1790771166.926465:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.926467:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.926469:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.926472:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e79e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.926476:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.926521:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 35 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362ee expref: 119 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926525:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13195:x1877759533964544:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771166.926539:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:2398:x1877759534007552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 138us (232us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.926544:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.926548:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362ee expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926551:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 860 00010000:00010000:0.0:1790771166.926561:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:3.0:1790771166.926561:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e7ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 35 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36055 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926566:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.926570:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1a00, rc 0) 00010000:00010000:3.0:1790771166.926593:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 35 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36055 expref: 150 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.926597:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14508:x1877759534006528:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 528us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.926612:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6363 00010000:00010000:3.0:1790771166.926617:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e7ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 35 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36055 expref: 150 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.926624:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.926631:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.926634:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.926636:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594200, rc 0) 00000100:00100000:3.0:1790771166.926676:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:13195:x1877759533964544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 219us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.926682:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007680 00000100:00100000:3.0:1790771166.926683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6365 00000100:00100000:0.0:1790771166.926690:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007680 00000100:00100000:2.0:1790771166.926706:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.926735:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534001920 00000100:00100000:0.0:1790771166.926736:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 861 00000100:00100000:2.0:1790771166.926742:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534001920 00000100:00100000:0.0:1790771166.926748:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:2399:x1877759534007680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.926757:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.926769:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e624 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36262 expref: 106 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.926783:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:2.0:1790771166.926789:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6366 00010000:00010000:0.0:1790771166.926790:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.926793:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.926806:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13566:x1877759534001920:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.926815:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:2399:x1877759534007680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 68us (200us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.926818:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.926825:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 861 00010000:00010000:2.0:1790771166.926832:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e7b3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362bd expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926854:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.926886:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964672 00010000:00010000:2.0:1790771166.926890:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926891:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964672 00010000:00010000:2.0:1790771166.926905:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.926916:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.926923:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002048 00000100:00100000:3.0:1790771166.926927:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002048 00000004:00200000:2.0:1790771166.926946:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.926952:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.926957:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6367 00000100:00100000:3.0:1790771166.926965:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6368 00000004:00010000:2.0:1790771166.926966:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.926971:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:13282:x1877759533964672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.926989:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.926999:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e7c1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 36 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3605c expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.927004:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e7b3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362bd expref: 107 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.927016:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13569:x1877759534002048:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.927019:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3605c expref: 151 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.927026:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362bd expref: 106 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.927028:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.927034:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3605c expref: 151 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.927039:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e7c8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362c4 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.927044:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.927054:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.927056:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.927060:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.927060:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82800, rc 0) 00010000:00010000:0.0:1790771166.927062:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00000100:00100000:0.0:1790771166.927092:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13282:x1877759533964672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 128us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.927094:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.927102:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13566:x1877759534001920:12345-192.168.204.50@tcp:101:ls.0 Request processed in 298us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.927103:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6367 00010000:00010000:3.0:1790771166.927116:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.927119:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6366 00010000:00010000:3.0:1790771166.927130:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.927147:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.927152:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.927166:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.927173:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13292:x1877759534004480:12345-192.168.204.50@tcp:37:ls.0 Request processed in 12718us (12819us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.927183:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1657 00010000:00010000:3.0:1790771166.927200:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e7c8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362c4 expref: 106 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.927275:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362c4 expref: 105 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.927285:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771166.927287:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.927289:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595200, rc 0) 00000100:00100000:3.0:1790771166.927347:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:13569:x1877759534002048:12345-192.168.204.50@tcp:101:ls.0 Request processed in 374us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.927352:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6368 00000100:00100000:0.0:1790771166.928288:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.928309:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.928325:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002304 00000100:00100000:1.0:1790771166.928331:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002304 00000100:00100000:3.0:1790771166.928335:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002816 00000100:00100000:3.0:1790771166.928341:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002816 00000100:00100000:1.0:1790771166.928365:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6369 00000100:00100000:1.0:1790771166.928378:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:11804:x1877759534002304:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:3.0:1790771166.928380:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6370 00010000:00010000:1.0:1790771166.928394:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.928394:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:11864:x1877759534002816:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.928406:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.928411:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e7d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36143 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928415:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e7dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3614a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928504:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e7eb lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928514:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e7eb lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.928519:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e7e4 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928525:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e7eb lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.928535:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e7e4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.928539:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.928553:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e7e4 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.928564:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.928602:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e7dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3614a expref: 111 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928618:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e7eb lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3614a expref: 110 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.928624:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.928627:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771166.928629:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594800, rc 0) 00010000:00010000:1.0:1790771166.928634:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e7d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36143 expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.928666:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e7e4 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36143 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.928674:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:3.0:1790771166.928675:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:11864:x1877759534002816:12345-192.168.204.50@tcp:101:ls.0 Request processed in 282us (360us total) trans 4294968826 rc 0/0 00010000:00010000:1.0:1790771166.928681:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.928684:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592a00, rc 0) 00000100:00100000:3.0:1790771166.928688:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6370 00000100:00100000:1.0:1790771166.928712:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:11804:x1877759534002304:12345-192.168.204.50@tcp:101:ls.0 Request processed in 339us (423us total) trans 4294968827 rc 0/0 00000100:00100000:1.0:1790771166.928719:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6369 00000100:00100000:3.0:1790771166.929862:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.929893:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007808 00000100:00100000:1.0:1790771166.929898:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007808 00000100:00100000:3.0:1790771166.929903:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.929938:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964800 00000100:00100000:2.0:1790771166.929941:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539769088:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.929946:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964800 00000100:00100000:1.0:1790771166.929947:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 862 00000100:00100000:1.0:1790771166.929959:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2396:x1877759534007808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.929967:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.929981:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e639 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36269 expref: 109 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.929994:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:0.0:1790771166.929998:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6371 00010000:00010000:1.0:1790771166.929999:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.930013:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:13206:x1877759533964800:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.930025:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.930031:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:2396:x1877759534007808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (168us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.930036:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39c00/0xfa0c505d97f0e800 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 37 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36063 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.930039:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 862 00010000:00010000:0.0:1790771166.930063:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39c00/0xfa0c505d97f0e800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36063 expref: 152 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.930075:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39c00/0xfa0c505d97f0e800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36063 expref: 152 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.930082:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.930085:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.930087:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c39c00, rc 0) 00000100:00100000:0.0:1790771166.930114:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:13206:x1877759533964800:12345-192.168.204.50@tcp:101:ls.0 Request processed in 105us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.930119:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6371 00000100:00100000:0.0:1790771166.935874:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.935959:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534002944 00000100:00100000:1.0:1790771166.935965:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534002944 00000100:00100000:1.0:1790771166.935996:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6372 00000100:00100000:1.0:1790771166.936002:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:11955:x1877759534002944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.936011:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.936020:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e807 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3616d expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.936066:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e80e lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.936074:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e80e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.936081:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e80e lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.936087:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.936134:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e807 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3616d expref: 111 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.936146:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e80e lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3616d expref: 110 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.936151:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.936153:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771166.936156:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592000, rc 0) 00000100:00100000:1.0:1790771166.936184:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:11955:x1877759534002944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 182us (311us total) trans 4294968828 rc 0/0 00000100:00100000:1.0:1790771166.936189:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6372 00000100:00100000:2.0:1790771166.961714:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.961758:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.961780:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534010112 00000100:00100000:1.0:1790771166.961789:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534010112 00000100:00100000:0.0:1790771166.961795:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.961830:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.961839:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003072 00000100:00100000:1.0:1790771166.961843:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003072 00000100:00100000:2.0:1790771166.961847:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533964928 00000100:00100000:2.0:1790771166.961855:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533964928 00000100:00100000:0.0:1790771166.961861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.961878:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6373 00000100:00100000:1.0:1790771166.961892:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:14073:x1877759534010112:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.961893:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.961910:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6374 00000100:00100000:0.0:1790771166.961919:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534007936 00010000:00010000:1.0:1790771166.961922:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.961926:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534007936 00000100:00100000:2.0:1790771166.961926:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14582:x1877759534003072:12345-192.168.204.50@tcp:101:touch.0 00000100:00100000:3.0:1790771166.961939:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6375 00010000:00010000:1.0:1790771166.961942:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e81c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36303 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.961942:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.961955:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:13286:x1877759533964928:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771166.961956:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 118 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.961963:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e823 lrc: 2/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3613c expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.961970:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.961983:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008064 00010000:00010000:3.0:1790771166.961986:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e82a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 38 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3606a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.961987:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008064 00000100:00100000:0.0:1790771166.962006:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008192 00010000:00010000:1.0:1790771166.962009:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962010:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008192 00010000:00010000:3.0:1790771166.962014:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 38 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3606a expref: 153 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962031:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1765 00010000:00010000:1.0:1790771166.962036:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962042:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e82a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 38 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3606a expref: 153 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962043:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759534007936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.962057:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962059:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771166.962061:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.962061:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962068:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.962075:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595600, rc 0) 00010000:00010000:0.0:1790771166.962076:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 118 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962084:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962099:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962101:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962103:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 118 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962119:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962134:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962137:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962144:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0e472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36200 expref: 118 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962164:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962173:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:2.0:1790771166.962176:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962180:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962193:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962200:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:13286:x1877759533964928:12345-192.168.204.50@tcp:101:ls.0 Request processed in 246us (402us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.962201:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.962212:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6375 00000100:00100000:0.0:1790771166.962229:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534007936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 188us (396us total) trans 0 rc 0/0 00000004:00200000:1.0:1790771166.962235:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.962241:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1765 00000100:00100000:0.0:1790771166.962264:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 863 00000100:00100000:0.0:1790771166.962276:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2396:x1877759534008064:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.962286:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.962300:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0e66a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36293 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962307:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962310:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.962317:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.962326:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962334:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962342:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2396:x1877759534008064:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 71us (482us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.962346:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962353:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 863 00000100:00100000:3.0:1790771166.962354:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.962363:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.962367:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962376:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962388:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.962391:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.962396:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962404:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0e831 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962410:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008320 00000100:00100000:0.0:1790771166.962414:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008320 00010000:00010000:1.0:1790771166.962422:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962426:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 864 00010000:00010000:0.0:1790771166.962429:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 117 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962443:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2399:x1877759534008192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.962456:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962459:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.962461:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962467:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1766 00010000:00010000:1.0:1790771166.962472:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.962474:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594000/0xfa0c505d97f0e671 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3628c expref: 111 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962476:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962482:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534008320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00080000:2.0:1790771166.962528:0:13772:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x19:0x0], index 1: 0 00010000:00010000:1.0:1790771166.962529:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962531:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.962534:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.962540:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 117 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962544:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.962552:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfb0321a900) 00010000:00010000:0.0:1790771166.962557:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 117 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962558:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.962563:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962570:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0e83f lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962574:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00000100:00100000:3.0:1790771166.962578:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2399:x1877759534008192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 137us (685us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.962580:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962594:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962594:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 864 00010000:00010000:0.0:1790771166.962603:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962616:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e81c lrc: 1/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36303 expref: 50 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962617:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.962633:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771166.962637:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.962642:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0e81c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36303 expref: 50 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962646:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534008320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.962679:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.962682:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1766 00010000:00010000:1.0:1790771166.962690:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00010000:00010000:2.0:1790771166.962692:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e854 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962706:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e854 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962716:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e854 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.962721:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14073:x1877759534010112:12345-192.168.204.50@tcp:101:ls.0 Request processed in 833us (1013us total) trans 4294968829 rc 301/301 00000100:00100000:1.0:1790771166.962733:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6373 00000100:00100000:3.0:1790771166.962740:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.962749:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.962753:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533966208 00000100:00100000:1.0:1790771166.962758:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533966208 00000100:00100000:3.0:1790771166.962763:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008448 00000100:00100000:3.0:1790771166.962769:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008448 00010000:00010000:2.0:1790771166.962770:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962780:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962787:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962794:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.962795:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6376 00010000:00010000:2.0:1790771166.962801:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.962811:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:14567:x1877759533966208:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:2.0:1790771166.962814:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962815:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 865 00000100:00100000:0.0:1790771166.962822:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.962828:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.962833:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2399:x1877759534008448:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.962839:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc34224100) 00010000:00010000:3.0:1790771166.962843:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.962844:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e862 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 39 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3608d expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962844:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.962852:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962860:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0e686 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3629a expref: 111 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962861:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e838 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.962881:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 40 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.962890:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000461b7d8d reply state 00000000070dfd17 transno 4294968830 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962900:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.962901:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.962902:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.962909:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.962915:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008576 00000100:00100000:0.0:1790771166.962919:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008576 00010000:00010000:1.0:1790771166.962922:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962923:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.962933:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 117 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962950:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0xd6e9df9d (ffff8bfc34224d00) 00010000:00010000:1.0:1790771166.962952:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.962958:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008704 00010000:00010000:2.0:1790771166.962958:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.962964:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008704 00000100:00100000:2.0:1790771166.962966:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.962971:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962973:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2399:x1877759534008448:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 145us (234us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.962980:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.962995:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 865 00010000:00010000:1.0:1790771166.962999:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.962999:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0e823 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3613c expref: 111 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963011:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1767 00000100:00100000:0.0:1790771166.963028:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534008576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.963028:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1768 00010000:00010000:2.0:1790771166.963036:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e854 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3613c expref: 109 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963040:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.963041:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963044:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759534008704:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.963050:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 117 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963062:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.963063:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xad:0x0].0x0 (ffff8bfc34224300) 00010000:00010000:1.0:1790771166.963065:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.963071:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.963077:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963079:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 117 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.963079:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00010000:00010000:1.0:1790771166.963081:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963108:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963111:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00010000:00010000:3.0:1790771166.963113:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963116:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14582:x1877759534003072:12345-192.168.204.50@tcp:101:touch.0 Request processed in 1194us (1355us total) trans 4294968830 rc 0/0 00010000:00010000:0.0:1790771166.963123:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963130:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.963138:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963140:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6374 00010000:00010000:0.0:1790771166.963148:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963154:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963158:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790771166.963160:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963167:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771166.963168:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.963175:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.963178:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963179:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963183:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.963199:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39e00/0xfa0c505d97f08f45 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34256 expref: 117 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963200:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0e869 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963202:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963212:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534008576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (393us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.963225:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963235:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1767 00010000:00010000:1.0:1790771166.963238:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963240:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539769216:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.963245:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.963253:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963258:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.963261:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963266:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963273:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759534008704:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 233us (376us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.963275:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfb0321ac00) 00010000:00010000:2.0:1790771166.963278:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963282:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.963287:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963288:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1768 00010000:00010000:1.0:1790771166.963302:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0e870 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.963306:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.963315:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963329:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.963336:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e862 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3608d expref: 154 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963336:0:13796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edc2aac9/0xfa0c505d97f099a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34757 expref: 25 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963346:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008832 00000100:00100000:0.0:1790771166.963351:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008832 00010000:00010000:1.0:1790771166.963361:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.963365:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.963367:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539771008:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.963370:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 27 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963375:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e862 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3608d expref: 154 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963384:0:13796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963394:0:13796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963396:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00000100:00100000:0.0:1790771166.963401:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1769 00010000:00010000:3.0:1790771166.963408:0:13796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.963413:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f5db3236 reply state 00000000b0e6d872 transno 4294969411 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963414:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759534008832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.963423:0:13796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963427:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.963433:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:14567:x1877759533966208:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 624us (755us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771166.963436:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 27 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963451:0:13796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.963457:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.963468:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6376 00010000:00010000:0.0:1790771166.963470:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 27 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963510:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790771166.963512:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771166.963514:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771166.963514:0:13796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771166.963519:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.963521:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771166.963525:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963527:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963527:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.963555:0:13791:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963556:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595e00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771166.963564:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963569:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:14692:x1877759534003328:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 60590us (60945us total) trans 4294969411 rc 0/0 00010000:00010000:0.0:1790771166.963571:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.963588:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963589:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6348 00000100:00100000:0.0:1790771166.963597:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2396:x1877759534008832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 184us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.963611:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1769 00010000:00010000:1.0:1790771166.963618:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963628:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8a79c7e/0xfa0c505d97f0e6a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963668:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3625:x1877759539770880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57465us (57733us total) trans 4294967632 rc 0/0 00010000:00010000:1.0:1790771166.963670:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.963675:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790771166.963679:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00010000:00010000:1.0:1790771166.963681:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771166.963687:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.963714:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539771264:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.963733:0:13793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963739:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f028b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f56 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771166.963741:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b01880/2, rc 0, transno 4294967632 00000100:00100000:2.0:1790771166.963749:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.963751:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790771166.963755:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533967104 00000100:00100000:0.0:1790771166.963761:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533967104 00000100:00100000:1.0:1790771166.963774:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539771136:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.963780:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534008960 00000100:00100000:2.0:1790771166.963786:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534008960 00010000:00010000:1.0:1790771166.963791:0:13788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963796:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6377 00010000:00010000:1.0:1790771166.963806:0:13788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.963813:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:14893:x1877759533967104:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:0.0:1790771166.963814:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6378 00010000:00010000:1.0:1790771166.963823:0:13788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.963830:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:15069:x1877759534008960:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771166.963830:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.963836:0:13788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963843:0:13788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963844:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e877 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 39 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f1a expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963845:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.963857:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0e87e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362fc expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.963867:0:13788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790771166.963887:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.963890:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963900:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963907:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963923:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.963927:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.963935:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963942:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963953:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e88c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.963964:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e88c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.963966:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3625:x1877759539770240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57659us (57982us total) trans 4294967633 rc 0/0 00000100:00100000:2.0:1790771166.963977:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.963979:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e88c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.963983:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.963984:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000004:00200000:3.0:1790771166.964002:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00010000:00010000:0.0:1790771166.964003:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964007:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.964017:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964018:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964039:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.964040:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771166.964046:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.964053:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x3e:0x0]: returning size 0 00010000:00010000:1.0:1790771166.964054:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.964058:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771166.964064:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003840 00010000:00010000:3.0:1790771166.964065:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0e877 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 39 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f1a expref: 157 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964071:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003840 00010000:00010000:1.0:1790771166.964072:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.964073:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964082:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a02800/0xfa0c505d97f0e88c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f1a expref: 156 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964095:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964096:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000157b5d7f/0xfa0c505d97f0e6a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964098:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:2.0:1790771166.964102:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533971456 00000100:00100000:2.0:1790771166.964109:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533971456 00010000:00010000:3.0:1790771166.964109:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790771166.964117:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964117:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03a02800, rc 0) 00010000:00010000:0.0:1790771166.964127:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964128:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.964133:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771166.964137:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006656 00010000:00010000:1.0:1790771166.964138:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.964139:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964144:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006656 00010000:00010000:0.0:1790771166.964149:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.964153:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+157:14893:x1877759533967104:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 344us (468us total) trans 4294969412 rc 0/0 00010000:00010000:1.0:1790771166.964163:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0a708 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b9b expref: 117 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964164:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c38c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.964172:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964176:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6379 00000100:00100000:3.0:1790771166.964190:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6377 00000100:00100000:1.0:1790771166.964193:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f918000 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539770112:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771166.964194:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964194:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:15026:x1877759534003840:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.964211:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964213:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.964214:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.964223:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.964224:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6380 00010000:00010000:2.0:1790771166.964226:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e8a8 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3617b expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964229:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964230:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.964242:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc34323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+156:13293:x1877759533971456:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.964249:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964256:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38c00/0xfa0c505d97f0e885 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964261:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.964273:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e8af lrc: 2/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f59 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964283:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964289:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964294:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964298:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.964301:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964306:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964313:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x7a94fdef (ffff8bfc113f3f00) 00010000:00010000:0.0:1790771166.964315:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.964316:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964318:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964331:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e8bd lrc: 3/1,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964336:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0e893 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964337:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964361:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e8bd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964361:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964375:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c38800/0xfa0c505d97f0e87e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362fc expref: 117 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964389:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e8bd lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964392:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964395:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362fc expref: 116 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.964416:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790771166.964417:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3e:0x0].0x0 (ffff8bfc20109600) 00010000:00010000:3.0:1790771166.964417:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.964418:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7c:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.964424:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.964429:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00010000:00010000:3.0:1790771166.964433:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964436:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964447:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.964453:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:15069:x1877759534008960:12345-192.168.204.50@tcp:101:rm.0 Request processed in 626us (710us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.964455:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964463:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.964464:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6378 00010000:00010000:1.0:1790771166.964467:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964474:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.964507:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6381 00010000:00010000:1.0:1790771166.964511:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7c:0x0].0x0 (ffff8bfb0321a300) 00000004:00200000:3.0:1790771166.964514:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x5b:0x0]: returning size 4096 00010000:00010000:2.0:1790771166.964515:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0e8a8 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3617b expref: 114 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964516:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1790771166.964520:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12238:x1877759534006656:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.964522:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964535:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.964539:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0e69b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x7c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964550:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0e8d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36197 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964553:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57600/0xfa0c505d97f0e8bd lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3617b expref: 113 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964562:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964564:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964573:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:1.0:1790771166.964580:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964583:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1790771166.964586:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.964589:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57600, rc 0) 00010000:00010000:0.0:1790771166.964593:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0e8e0 lrc: 3/1,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964598:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964609:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964616:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0e8e0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964619:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.964623:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:15026:x1877759534003840:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 430us (733us total) trans 4294968831 rc 0/0 00010000:00010000:1.0:1790771166.964626:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964633:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964639:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0e8e0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964662:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6379 00010000:00010000:3.0:1790771166.964670:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.964677:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.964679:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.964680:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964692:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964697:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:1.0:1790771166.964701:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.964704:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771166.964705:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964711:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.964719:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0e5a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964719:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964727:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.964736:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0e8d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36197 expref: 115 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964742:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0e8b6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.964746:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000016ebc55d reply state 0000000065588d2f transno 4294969413 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964760:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0e8e0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36197 expref: 114 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964760:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964761:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.964782:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfb0321a800) 00010000:00010000:3.0:1790771166.964786:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.964787:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:1.0:1790771166.964787:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.964792:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.964795:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771166.964799:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1800, rc 0) 00010000:00010000:3.0:1790771166.964801:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964807:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04ee1000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.964810:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964815:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.964821:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:12238:x1877759534006656:12345-192.168.204.50@tcp:101:ls.0 Request processed in 305us (785us total) trans 4294968832 rc 0/0 00010000:00010000:3.0:1790771166.964826:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x9b50d0cc (ffff8bfb02b20e00) 00000100:00100000:1.0:1790771166.964828:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+160:14432:x1877759533996416:12345-192.168.204.50@tcp:36:rm.0 Request processed in 65816us (66056us total) trans 4294969413 rc 0/0 00000100:00100000:0.0:1790771166.964831:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6381 00000100:00100000:2.0:1790771166.964834:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539772288:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.964834:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.964840:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.964848:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6331 00000100:00100000:0.0:1790771166.964850:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013696 00010000:00010000:3.0:1790771166.964852:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0e8c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.964855:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013696 00010000:00010000:2.0:1790771166.964862:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.964880:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6382 00000100:00100000:1.0:1790771166.964894:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13735:x1877759534013696:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.964895:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e8af lrc: 1/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f59 expref: 159 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.964906:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.964907:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:3.0:1790771166.964912:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:0.0:1790771166.964913:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539771520:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771166.964918:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e8ee lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361c1 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964921:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0e8af lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f59 expref: 159 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.964929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.964931:0:8676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.964948:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0800, rc 0) 00000100:00100000:2.0:1790771166.964964:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.964973:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc34323850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+158:13293:x1877759533971456:12345-192.168.204.50@tcp:101:ls.0 Request processed in 738us (1002us total) trans 4294969414 rc 301/301 00000100:00100000:3.0:1790771166.964980:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6380 00000100:00100000:0.0:1790771166.964981:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534009088 00000100:00100000:0.0:1790771166.964986:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534009088 00010000:00010000:1.0:1790771166.965006:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965009:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 25 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.965011:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00080000:3.0:1790771166.965021:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb05c33480/2, rc 0, transno 4294967633 00010000:00010000:1.0:1790771166.965029:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.965030:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05c33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770240:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790771166.965043:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965050:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534009344 00000100:00100000:0.0:1790771166.965054:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534009344 00000100:00100000:2.0:1790771166.965055:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.965058:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965065:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965068:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965077:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.965079:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534010368 00000100:00100000:2.0:1790771166.965087:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534010368 00000100:00100000:0.0:1790771166.965093:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534009472 00000100:00100000:0.0:1790771166.965098:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534009472 00000100:00100000:3.0:1790771166.965098:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1770 00000100:00100000:3.0:1790771166.965113:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759534009088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.965115:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 27 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.965125:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:2.0:1790771166.965129:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6383 00010000:00010000:3.0:1790771166.965129:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.965141:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 27 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965147:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1771 00000100:00100000:2.0:1790771166.965148:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14646:x1877759534010368:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:1.0:1790771166.965159:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965167:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759534009344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.965170:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 27 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965173:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965184:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.965194:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965196:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965208:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015ad251/0xfa0c505d97f0a58e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10289152->10354687) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34b08 expref: 27 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965210:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.965216:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965224:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 27 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.965240:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14646:x1877759534010368:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 95us (185us total) trans 0 rc -17/-17 00010000:00010000:3.0:1790771166.965244:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(6 2) 00010000:00010000:1.0:1790771166.965249:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965255:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(6 2) 00000100:00100000:2.0:1790771166.965264:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6383 00010000:00010000:3.0:1790771166.965268:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965269:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3046edd/0xfa0c505d97f0b9bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 16384->24575) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352d3 expref: 26 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965270:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.965278:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.965283:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965294:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965297:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0e8f5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965299:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(3 10) 00010000:00010000:0.0:1790771166.965311:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(3 10) 00000100:00100000:2.0:1790771166.965314:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.965321:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965324:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965325:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.965331:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965334:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.965339:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534010624 00000100:00100000:2.0:1790771166.965347:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534010624 00000100:00100000:3.0:1790771166.965347:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759534009088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 237us (1420us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.965350:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965359:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.965365:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1770 00010000:00010000:1.0:1790771166.965366:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.965371:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965378:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965384:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759534009344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.965392:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1772 00010000:00010000:1.0:1790771166.965393:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfb0321a400) 00000100:00100000:2.0:1790771166.965395:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6384 00000100:00100000:0.0:1790771166.965403:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1771 00010000:00010000:1.0:1790771166.965403:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.965406:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759534009472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.965411:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.965415:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14668:x1877759534010624:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771166.965428:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534009600 00010000:00010000:3.0:1790771166.965428:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.965431:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.965434:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534009600 00010000:00010000:1.0:1790771166.965441:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0e8fc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965441:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 23 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965450:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e90a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3630a expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965463:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1047 00010000:00010000:3.0:1790771166.965472:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 23 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965477:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2398:x1877759534009600:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:1.0:1790771166.965506:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e8ee lrc: 1/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361c1 expref: 116 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965523:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771166.965525:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.965534:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0e8ee lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361c1 expref: 116 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965535:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3a78ada/0xfa0c505d97f0a094 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->16383) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34995 expref: 23 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965541:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2398:x1877759534009600:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 66us (576us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.965551:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:2.0:1790771166.965556:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965558:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1047 00010000:00010000:3.0:1790771166.965570:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1790771166.965574:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965576:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(2 0) 00000100:00100000:1.0:1790771166.965577:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13735:x1877759534013696:12345-192.168.204.50@tcp:101:ls.0 Request processed in 686us (809us total) trans 4294968833 rc 301/301 00010000:00010000:0.0:1790771166.965581:0:13793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965587:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965598:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6382 00010000:00010000:0.0:1790771166.965608:0:13793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965618:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965623:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965624:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534009856 00000100:00100000:1.0:1790771166.965630:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534009856 00010000:00010000:0.0:1790771166.965646:0:13793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965669:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1661 00010000:00010000:0.0:1790771166.965670:0:13793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965673:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965673:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.965680:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14075:x1877759534009856:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.965694:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2397:x1877759534009472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 290us (771us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.965700:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.965701:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1772 00010000:00010000:0.0:1790771166.965707:0:13793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.965716:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965763:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0e91f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965774:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0e91f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965777:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:14075:x1877759534009856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 100us (771us total) trans 4294968834 rc 0/0 00000100:00100000:1.0:1790771166.965790:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1661 00010000:00010000:2.0:1790771166.965794:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0e91f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.965804:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2c:0x0]: returning size 33196 00010000:00010000:1.0:1790771166.965808:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1790771166.965810:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3625:x1877759539770752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59402us (59766us total) trans 4294967634 rc 0/0 00010000:00010000:1.0:1790771166.965814:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.965819:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00010000:00010000:1.0:1790771166.965832:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771166.965835:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965841:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965846:0:8676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965850:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965852:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965857:0:8676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965879:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.965879:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.965882:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b93aab5/0xfa0c505d97f0e6b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965884:0:8676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965905:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.965909:0:8676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.965913:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.965917:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.965920:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.965927:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771166.965933:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534010752 00010000:00010000:2.0:1790771166.965933:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965938:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534010752 00010000:00010000:0.0:1790771166.965941:0:8676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.965945:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.965959:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.965962:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.965968:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965974:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 866 00010000:00010000:3.0:1790771166.965977:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.965981:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0e911 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.965984:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.965988:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2399:x1877759534010752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.966001:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.966008:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.966016:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592400/0xfa0c505d97f0e735 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362a1 expref: 115 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.966017:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3627:x1877759539770624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 59234us (59345us total) trans 4294967635 rc 0/0 00010000:00010000:2.0:1790771166.966024:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.966050:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00010000:00010000:1.0:1790771166.966050:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771166.966053:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.966059:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.966062:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f200 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:3.0:1790771166.966068:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966070:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.966078:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.966080:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2399:x1877759534010752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.966082:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.966099:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 866 00010000:00010000:2.0:1790771166.966103:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.966116:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966120:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc34224200) 00010000:00010000:2.0:1790771166.966128:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.966133:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce9bdbb7/0xfa0c505d97f0e6b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966135:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966155:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0e918 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771166.966167:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b01c00/2, rc 0, transno 4294967634 00000100:00100000:1.0:1790771166.966173:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539770752:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790771166.966175:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.966180:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771166.966183:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771166.966200:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0e90a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3630a expref: 119 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.966211:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfc08b02a00/2, rc 0, transno 4294967635 00000100:00100000:0.0:1790771166.966219:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3627:1877759539770624:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790771166.966220:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0e91f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3630a expref: 118 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966232:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771166.966235:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.966238:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4600, rc 0) 00010000:00010000:0.0:1790771166.966260:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.966266:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14668:x1877759534010624:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 856us (956us total) trans 4294969415 rc 0/0 00010000:00010000:0.0:1790771166.966280:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.966286:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6384 00000100:00100000:1.0:1790771166.966294:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.966297:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966305:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966318:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790771166.966338:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.966338:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562d500 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0001_UUID:13762:1877759539772416:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.966362:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.966381:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534010880 00000100:00100000:3.0:1790771166.966386:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534010880 00000100:00100000:2.0:1790771166.966388:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534003712 00000100:00100000:1.0:1790771166.966393:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.966395:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534003712 00000100:00100000:0.0:1790771166.966403:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3626:x1877759539772032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 58830us (59010us total) trans 4294967636 rc 0/0 00000100:00100000:0.0:1790771166.966410:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1790771166.966435:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6385 00000004:00080000:0.0:1790771166.966443:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb069abb80/2, rc 0, transno 4294967636 00000100:00100000:2.0:1790771166.966449:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:13565:x1877759534003712:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.966450:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539772032:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1790771166.966461:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 50 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966464:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.966473:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.966474:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771166.966479:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0e92d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362cb expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966481:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966534:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:1.0:1790771166.966538:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.966540:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966547:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966559:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966565:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c5142a2/0xfa0c505d97f0e6c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966577:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.966578:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.966580:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771166.966590:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011008 00010000:00010000:2.0:1790771166.966592:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.966594:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011008 00000100:00100000:3.0:1790771166.966596:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011136 00000100:00100000:3.0:1790771166.966602:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011136 00000100:00100000:1.0:1790771166.966607:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.966617:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.966626:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1773 00010000:00010000:2.0:1790771166.966632:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.966637:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:2397:x1877759534010880:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.966664:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.966664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.966673:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 50 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.966680:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.966684:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 50 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.966686:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.966703:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0b9fb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e352e8 expref: 50 pid: 7771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.966706:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966717:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00000100:00100000:1.0:1790771166.966719:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.966725:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966733:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966737:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.966744:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0e92d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362cb expref: 118 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966758:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.966765:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362cb expref: 117 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.966772:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 867 00010000:00010000:2.0:1790771166.966775:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:0.0:1790771166.966777:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:2397:x1877759534010880:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 141us (487us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.966784:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771166.966785:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.966788:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2397:x1877759534011008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771166.966791:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5800, rc 0) 00000100:00100000:0.0:1790771166.966796:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1773 00010000:00010000:3.0:1790771166.966799:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.966814:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 868 00000100:00100000:0.0:1790771166.966827:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:2396:x1877759534011136:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.966828:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:13565:x1877759534003712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 378us (489us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.966838:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.966844:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6385 00010000:00010000:3.0:1790771166.966846:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03f73600/0xfa0c505d97f0e72e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362af expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966851:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0e758 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362b6 expref: 117 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.966868:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.966870:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533967744 00010000:00010000:3.0:1790771166.966870:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:2.0:1790771166.966876:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533967744 00010000:00010000:0.0:1790771166.966877:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:3.0:1790771166.966877:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.966883:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.966887:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011904 00000100:00100000:1.0:1790771166.966893:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011904 00000100:00100000:0.0:1790771166.966901:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2396:x1877759534011136:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (365us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.966910:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.966912:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533968512 00000100:00100000:0.0:1790771166.966914:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 868 00000100:00100000:2.0:1790771166.966919:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533968512 00000100:00100000:3.0:1790771166.966928:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759534011008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 143us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.966935:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 867 00010000:00010000:0.0:1790771166.966942:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.966948:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.966952:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1774 00000100:00100000:2.0:1790771166.966960:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011776 00000100:00100000:1.0:1790771166.966966:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759534011904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771166.966967:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011776 00010000:00010000:0.0:1790771166.966968:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: --/PW res: [0x240000402:0x37:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.966975:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011392 00010000:00010000:1.0:1790771166.966976:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.966978:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.966980:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011392 00010000:00010000:0.0:1790771166.966989:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.966994:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.967007:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6386 00000100:00100000:3.0:1790771166.967009:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534011648 00010000:00010000:1.0:1790771166.967015:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967015:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534011648 00000100:00100000:2.0:1790771166.967025:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+160:14974:x1877759533967744:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.967032:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006aad3d5/0xfa0c505d97f0e1a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360b7 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967037:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967037:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.967043:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(6 0) 00000100:00100000:3.0:1790771166.967043:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1662 00010000:00010000:2.0:1790771166.967051:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0e949 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 39 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36094 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967053:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(6 0) 00010000:00010000:0.0:1790771166.967055:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967058:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13885:x1877759534011392:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.967068:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361cf expref: 21 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967078:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967090:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361cf expref: 21 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967094:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0e949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36094 expref: 161 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967112:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0e949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36094 expref: 161 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967123:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d9660b5/0xfa0c505d97f0e3a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->57343) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361cf expref: 21 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967123:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.967131:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.967137:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5200, rc 0) 00000100:00100000:1.0:1790771166.967142:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f919f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539772672:192.168.204.50@tcp:105: 00000100:00100000:2.0:1790771166.967160:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+161:14974:x1877759533967744:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 139us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.967171:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6386 00000100:00100000:3.0:1790771166.967173:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:13885:x1877759534011392:12345-192.168.204.50@tcp:35:ls.0 Request processed in 116us (523us total) trans 4294968835 rc 0/0 00000100:00100000:3.0:1790771166.967181:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1662 00000100:00100000:2.0:1790771166.967198:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6387 00000100:00100000:1.0:1790771166.967203:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.967211:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1663 00000100:00100000:2.0:1790771166.967212:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+160:14680:x1877759533968512:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771166.967225:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000040:00080000:0.0:1790771166.967228:0:13762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9800 00000100:00100000:3.0:1790771166.967229:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+160:12253:x1877759534011648:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771166.967238:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0e950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3609b expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967256:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.967278:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967283:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967287:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967302:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.967302:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967316:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967321:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967323:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+162:12253:x1877759534011648:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (606us total) trans 4294969416 rc 0/0 00010000:00010000:0.0:1790771166.967333:0:13762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967342:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1663 00010000:00010000:0.0:1790771166.967350:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967355:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967357:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967359:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b01500 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539772544:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.967369:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012160 00000100:00100000:3.0:1790771166.967375:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012160 00010000:00010000:0.0:1790771166.967380:0:13762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771166.967380:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967384:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967392:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967399:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967401:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6388 00010000:00010000:0.0:1790771166.967413:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967415:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14785:x1877759534011776:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:0.0:1790771166.967433:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967434:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.967441:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967442:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.967447:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967451:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:0.0:1790771166.967455:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967456:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967459:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967470:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3a:0x0].0x0 (ffff8bfc113f3300) 00000100:00100000:3.0:1790771166.967475:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14785:x1877759534011776:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 61us (694us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.967478:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771166.967502:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967505:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967513:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967515:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0e942 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967517:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3a:0x0].0x0 (ffff8bfc113f3300) 00000100:00100000:3.0:1790771166.967518:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6388 00010000:00010000:1.0:1790771166.967526:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771166.967531:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.967540:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03600/0xfa0c505d97f0e957 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967542:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967545:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.967549:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6389 00010000:00010000:1.0:1790771166.967553:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.967556:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.967560:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.967565:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967571:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967576:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c73200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.967579:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967584:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.967586:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 38336 00000004:00200000:2.0:1790771166.967593:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.967594:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771166.967600:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.967601:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.967605:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 2/0,0 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.967608:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967612:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c73200/0xfa0c505d97f0e73c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967621:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012416 00000100:00100000:1.0:1790771166.967627:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012416 00000004:00010000:0.0:1790771166.967631:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000098d1e1fd reply state 000000001b55f580 transno 4294968836 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967639:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.967646:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967669:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967670:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1664 00010000:00010000:0.0:1790771166.967672:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x84832a57 (ffff8bfc113f3000) 00010000:00010000:0.0:1790771166.967680:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.967683:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:11733:x1877759534012160:12345-192.168.204.50@tcp:36:dir_create.sh.0 00000100:00100000:1.0:1790771166.967684:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:11438:x1877759534012416:12345-192.168.204.50@tcp:35:dir_create.sh.0 00000100:00100000:0.0:1790771166.967685:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.967695:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967702:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967711:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.967714:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14512:x1877759534004352:12345-192.168.204.50@tcp:36:rm.0 Request processed in 53314us (53400us total) trans 4294968836 rc 0/0 00010000:00010000:2.0:1790771166.967729:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771166.967730:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6355 00010000:00010000:2.0:1790771166.967737:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967744:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.967746:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.967754:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012288 00000100:00100000:0.0:1790771166.967758:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012288 00010000:00010000:2.0:1790771166.967760:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.967765:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0e77b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362f5 expref: 118 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967766:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.967774:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.967780:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x65:0x0].0x0 (ffff8bfb03146600) 00002000:00100000:0.0:1790771166.967782:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (577536->581631) req@ffff8bfc3f918000 x1877759534012288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000001:00080000:1.0:1790771166.967786:0:13780:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968837 00010000:00010000:2.0:1790771166.967786:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0e95e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.967787:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1790771166.967806:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f918000 with x1877759534012288 ext(577536->581631) 00002000:00010000:0.0:1790771166.967811:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f918000 00010000:00010000:2.0:1790771166.967818:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967828:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.967834:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 444 00000100:00100000:1.0:1790771166.967841:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:11438:x1877759534012416:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 159us (242us total) trans 4294968838 rc 0/0 00010000:00010000:2.0:1790771166.967844:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.967852:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534012288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771166.967854:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1664 00000020:00080000:1.0:1790771166.967861:0:13780:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.967864:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.967869:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967876:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.967877:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x65:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.967898:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967901:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc34224900) 00010000:00010000:2.0:1790771166.967909:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.967909:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967911:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.967916:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967927:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0e965 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967928:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012544 00000100:00100000:1.0:1790771166.967933:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012544 00000001:00080000:3.0:1790771166.967943:0:13765:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969417 00010000:00010000:1.0:1790771166.967950:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 120 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.967967:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000641dc942 reply state 000000000c8760d8 transno 4294969418 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.967968:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0e950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3609b expref: 162 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.967973:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1775 00000100:00100000:1.0:1790771166.967987:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759534012544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.967993:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.967997:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2396:x1877759534012288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 147us (695us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.968001:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.968004:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3609b expref: 161 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.968005:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x65:0x0].0x0 (ffff8bfb03146600) 00010000:00010000:1.0:1790771166.968011:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 120 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.968014:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.968018:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771166.968021:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 444 00002000:00100000:0.0:1790771166.968035:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (577536->581631) req@ffff8bfc3f918000 x1877759534012288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.968035:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:1.0:1790771166.968039:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 120 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.968045:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.968052:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5c00, rc 0) 00000100:00100000:3.0:1790771166.968058:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:11733:x1877759534012160:12345-192.168.204.50@tcp:36:dir_create.sh.0 Request processed in 495us (799us total) trans 4294969418 rc 0/0 00002000:00100000:0.0:1790771166.968067:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f918000 with x1877759534012288 ext(577536->581631) 00002000:00010000:0.0:1790771166.968072:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3f918000 00010000:00010000:1.0:1790771166.968073:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0c872 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35668 expref: 121 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.968075:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6389 00000020:00080000:3.0:1790771166.968083:0:13765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771166.968084:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+161:14680:x1877759533968512:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 874us (1478us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.968097:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:2.0:1790771166.968097:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6387 00010000:00010000:1.0:1790771166.968104:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968110:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968115:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968133:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.968152:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:2397:x1877759534012544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.968158:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1775 00000100:00100000:3.0:1790771166.968173:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.968187:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968193:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.968208:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014208 00010000:00010000:1.0:1790771166.968211:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.968213:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014208 00010000:00010000:1.0:1790771166.968220:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968225:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968230:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.968233:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968238:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.968246:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771166.968248:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771166.968251:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.968260:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6390 00010000:00010000:1.0:1790771166.968262:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0e797 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.968277:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14924:x1877759534014208:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771166.968287:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.968296:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14616:x1877759534007424:12345-192.168.204.50@tcp:55:cp.0 Request processed in 42192us (42269us total) trans 0 rc -22/-22 00010000:00010000:0.0:1790771166.968298:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0e97a lrc: 2/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3621c expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.968307:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6364 00010000:00010000:0.0:1790771166.968355:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 3/0,1 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968364:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968371:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968382:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xa6:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968387:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968393:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771166.968603:0:13768:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x1a:0x0], index 0: 0 00010000:00010000:0.0:1790771166.968712:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0e98f lrc: 3/1,0 mode: --/PR res: [0x240000402:0xae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968720:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0e98f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968729:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0e98f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968750:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968759:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968767:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968774:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968781:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.968785:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968793:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968806:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0x0 (ffff8bfc113f3500) 00010000:00010000:0.0:1790771166.968808:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.968811:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 3/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968816:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03400/0xfa0c505d97f0e981 lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.968826:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e82cf16 reply state 00000000ac108854 transno 4294968839 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968834:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968839:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0xd870248a (ffff8bfc113f3b00) 00010000:00010000:0.0:1790771166.968841:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.968843:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.968861:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0e97a lrc: 0/0,0 mode: --/CW res: [0x240000402:0xa6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3621c expref: 119 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968879:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0e98f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3621c expref: 118 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.968884:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfc113f3d00) 00010000:00010000:0.0:1790771166.968886:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.968888:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02e00, rc 0) 00000100:00100000:0.0:1790771166.968919:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14924:x1877759534014208:12345-192.168.204.50@tcp:101:cp.0 Request processed in 649us (748us total) trans 4294968839 rc 0/0 00000100:00100000:0.0:1790771166.968926:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6390 00000100:00100000:0.0:1790771166.968953:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.968998:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.969004:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012672 00000100:00100000:2.0:1790771166.969011:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012672 00000100:00100000:0.0:1790771166.969028:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.969058:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533972608 00000100:00100000:0.0:1790771166.969059:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.969065:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533972608 00000100:00100000:2.0:1790771166.969076:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534004096 00000100:00100000:2.0:1790771166.969082:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534004096 00000100:00100000:0.0:1790771166.969094:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.969109:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6391 00000100:00100000:3.0:1790771166.969124:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:14508:x1877759534012672:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:2.0:1790771166.969130:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6392 00000100:00100000:0.0:1790771166.969132:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.969143:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.969149:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+161:14573:x1877759533972608:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771166.969160:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0e99d lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36311 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969162:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.969174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.969177:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0e9a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 40 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360c5 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969198:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012800 00010000:00010000:3.0:1790771166.969198:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0e9ab lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969202:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0e9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360c5 expref: 162 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969205:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012800 00010000:00010000:3.0:1790771166.969223:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0e9ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969230:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0e9a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360c5 expref: 162 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969239:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534012928 00010000:00010000:3.0:1790771166.969241:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0e9ab lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969242:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771166.969244:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534012928 00010000:00010000:2.0:1790771166.969251:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.969255:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5a00, rc 0) 00000004:00200000:3.0:1790771166.969269:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.969273:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.969275:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013184 00000100:00100000:0.0:1790771166.969280:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013184 00000100:00100000:2.0:1790771166.969294:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+162:14573:x1877759533972608:12345-192.168.204.50@tcp:101:ln.0 Request processed in 148us (264us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.969297:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0e99d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36311 expref: 52 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969306:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013312 00000100:00100000:0.0:1790771166.969310:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013312 00000100:00100000:2.0:1790771166.969313:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6392 00010000:00010000:3.0:1790771166.969321:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0e9ab lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36311 expref: 51 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.969328:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771166.969331:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.969334:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3600, rc 0) 00000100:00100000:1.0:1790771166.969336:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6393 00000100:00100000:0.0:1790771166.969343:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 869 00000100:00100000:1.0:1790771166.969350:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13555:x1877759534004096:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.969356:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:2396:x1877759534012800:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771166.969360:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.969364:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.969365:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3faced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:14508:x1877759534012672:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 245us (409us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.969371:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0e9b2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e362d2 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.969376:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6391 00010000:00010000:0.0:1790771166.969380:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0e7a5 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362ee expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.969390:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.969405:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00000100:00100000:3.0:1790771166.969410:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 870 00010000:00010000:0.0:1790771166.969411:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.969423:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2398:x1877759534012928:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.969432:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771166.969438:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:2396:x1877759534012800:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (440us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.969444:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.969447:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0e7ba lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362bd expref: 123 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969449:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 869 00000100:00100000:2.0:1790771166.969462:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.969469:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 871 00010000:00010000:1.0:1790771166.969469:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.969481:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.969482:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:0.0:1790771166.969509:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2397:x1877759534013184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.969518:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771166.969519:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771166.969531:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594800/0xfa0c505d97f0e7eb lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3614a expref: 122 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.969539:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.969542:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000004:00200000:1.0:1790771166.969543:0:13774:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.969550:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1790771166.969556:0:13774:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.969556:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.969556:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2398:x1877759534012928:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 132us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.969574:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3face680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2397:x1877759534013184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.969580:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 870 00010000:00010000:1.0:1790771166.969587:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0e9b2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362d2 expref: 122 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969594:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 871 00000100:00100000:3.0:1790771166.969602:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013440 00000100:00100000:3.0:1790771166.969608:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013440 00010000:00010000:1.0:1790771166.969614:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362d2 expref: 119 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.969614:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.969620:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 872 00010000:00010000:1.0:1790771166.969628:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:1.0:1790771166.969631:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771166.969635:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759534013312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771166.969635:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013824 00010000:00010000:1.0:1790771166.969636:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3000, rc 0) 00000100:00100000:3.0:1790771166.969642:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013824 00010000:00010000:0.0:1790771166.969647:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771166.969677:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595200/0xfa0c505d97f0e7cf lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362c4 expref: 121 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.969682:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.969686:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13555:x1877759534004096:12345-192.168.204.50@tcp:101:ls.0 Request processed in 339us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.969689:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 873 00010000:00010000:0.0:1790771166.969704:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:1.0:1790771166.969707:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6393 00000100:00100000:3.0:1790771166.969707:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:2397:x1877759534013440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.969709:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771166.969720:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771166.969729:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974528 00000100:00100000:1.0:1790771166.969734:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974528 00010000:00010000:3.0:1790771166.969736:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0e80e lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3616d expref: 119 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969738:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:2397:x1877759534013312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 105us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.969753:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 872 00010000:00010000:3.0:1790771166.969758:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.969763:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.969765:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013568 00000100:00100000:1.0:1790771166.969771:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013568 00000100:00100000:2.0:1790771166.969775:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.969776:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 874 00000100:00100000:3.0:1790771166.969790:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759534013440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.969791:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:2397:x1877759534013824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.969806:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.969806:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 873 00000100:00100000:1.0:1790771166.969808:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533974656 00000100:00100000:1.0:1790771166.969813:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533974656 00000100:00100000:2.0:1790771166.969814:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534013952 00000100:00100000:2.0:1790771166.969821:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534013952 00010000:00010000:0.0:1790771166.969822:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0e7e4 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36143 expref: 117 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.969837:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:0.0:1790771166.969840:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.969844:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6394 00000100:00100000:3.0:1790771166.969853:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6395 00000100:00100000:1.0:1790771166.969855:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+163:14588:x1877759533974528:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:0.0:1790771166.969862:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:2397:x1877759534013824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 75us (255us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.969865:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.969868:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14757:x1877759534013568:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:2.0:1790771166.969874:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6396 00010000:00010000:1.0:1790771166.969875:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0e9c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 41 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360e8 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969880:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 874 00000100:00100000:2.0:1790771166.969893:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+164:14414:x1877759533974656:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:1.0:1790771166.969899:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0e9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 41 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360e8 expref: 164 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969906:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.969910:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6397 00010000:00010000:1.0:1790771166.969911:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0e9c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 41 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360e8 expref: 164 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969923:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e9c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e360ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.969924:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:14073:x1877759534013952:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771166.969926:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771166.969934:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.969937:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2000, rc 0) 00010000:00010000:0.0:1790771166.969938:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.969951:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0e9ce lrc: 2/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36318 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.969964:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+165:14588:x1877759533974528:12345-192.168.204.50@tcp:101:ln.0 Request processed in 110us (578us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.969964:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.969978:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6394 00010000:00010000:3.0:1790771166.969983:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.969992:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.969993:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.969997:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.970013:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.970020:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.970022:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771166.970027:0:13765:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968840 00010000:00010000:2.0:1790771166.970044:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.970046:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fd816c97 reply state 00000000a1dc71af transno 4294968841 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.970047:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.970053:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.970064:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.970066:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.970075:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x73:0x0]: returning size 4232645 00010000:00010000:3.0:1790771166.970077:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000004:00200000:2.0:1790771166.970082:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.970083:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771166.970087:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.970088:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0e9ce lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 53 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.970099:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 52 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.970101:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.970109:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:0.0:1790771166.970114:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.970118:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02a00, rc 0) 00010000:00010000:2.0:1790771166.970136:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0e9c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 165 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.970140:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14757:x1877759534013568:12345-192.168.204.50@tcp:36:cp.0 Request processed in 275us (683us total) trans 4294968841 rc 0/0 00000100:00100000:0.0:1790771166.970145:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:14073:x1877759534013952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 223us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.970163:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6395 00000020:00080000:3.0:1790771166.970169:0:13765:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.970171:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 164 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.970174:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6397 00010000:00010000:2.0:1790771166.970187:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771166.970191:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.970195:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104600, rc 0) 00000100:00100000:2.0:1790771166.970221:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+164:14414:x1877759533974656:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 333us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.970230:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6396 00000100:00100000:3.0:1790771166.970753:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.970772:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.970790:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.970799:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014336 00000100:00100000:2.0:1790771166.970806:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014336 00000100:00100000:0.0:1790771166.970814:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014720 00000100:00100000:3.0:1790771166.970814:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.970821:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014720 00000100:00100000:1.0:1790771166.970824:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014848 00000100:00100000:1.0:1790771166.970830:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014848 00000100:00100000:2.0:1790771166.970848:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533978496 00000100:00100000:3.0:1790771166.970848:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.970853:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6398 00000100:00100000:2.0:1790771166.970857:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533978496 00000100:00100000:0.0:1790771166.970864:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:15026:x1877759534014336:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.970873:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.970877:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1665 00010000:00010000:0.0:1790771166.970882:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0e9ea lrc: 2/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3631f expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.970891:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15067:x1877759534014848:12345-192.168.204.50@tcp:35:chmod.0 00000100:00100000:3.0:1790771166.970895:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014976 00000100:00100000:2.0:1790771166.970900:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6399 00000100:00100000:3.0:1790771166.970901:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014976 00000100:00100000:2.0:1790771166.970914:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:15069:x1877759534014720:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771166.970921:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e9f1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.970930:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e9f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.970935:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 875 00010000:00010000:0.0:1790771166.970940:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e9f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.970942:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:3.0:1790771166.970949:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759534014976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.970959:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:0.0:1790771166.970962:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1790771166.970962:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0e89a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362fc expref: 117 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.970967:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.970973:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0e8e0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36197 expref: 122 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.970979:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e9f1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.970997:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97efd57f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e300d2 expref: 116 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971000:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:1.0:1790771166.971005:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:15067:x1877759534014848:12345-192.168.204.50@tcp:35:chmod.0 Request processed in 115us (209us total) trans 4294968842 rc 0/0 00010000:00010000:0.0:1790771166.971007:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0e9ea lrc: 0/0,0 mode: --/CR res: [0x240000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3631f expref: 122 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971008:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.971032:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1665 00010000:00010000:2.0:1790771166.971033:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3e:0x0].0x0 (ffff8bfc20109600) 00000100:00100000:3.0:1790771166.971033:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759534014976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (182us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.971034:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592c00/0xfa0c505d97f0e9f1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3631f expref: 121 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.971052:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 875 00010000:00010000:0.0:1790771166.971059:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x7:0x0].0x0 (ffff8bfc3600d500) 00010000:00010000:0.0:1790771166.971063:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.971063:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0e44f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361eb expref: 115 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971068:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592c00, rc 0) 00010000:00010000:2.0:1790771166.971085:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.971089:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.971096:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:15026:x1877759534014336:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 235us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.971102:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6398 00010000:00010000:2.0:1790771166.971104:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.971110:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6400 00010000:00010000:2.0:1790771166.971121:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.971129:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+164:15037:x1877759533978496:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771166.971139:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971148:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.971160:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: --/PW res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971163:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ea06 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 42 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3615f expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971172:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971181:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971233:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971243:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971263:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971322:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ea06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 42 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3615f expref: 165 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971333:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ea06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 42 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3615f expref: 165 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.971338:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.971340:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.971342:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2800, rc 0) 00000040:00080000:2.0:1790771166.971404:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off11064 00000100:00100000:3.0:1790771166.971424:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+165:15037:x1877759533978496:12345-192.168.204.50@tcp:101:cp.0 Request processed in 302us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.971431:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6400 00010000:00010000:2.0:1790771166.971447:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.971448:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.971461:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.971465:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534015360 00000100:00100000:3.0:1790771166.971471:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534015360 00010000:00010000:2.0:1790771166.971481:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971575:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971584:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971592:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.971599:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6401 00000100:00100000:0.0:1790771166.971611:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:14678:x1877759534015360:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771166.971618:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.971621:0:13772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790771166.971626:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ea1b lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36334 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971636:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971637:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771166.971644:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971661:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971666:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971670:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105e00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771166.971672:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971678:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971680:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971686:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.971694:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971698:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971700:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971713:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971722:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3e:0x0].0x0 (ffff8bfc34224f00) 00010000:00010000:1.0:1790771166.971726:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790771166.971727:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971733:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971739:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971739:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x3e:0x0].0x0 (ffff8bfc34224f00) 00010000:00010000:1.0:1790771166.971740:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ea14 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971749:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771166.971758:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 2/0,0 mode: --/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.971763:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.971766:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771166.971771:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771166.971772:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971775:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea0d lrc: 0/0,0 mode: --/EX res: [0x200000403:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971796:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971799:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971804:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971816:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971817:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971838:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.971840:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971855:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971857:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971871:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971874:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.971879:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971881:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971888:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.971892:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971896:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971899:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971917:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771166.971921:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.971922:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771166.971924:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971929:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.971932:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ea22 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971935:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971941:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971945:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0e9f8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971949:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971962:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.971965:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019890328 reply state 000000006feabe40 transno 4294969419 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971966:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.971970:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971985:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.971991:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.971993:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xb62e0cbf (ffff8bfc113f3400) 00010000:00010000:0.0:1790771166.971999:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.972002:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.972010:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea29 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.972011:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x7a94fdef (ffff8bfc34224100) 00010000:00010000:2.0:1790771166.972019:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771166.972023:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771166.972033:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ea1b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36334 expref: 54 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.972043:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36334 expref: 53 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.972049:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:0.0:1790771166.972051:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.972053:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593e00, rc 0) 00000100:00100000:2.0:1790771166.972067:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:15069:x1877759534014720:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1155us (1290us total) trans 4294969419 rc 0/0 00000100:00100000:0.0:1790771166.972076:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14678:x1877759534015360:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 465us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.972081:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6399 00000100:00100000:0.0:1790771166.972094:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6401 00000100:00100000:0.0:1790771166.981590:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.981631:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.981634:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016000 00000100:00100000:1.0:1790771166.981640:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016000 00000100:00100000:1.0:1790771166.981686:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533981440 00000100:00100000:1.0:1790771166.981689:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533981440 00000100:00100000:2.0:1790771166.981700:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6402 00000100:00100000:2.0:1790771166.981714:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14668:x1877759534016000:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1790771166.981721:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6403 00000100:00100000:1.0:1790771166.981731:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+165:14002:x1877759533981440:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771166.981733:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.981744:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.981749:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0ea37 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3633b expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.981756:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ea3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e35f91 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.981772:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.981792:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.981807:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.981817:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.981826:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.981829:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533977344 00010000:00010000:1.0:1790771166.981835:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.981836:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533977344 00010000:00010000:2.0:1790771166.981841:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0ea37 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3633b expref: 117 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.981848:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.981860:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.981863:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:0.0:1790771166.981873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.981873:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.981880:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.981884:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0ea37 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3633b expref: 117 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.981896:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.981897:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.981915:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104400, rc 0) 00000100:00100000:0.0:1790771166.981927:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.981949:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534015744 00000100:00100000:0.0:1790771166.981953:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534015744 00000100:00100000:2.0:1790771166.981960:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14668:x1877759534016000:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 247us (371us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771166.981974:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6402 00000004:00200000:1.0:1790771166.981977:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:0.0:1790771166.981985:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016384 00000100:00100000:0.0:1790771166.981988:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016384 00000100:00100000:2.0:1790771166.981998:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534015488 00000100:00100000:2.0:1790771166.982004:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534015488 00000100:00100000:0.0:1790771166.982015:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016512 00000100:00100000:0.0:1790771166.982019:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016512 00010000:00010000:1.0:1790771166.982026:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982034:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982039:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982040:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533984768 00000100:00100000:2.0:1790771166.982044:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533976320 00000100:00100000:3.0:1790771166.982047:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533984768 00010000:00010000:1.0:1790771166.982048:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771166.982051:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533976320 00000100:00100000:0.0:1790771166.982052:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1666 00010000:00010000:1.0:1790771166.982055:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982062:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982068:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14400:x1877759534015744:12345-192.168.204.50@tcp:35:lfs.0 00010000:00010000:1.0:1790771166.982075:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.982080:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.982085:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982086:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6404 00010000:00010000:1.0:1790771166.982097:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0ea45 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982097:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6405 00000100:00100000:3.0:1790771166.982102:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+171:14078:x1877759533977344:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:2.0:1790771166.982115:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+171:14383:x1877759534015488:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:3.0:1790771166.982117:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.982125:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.982130:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ea5a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 43 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36135 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982150:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982157:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982161:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.982166:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.982167:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.982169:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ea5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 43 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36135 expref: 172 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982179:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:14400:x1877759534015744:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 115us (362us total) trans 4294968843 rc 0/0 00010000:00010000:1.0:1790771166.982184:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.982196:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982197:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1666 00010000:00010000:1.0:1790771166.982219:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb0321a400) 00010000:00010000:1.0:1790771166.982223:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.982224:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.982225:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ea5a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 43 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36135 expref: 172 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982227:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982234:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1667 00000100:00100000:0.0:1790771166.982247:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14064:x1877759534016384:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.982250:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ea4c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.982257:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.982264:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.982265:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.982268:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00010000:00010000:2.0:1790771166.982283:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 172 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982286:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ea3e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f91 expref: 172 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982309:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+172:14078:x1877759533977344:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 209us (532us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.982310:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771166.982310:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 4/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982316:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771166.982325:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0ea3e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f91 expref: 172 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982328:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14064:x1877759534016384:12345-192.168.204.50@tcp:35:ls.0 Request processed in 79us (431us total) trans 4294968844 rc 0/0 00000100:00100000:3.0:1790771166.982330:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6404 00000100:00100000:0.0:1790771166.982346:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1667 00010000:00010000:2.0:1790771166.982357:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 170 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982358:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2c00, rc 0) 00000100:00100000:3.0:1790771166.982358:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6406 00000100:00100000:0.0:1790771166.982369:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1668 00000100:00100000:3.0:1790771166.982375:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+170:13208:x1877759533984768:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.982381:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:11807:x1877759534016512:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.982386:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.982388:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 170 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.982389:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+170:14002:x1877759533981440:12345-192.168.204.50@tcp:101:ls.0 Request processed in 658us (756us total) trans 4294969420 rc 301/301 00010000:00010000:3.0:1790771166.982397:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ea6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 44 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36086 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.982403:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6403 00000100:00100000:2.0:1790771166.982427:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539772800:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.982428:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6407 00000100:00100000:1.0:1790771166.982442:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+170:14482:x1877759533976320:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:1.0:1790771166.982450:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771166.982459:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11807:x1877759534016512:12345-192.168.204.50@tcp:35:ls.0 Request processed in 81us (531us total) trans 4294968845 rc 0/0 00010000:00010000:1.0:1790771166.982460:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ea76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36112 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982471:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1668 00010000:00010000:1.0:1790771166.982533:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.982537:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 4096 00010000:00010000:1.0:1790771166.982541:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982549:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982551:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cc00 going to sleep for 11 seconds 00010000:00010000:1.0:1790771166.982565:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982568:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.982576:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982583:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982591:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016640 00000100:00100000:2.0:1790771166.982597:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016640 00010000:00010000:1.0:1790771166.982622:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982632:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.982634:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982643:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6408 00010000:00010000:3.0:1790771166.982643:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ea6f lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 44 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36086 expref: 173 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982644:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.982666:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016768 00000100:00100000:0.0:1790771166.982672:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016768 00000100:00100000:2.0:1790771166.982679:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+173:14422:x1877759534016640:12345-192.168.204.50@tcp:36:ln.0 00010000:00010000:3.0:1790771166.982679:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.982685:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771166.982692:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ea6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 44 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36086 expref: 174 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.982695:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x49:0x0]: returning size 5 00000100:00100000:0.0:1790771166.982702:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6409 00000004:00200000:1.0:1790771166.982702:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.982708:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00000100:00100000:0.0:1790771166.982713:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+173:15043:x1877759534016768:12345-192.168.204.50@tcp:36:truncate.0 00000004:00010000:1.0:1790771166.982715:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982725:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982731:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982737:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+173:13208:x1877759533984768:12345-192.168.204.50@tcp:101:ls.0 Request processed in 365us (890us total) trans 4294969421 rc 301/301 00010000:00010000:1.0:1790771166.982740:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982748:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6406 00010000:00010000:1.0:1790771166.982751:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982757:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.982759:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982766:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982771:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539772928:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1790771166.982775:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0x0 (ffff8bfc3607dc00) 00010000:00010000:1.0:1790771166.982779:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.982782:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982786:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0ea7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982794:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982799:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982804:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982808:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.982811:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982815:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982826:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771166.982827:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982827:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x37:0x0].0xb62e0cbf (ffff8bfb0321a300) 00010000:00010000:1.0:1790771166.982833:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.982838:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982843:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.982847:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982849:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ea8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x37:0x0].0xb62e0cbf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982855:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.982877:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.982885:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539772928 00010000:00010000:0.0:1790771166.982886:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982892:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539772928 00010000:00010000:1.0:1790771166.982905:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0ea76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36112 expref: 174 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.982908:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000001:00080000:0.0:1790771166.982919:0:13766:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969422 00010000:00010000:1.0:1790771166.982926:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36112 expref: 174 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.982932:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:1.0:1790771166.982935:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771166.982937:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02c00, rc 0) 00000004:00010000:0.0:1790771166.982940:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e45eeb72 reply state 000000007262c953 transno 4294969423 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982944:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:3.0:1790771166.982947:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.982957:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.982965:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6494:x1877759539772928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790771166.982967:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+174:14482:x1877759533976320:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 525us (1093us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.982970:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00000100:00100000:3.0:1790771166.982970:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017536 00000100:00100000:3.0:1790771166.982977:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017536 00010000:00010000:0.0:1790771166.982978:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771166.982982:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.982983:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6407 00000100:00100000:1.0:1790771166.983002:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6410 00000100:00100000:1.0:1790771166.983013:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:14616:x1877759534017536:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:0.0:1790771166.983024:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+174:15043:x1877759534016768:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 311us (393us total) trans 4294969423 rc 0/0 00000100:00100000:0.0:1790771166.983030:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6409 00000020:00080000:0.0:1790771166.983034:0:13766:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771166.983039:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.983046:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983055:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.983058:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018176 00010000:00010000:1.0:1790771166.983062:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.983063:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018176 00000100:00100000:2.0:1790771166.983063:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:6494:x1877759539772928:12345-0@lo:1000:mdt00_001.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.983080:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.983085:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1790771166.983091:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018304 00000100:00100000:0.0:1790771166.983095:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018304 00000100:00100000:3.0:1790771166.983112:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.983124:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018432 00000100:00100000:0.0:1790771166.983128:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018432 00000100:00100000:2.0:1790771166.983136:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6411 00000100:00100000:3.0:1790771166.983149:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.983155:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14813:x1877759534018176:12345-192.168.204.50@tcp:55:chown.0 00000100:00100000:0.0:1790771166.983160:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6412 00000001:00080000:1.0:1790771166.983172:0:13763:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969424 00000100:00100000:0.0:1790771166.983173:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14508:x1877759534018304:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771166.983176:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018688 00000100:00100000:3.0:1790771166.983183:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018688 00000004:00010000:1.0:1790771166.983196:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000065d53031 reply state 000000003e9a3b8b transno 4294969425 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.983198:0:13766:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.983200:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.983215:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0e9ab lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36311 expref: 54 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.983219:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6413 00010000:00010000:2.0:1790771166.983234:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 122 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.983235:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14669:x1877759534018432:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.983238:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983254:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.983261:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771166.983265:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:3.0:1790771166.983267:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0eaae lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36350 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983268:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771166.983274:0:13766:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771166.983274:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.983284:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 4/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983301:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14616:x1877759534017536:12345-192.168.204.50@tcp:36:cp.0 Request processed in 291us (360us total) trans 4294969425 rc 0/0 00000100:00100000:1.0:1790771166.983308:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6410 00010000:00010000:3.0:1790771166.983310:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790771166.983312:0:13763:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771166.983316:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.983320:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14508:x1877759534018304:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 149us (239us total) trans 0 rc -17/-17 00010000:00010000:3.0:1790771166.983330:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983331:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6414 00000100:00100000:0.0:1790771166.983344:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6412 00000100:00100000:1.0:1790771166.983346:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14789:x1877759534018688:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:2.0:1790771166.983351:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983354:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.983368:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017152 00000100:00100000:0.0:1790771166.983373:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017152 00000100:00100000:2.0:1790771166.983380:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539773056:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.983389:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983396:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.983398:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017280 00000100:00100000:0.0:1790771166.983404:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017280 00010000:00010000:3.0:1790771166.983406:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983417:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14789:x1877759534018688:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 73us (269us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771166.983420:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.983425:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6414 00000100:00100000:0.0:1790771166.983429:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1669 00000100:00100000:0.0:1790771166.983439:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+174:14974:x1877759534017152:12345-192.168.204.50@tcp:37:lfs.0 00010000:00010000:3.0:1790771166.983450:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.983451:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1670 00010000:00010000:3.0:1790771166.983462:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.983469:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13978:x1877759534017280:12345-192.168.204.50@tcp:35:dd.0 00010000:00010000:3.0:1790771166.983472:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983504:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f919f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539772672:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771166.983519:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1790771166.983523:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.983529:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.983533:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2397:x1877759534011904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 16572us (16671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.983539:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1774 00000004:00010000:3.0:1790771166.983546:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983559:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983567:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983575:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983576:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534016896 00000100:00100000:1.0:1790771166.983581:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534016896 00010000:00010000:3.0:1790771166.983589:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983593:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.983596:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983601:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983611:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:1.0:1790771166.983614:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1048 00010000:00010000:3.0:1790771166.983617:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.983621:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983626:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:11733:x1877759534016896:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:3.0:1790771166.983632:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0eab5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983636:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:2.0:1790771166.983642:0:13775:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968846 00010000:00010000:3.0:1790771166.983643:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983647:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36342 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983672:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983679:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983683:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03a03a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.983685:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983691:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 21 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983703:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.983705:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x1d:0x0].0x0 since=3s v=(1 0) 00010000:00010000:1.0:1790771166.983713:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1790771166.983715:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xcdd6ff3 (ffff8bfb02b20e00) 00010000:00010000:1.0:1790771166.983718:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 4/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36342 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983719:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.983723:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.983729:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13978:x1877759534017280:12345-192.168.204.50@tcp:35:dd.0 Request processed in 262us (817us total) trans 4294968847 rc 0/0 00010000:00010000:3.0:1790771166.983738:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0eabc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.983745:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1670 00010000:00010000:1.0:1790771166.983749:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 21 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771166.983752:0:13775:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771166.983762:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 21 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983767:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0eaae lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36350 expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.983780:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc08b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539773184:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.983786:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36350 expref: 125 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.983792:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771166.983795:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790771166.983797:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00000100:00100000:2.0:1790771166.983801:0:6494:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968779 gen 2 00000004:00080000:2.0:1790771166.983809:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968758 committed transno 4294968779 00000100:00100000:1.0:1790771166.983816:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.983819:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14669:x1877759534018432:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 589us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.983826:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6413 00000004:00080000:2.0:1790771166.983828:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968759 committed transno 4294968779 00000004:00080000:2.0:1790771166.983844:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968760 committed transno 4294968779 00000004:00080000:2.0:1790771166.983854:0:6494:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968779 committed transno 4294968779 00000020:00080000:2.0:1790771166.983859:0:6494:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfb060806c0 refcount 2 committed 0 result 0 batchid 51 00000020:00080000:2.0:1790771166.983864:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc1834fd00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06080840 00000020:00080000:2.0:1790771166.983868:0:6494:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].40 00000020:00080000:2.0:1790771166.983871:0:6494:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb05ab0000 00000020:00080000:2.0:1790771166.983875:0:6494:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].40 00000100:00100000:2.0:1790771166.983900:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539772928:0@lo:1000:mdt00_001.0 00000020:00080000:3.0:1790771166.983908:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 52 committed batchid 50 00000020:00080000:3.0:1790771166.983938:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 50 00010000:00010000:2.0:1790771166.983942:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.983959:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.983960:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.983973:0:6494:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.983981:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533994880 00000100:00100000:3.0:1790771166.983985:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533994880 00010000:00010000:2.0:1790771166.984001:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 118 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.984003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.984017:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6415 00010000:00010000:2.0:1790771166.984020:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 118 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984022:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018944 00000100:00100000:0.0:1790771166.984028:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018944 00000100:00100000:3.0:1790771166.984028:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+176:14000:x1877759533994880:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.984044:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.984049:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.984050:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1877759539773312:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.984055:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3622a expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984062:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1671 00000100:00100000:0.0:1790771166.984075:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13672:x1877759534018944:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:3.0:1790771166.984081:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 177 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.984083:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.984095:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.984097:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 177 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.984104:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:3.0:1790771166.984107:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.984109:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82800, rc 0) 00000100:00100000:2.0:1790771166.984125:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533990144 00000100:00100000:3.0:1790771166.984130:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+177:14000:x1877759533994880:12345-192.168.204.50@tcp:101:ls.0 Request processed in 104us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.984133:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533990144 00000100:00100000:3.0:1790771166.984140:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6415 00000100:00100000:0.0:1790771166.984151:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13672:x1877759534018944:12345-192.168.204.50@tcp:35:ls.0 Request processed in 78us (148us total) trans 4294968848 rc 0/0 00000100:00100000:0.0:1790771166.984158:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1671 00000100:00100000:1.0:1790771166.984168:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.984168:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6416 00000100:00100000:3.0:1790771166.984185:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+177:15075:x1877759533990144:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:0.0:1790771166.984192:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017024 00000100:00100000:0.0:1790771166.984197:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017024 00010000:00010000:3.0:1790771166.984197:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.984210:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0eadf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 44 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e361f2 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984227:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017920 00000100:00100000:2.0:1790771166.984229:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.984230:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017920 00010000:00010000:3.0:1790771166.984243:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.984254:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984262:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1049 00010000:00010000:3.0:1790771166.984262:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984273:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759534017024:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:0.0:1790771166.984320:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1050 00000100:00100000:1.0:1790771166.984325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:3.0:1790771166.984328:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9314 00000004:00200000:3.0:1790771166.984334:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771166.984335:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759534017920:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771166.984343:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:3.0:1790771166.984348:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.984353:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072b1627c/0xfa0c505d97f0eaed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36349 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.984357:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.984381:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0eadf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 44 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f2 expref: 179 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984389:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539773440:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.984394:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f2 expref: 178 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.984401:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:3.0:1790771166.984404:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771166.984406:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595200, rc 0) 00000100:00100000:2.0:1790771166.984409:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019328 00000100:00100000:1.0:1790771166.984412:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.984418:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019328 00000100:00100000:0.0:1790771166.984419:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e87c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790771166.984436:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+179:15075:x1877759533990144:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 256us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.984442:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6416 00000100:00100000:1.0:1790771166.984449:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.984461:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6417 00000100:00100000:2.0:1790771166.984473:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+178:14558:x1877759534019328:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:1.0:1790771166.984474:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.984480:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534017664 00000100:00100000:3.0:1790771166.984518:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534017664 00000100:00100000:1.0:1790771166.984519:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.984544:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.984552:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.984564:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.984574:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.984576:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.984593:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.984607:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019712 00000100:00100000:1.0:1790771166.984611:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019712 00002000:00010000:3.0:1790771166.984620:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00002000:00100000:3.0:1790771166.984626:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8380 with x1877759534017664 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771166.984632:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8380. 00000100:00100000:1.0:1790771166.984640:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1051 00000100:00100000:1.0:1790771166.984665:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2397:x1877759534019712:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:3.0:1790771166.984671:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534018816 00010000:00010000:1.0:1790771166.984674:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.984677:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534018816 00010000:00010000:1.0:1790771166.984689:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3635e expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.984701:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 445 00000001:00080000:2.0:1790771166.984702:0:13773:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969426 00002000:00010000:1.0:1790771166.984706:0:13788:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1790771166.984712:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534017664:12345-192.168.204.50@tcp:10:cp.0 00010000:00010000:1.0:1790771166.984719:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=167s v=(0 0) 00010000:00010000:1.0:1790771166.984723:0:13788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771166.984729:0:13788:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 24 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.984736:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff9f0ae4 reply state 000000002a85bf1c transno 4294969427 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.984740:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 24 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.984762:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03600, rc 0) 00010000:00010000:2.0:1790771166.984763:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.984774:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:2.0:1790771166.984778:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1790771166.984779:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759534019712:12345-192.168.204.50@tcp:101:cp.0 Request processed in 132us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.984783:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771166.984788:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1051 00000100:00100000:2.0:1790771166.984823:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+181:14558:x1877759534019328:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 350us (595us total) trans 4294969427 rc 0/0 00000100:00100000:0.0:1790771166.984825:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019072 00000100:00100000:0.0:1790771166.984832:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019072 00000100:00100000:1.0:1790771166.984836:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.984842:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6417 00000100:00100000:3.0:1790771166.984844:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 446 00000020:00080000:2.0:1790771166.984851:0:13773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790771166.984861:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2399:x1877759534018816:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:0.0:1790771166.984866:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019200 00000100:00100000:1.0:1790771166.984871:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.984872:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019200 00000100:00100000:2.0:1790771166.984878:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533994240 00000100:00100000:2.0:1790771166.984884:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533994240 00000100:00100000:1.0:1790771166.984892:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019584 00000100:00100000:1.0:1790771166.984896:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019584 00000100:00100000:0.0:1790771166.984901:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 876 00000100:00100000:2.0:1790771166.984921:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019456 00000100:00100000:1.0:1790771166.984927:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020096 00000100:00100000:2.0:1790771166.984929:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019456 00000100:00100000:1.0:1790771166.984931:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020096 00000100:00100000:1.0:1790771166.984963:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1672 00002000:00010000:3.0:1790771166.984972:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 14368 -> 14368 00000100:00100000:1.0:1790771166.984974:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14073:x1877759534019584:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:2.0:1790771166.984976:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6418 00000100:00100000:0.0:1790771166.984980:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc105a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2399:x1877759534019072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00010000:3.0:1790771166.984980:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771166.984988:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1790771166.984991:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:0.0:1790771166.984994:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771166.984996:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+181:13998:x1877759533994240:12345-192.168.204.50@tcp:101:ls.0 00002000:00010000:3.0:1790771166.984996:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1790771166.985006:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0e934 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362cb expref: 128 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985013:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.985018:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:0.0:1790771166.985022:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.985027:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36223 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985028:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534018816:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 170us (579us total) trans 4294967637 rc 0/0 00000100:00100000:0.0:1790771166.985041:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc105a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2399:x1877759534019072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.985052:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 446 00000100:00100000:0.0:1790771166.985056:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 876 00010000:00010000:2.0:1790771166.985066:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 182 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985078:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534019840 00010000:00010000:2.0:1790771166.985081:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 182 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985083:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534019840 00010000:00010000:2.0:1790771166.985093:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:0.0:1790771166.985098:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 877 00010000:00010000:2.0:1790771166.985101:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00100000:3.0:1790771166.985105:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (581632->585727) req@ffff8bfb069e9f80 x1877759534019840/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.985106:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104200, rc 0) 00000100:00100000:0.0:1790771166.985110:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2399:x1877759534019200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1790771166.985125:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e9f80 with x1877759534019840 ext(581632->585727) 00010000:00010000:0.0:1790771166.985126:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1790771166.985129:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e9f80 00000100:00100000:2.0:1790771166.985135:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+182:13998:x1877759533994240:12345-192.168.204.50@tcp:101:ls.0 Request processed in 144us (614us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.985137:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0e9b9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e362d2 expref: 126 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.985157:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6418 00010000:00010000:0.0:1790771166.985158:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:3.0:1790771166.985158:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 447 00010000:00010000:0.0:1790771166.985167:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.985175:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534019840:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771166.985188:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6419 00000100:00100000:0.0:1790771166.985190:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2399:x1877759534019200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.985204:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14510:x1877759534019456:12345-192.168.204.50@tcp:101:mrename.0 00000100:00100000:0.0:1790771166.985205:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 877 00010000:00010000:2.0:1790771166.985219:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.985230:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0eb09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 44 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36357 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985237:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1673 00000100:00100000:0.0:1790771166.985249:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14512:x1877759534020096:12345-192.168.204.50@tcp:35:rm.0 00010000:00010000:2.0:1790771166.985272:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 45 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985282:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534019840:12345-192.168.204.50@tcp:3:cat.0 Request processed in 110us (451us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.985287:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985288:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 447 00002000:00100000:3.0:1790771166.985299:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (581632->585727) req@ffff8bfb069e9f80 x1877759534019840/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771166.985303:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771166.985310:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e9f80 with x1877759534019840 ext(581632->585727) 00002000:00010000:3.0:1790771166.985317:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e9f80 00000100:00100000:0.0:1790771166.985326:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14512:x1877759534020096:12345-192.168.204.50@tcp:35:rm.0 Request processed in 79us (458us total) trans 4294968849 rc 0/0 00000100:00100000:0.0:1790771166.985332:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1673 00010000:00010000:2.0:1790771166.985332:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985345:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985353:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985399:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97f0eb1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985406:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.985417:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97f0eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985427:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97f0eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985469:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771166.985472:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 4360 -> 0 00002000:00010000:0.0:1790771166.985477:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771165 -> 1790771167 00002000:00010000:0.0:1790771166.985480:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771166.985511:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771165 -> 1790771167 00002000:00010000:0.0:1790771166.985516:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 16 -> 0 00000004:00200000:2.0:1790771166.985524:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1790771166.985530:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1790771166.985531:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020224 00000100:00100000:3.0:1790771166.985537:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020224 00000100:00100000:0.0:1790771166.985544:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534017664:12345-192.168.204.50@tcp:10:cp.0 Request processed in 833us (1134us total) trans 4294967640 rc 0/0 00000004:00010000:2.0:1790771166.985548:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97f0eb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985557:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 445 00000100:00100000:1.0:1790771166.985565:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.985565:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771166.985566:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/7 (0->18446744073709551615) 00000100:00100000:3.0:1790771166.985570:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020480 00002000:00100000:0.0:1790771166.985574:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb069e8380 with x1877759534017664 ext(0->18446744073709551615) 00000100:00100000:3.0:1790771166.985577:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020480 00002000:00010000:0.0:1790771166.985586:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb069e8380. 00010000:00010000:2.0:1790771166.985587:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.985593:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6420 00010000:00010000:2.0:1790771166.985604:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.985606:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14582:x1877759534020224:12345-192.168.204.50@tcp:36:touch.0 00000100:00100000:0.0:1790771166.985619:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020352 00000100:00100000:0.0:1790771166.985625:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020352 00000100:00100000:3.0:1790771166.985625:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6421 00010000:00010000:2.0:1790771166.985628:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985633:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771166.985641:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.985643:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:15069:x1877759534020480:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771166.985647:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985666:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0e854 lrc: 0/0,0 mode: --/PR res: [0x240000402:0xad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3613c expref: 125 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985672:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1052 00010000:00010000:3.0:1790771166.985673:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.985677:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985686:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759534020352:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771166.985686:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3636c expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985688:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xad:0x0].0x0 (ffff8bfc34224300) 00010000:00010000:0.0:1790771166.985703:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.985704:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.985704:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771166.985711:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.985713:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 122 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985716:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.985717:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aa462e7/0xfa0c505d97f0eb2c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36365 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.985734:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 122 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985735:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985742:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0eb10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 45 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985761:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.985765:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771166.985771:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.985771:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.985772:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985775:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13793:1877759539773568:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771166.985778:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00010000:00010000:2.0:1790771166.985793:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985801:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985808:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.985812:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:15069:x1877759534020480:12345-192.168.204.50@tcp:101:rm.0 Request processed in 171us (341us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.985814:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.985820:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb05e873c0 going to sleep for 11 seconds 00000004:00010000:1.0:1790771166.985825:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000925b468f reply state 0000000063e9fe04 transno 4294968850 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985846:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6421 00010000:00010000:1.0:1790771166.985849:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985853:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.985874:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xad:0x0].0x0 (ffff8bfb0321a400) 00010000:00010000:1.0:1790771166.985878:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.985880:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771166.985881:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xbc0ca3a9 (ffff8bfc34224f00) 00010000:00010000:2.0:1790771166.985886:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.985890:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985898:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0eb17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.985902:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.985916:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0487a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14582:x1877759534020224:12345-192.168.204.50@tcp:36:touch.0 Request processed in 312us (511us total) trans 4294968850 rc 0/0 00000100:00100000:1.0:1790771166.985924:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6420 00000100:00100000:0.0:1790771166.985925:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020608 00000100:00100000:0.0:1790771166.985930:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020608 00010000:00010000:2.0:1790771166.985941:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0eb09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 44 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36357 expref: 123 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985958:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57000/0xfa0c505d97f0eb1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36357 expref: 122 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.985966:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc3607a800) 00010000:00010000:2.0:1790771166.985970:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771166.985972:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57000, rc 0) 00000100:00100000:3.0:1790771166.985987:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.986005:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14510:x1877759534019456:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 805us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.986013:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020864 00000100:00100000:2.0:1790771166.986017:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6419 00000100:00100000:3.0:1790771166.986019:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020864 00000100:00100000:0.0:1790771166.986025:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6422 00000100:00100000:1.0:1790771166.986032:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.986039:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14678:x1877759534020608:12345-192.168.204.50@tcp:101:mrename.0 00000100:00100000:2.0:1790771166.986043:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997440 00010000:00010000:0.0:1790771166.986047:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771166.986049:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997440 00010000:00010000:0.0:1790771166.986061:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f0eb3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36373 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.986066:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6423 00000100:00100000:1.0:1790771166.986075:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.986080:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:15091:x1877759534020864:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771166.986093:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.986101:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.986102:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534020992 00000100:00100000:2.0:1790771166.986103:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6424 00000100:00100000:1.0:1790771166.986111:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534020992 00010000:00010000:3.0:1790771166.986111:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.986113:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 4/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.986123:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+182:14622:x1877759533997440:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771166.986138:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.986141:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 123 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.986144:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.986152:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 878 00010000:00010000:2.0:1790771166.986157:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0eb4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 44 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3623f expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.986166:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2396:x1877759534020992:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771166.986172:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.986172:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.986180:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.986195:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593e00/0xfa0c505d97f0ea30 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36334 expref: 55 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.986207:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:1.0:1790771166.986210:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.986213:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.986214:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 123 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.986229:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2396:x1877759534020992:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65us (153us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.986242:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.986244:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 123 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.986246:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 878 00010000:00010000:2.0:1790771166.986267:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.986270:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539773696:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771166.986302:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63180 going to sleep for 11 seconds 00000004:00200000:2.0:1790771166.986303:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9314 00000004:00200000:2.0:1790771166.986309:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771166.986322:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.986333:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.986356:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0eb4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 44 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3623f expref: 183 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.986374:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3623f expref: 182 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.986383:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.986388:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.986391:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00000100:00100000:2.0:1790771166.986418:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+182:14622:x1877759533997440:12345-192.168.204.50@tcp:101:ln.0 Request processed in 301us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.986427:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6424 00000001:00080000:0.0:1790771166.986456:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967639 is committed 00000001:00080000:0.0:1790771166.986463:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967638 is committed 00000001:00080000:0.0:1790771166.986474:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967633 is committed 00000100:00100000:2.0:1790771166.986609:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534017024:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2336us (2514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.986619:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1049 00000100:00100000:1.0:1790771166.986922:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+181:14974:x1877759534017152:12345-192.168.204.50@tcp:37:lfs.0 Request processed in 3486us (4051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.986928:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1669 00000100:00100000:0.0:1790771166.991091:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.991125:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534021120 00000100:00100000:3.0:1790771166.991133:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534021120 00000100:00100000:2.0:1790771166.991137:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539772800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771166.991157:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.991179:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.991194:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001_UUID:6493:1877759539773056:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771166.991210:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534021248 00010000:00010000:1.0:1790771166.991214:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.991217:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534021248 00000100:00100000:3.0:1790771166.991252:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6425 00000100:00100000:0.0:1790771166.991258:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1053 00000100:00100000:3.0:1790771166.991266:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:11807:x1877759534021120:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771166.991275:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:15043:x1877759534021248:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:1.0:1790771166.991275:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.991277:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.991288:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.991291:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0eb5d lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3637a expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.991299:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36381 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.991301:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534021376 00000100:00100000:2.0:1790771166.991310:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534021376 00000100:00100000:1.0:1790771166.991311:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.991330:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.991341:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xe:0x0].0x0 since=1s v=(2 4) 00000100:00100000:1.0:1790771166.991341:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.991346:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0eb6b lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.991348:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(3 4) 00000100:00100000:2.0:1790771166.991351:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1674 00010000:00010000:0.0:1790771166.991360:0:8676:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36381 expref: 25 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991365:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0eb6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991371:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.991371:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13735:x1877759534021376:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771166.991389:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991397:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.991412:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.991424:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539773824:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771166.991425:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.991447:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0eb6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991462:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.991475:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771166.991506:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534021504 00000100:00100000:1.0:1790771166.991511:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534021504 00000100:00100000:2.0:1790771166.991520:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13735:x1877759534021376:12345-192.168.204.50@tcp:35:ls.0 Request processed in 154us (244us total) trans 4294968851 rc 0/0 00000100:00100000:0.0:1790771166.991522:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534021632 00000100:00100000:0.0:1790771166.991527:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534021632 00000100:00100000:2.0:1790771166.991533:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1674 00000004:00200000:3.0:1790771166.991536:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000100:00100000:1.0:1790771166.991539:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997952 00000004:00200000:3.0:1790771166.991541:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771166.991544:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997952 00000004:00010000:3.0:1790771166.991556:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0eb6b lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.991559:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022016 00000100:00100000:0.0:1790771166.991565:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1675 00000100:00100000:2.0:1790771166.991568:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022016 00000100:00100000:1.0:1790771166.991572:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022144 00000100:00100000:1.0:1790771166.991576:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022144 00000100:00100000:0.0:1790771166.991578:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+183:13208:x1877759534021632:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:3.0:1790771166.991583:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0eb5d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3637a expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991601:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05ef5000/0xfa0c505d97f0eb6b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3637a expref: 128 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991603:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533997824 00000100:00100000:2.0:1790771166.991605:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1676 00000100:00100000:1.0:1790771166.991607:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533997824 00010000:00010000:3.0:1790771166.991616:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771166.991618:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771166.991621:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5000, rc 0) 00000100:00100000:2.0:1790771166.991623:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+185:14002:x1877759534022016:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771166.991631:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6426 00000100:00100000:1.0:1790771166.991640:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14616:x1877759534021504:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:3.0:1790771166.991666:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:11807:x1877759534021120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 386us (557us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.991668:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771166.991678:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6425 00010000:00010000:1.0:1790771166.991680:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0eb72 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36388 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.991698:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6427 00010000:00010000:1.0:1790771166.991701:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0eb79 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.991709:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+186:15040:x1877759533997952:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.991711:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0eb79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991718:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.991724:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0eb79 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991731:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0eb80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3625b expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.991747:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+187:14002:x1877759534022016:12345-192.168.204.50@tcp:35:ls.0 Request processed in 127us (380us total) trans 4294969428 rc 0/0 00000100:00100000:2.0:1790771166.991756:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1676 00010000:00010000:3.0:1790771166.991760:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991768:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991775:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991786:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991792:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991798:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.991804:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0eb72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36388 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.991812:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6428 00010000:00010000:1.0:1790771166.991818:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0eb79 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36388 expref: 125 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991819:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.991828:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+186:14439:x1877759534022144:12345-192.168.204.50@tcp:36:mcreate.0 00010000:00010000:3.0:1790771166.991830:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.991850:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771166.991852:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.991854:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771166.991858:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3a00, rc 0) 00010000:00010000:3.0:1790771166.991861:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.991862:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 33 locks, starting at 0 00010000:00010000:3.0:1790771166.991865:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991872:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991879:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc3607af00) 00010000:00010000:2.0:1790771166.991882:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0e82a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 44 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3606a expref: 186 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991883:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771166.991890:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14616:x1877759534021504:12345-192.168.204.50@tcp:101:cp.0 Request processed in 249us (580us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.991890:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991908:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6426 00010000:00010000:3.0:1790771166.991908:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0eb87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.991919:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c39c00/0xfa0c505d97f0e800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 43 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36063 expref: 185 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991924:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991932:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6429 00010000:00010000:3.0:1790771166.991935:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991943:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.991945:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+184:14667:x1877759533997824:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771166.991946:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0e7c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 42 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3605c expref: 184 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991952:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.991958:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.991959:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.991969:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0eb95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 43 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36254 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991975:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.991981:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0e7ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 43 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36055 expref: 183 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.991985:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd870248a (ffff8bfb02b20e00) 00010000:00010000:3.0:1790771166.991991:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.991995:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992000:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992001:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eb8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992006:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0e75f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 41 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3604e expref: 183 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992024:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992036:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992042:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03f72e00/0xfa0c505d97f0e74a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 40 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36047 expref: 182 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992044:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0eb80 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3625b expref: 182 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.992055:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00000004:00200000:1.0:1790771166.992061:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.992069:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc3607af00) 00010000:00010000:3.0:1790771166.992073:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1790771166.992074:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992077:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0eb80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3625b expref: 182 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992083:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0e743 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36040 expref: 182 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992106:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4e00, rc 0) 00000100:00100000:0.0:1790771166.992113:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.992113:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0eb95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 38 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36254 expref: 181 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992120:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0e678 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 39 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36039 expref: 181 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.992134:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+180:15040:x1877759533997952:12345-192.168.204.50@tcp:101:cp.0 Request processed in 427us (739us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771166.992142:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36254 expref: 179 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.992150:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6427 00010000:00010000:2.0:1790771166.992152:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0e64e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 36 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36032 expref: 179 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992156:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771166.992163:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771166.992169:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3200, rc 0) 00000100:00100000:0.0:1790771166.992173:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.992174:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022400 00000100:00100000:3.0:1790771166.992182:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022400 00000100:00100000:1.0:1790771166.992196:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+177:14667:x1877759533997824:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 257us (734us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771166.992196:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0e647 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 35 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36024 expref: 177 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992212:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6429 00000100:00100000:3.0:1790771166.992213:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022272 00000100:00100000:3.0:1790771166.992218:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022272 00010000:00010000:2.0:1790771166.992228:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0e640 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 34 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3602b expref: 175 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992237:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6430 00000100:00100000:1.0:1790771166.992247:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15067:x1877759534022400:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:3.0:1790771166.992251:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6431 00010000:00010000:2.0:1790771166.992252:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0e62b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 33 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3601d expref: 174 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992262:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.992268:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14853:x1877759534022272:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771166.992270:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1790771166.992282:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.992283:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0e5fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 32 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36016 expref: 173 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992289:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0e42c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f9 expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992293:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eba3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3638f expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992306:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.992314:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0e5de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 31 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3600f expref: 172 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992329:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f054ac lrc: 0/0,0 mode: --/CR res: [0x240000403:0x1b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e32df0 expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992337:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771166.992341:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0e598 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 30 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36001 expref: 171 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992350:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:1.0:1790771166.992355:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.992358:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022528 00000100:00100000:0.0:1790771166.992362:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022528 00010000:00010000:2.0:1790771166.992367:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60000/0xfa0c505d97f0e567 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 29 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36008 expref: 171 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992369:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992380:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992385:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022656 00000100:00100000:0.0:1790771166.992390:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022656 00010000:00010000:1.0:1790771166.992392:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992400:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992401:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 4/0,1 mode: --/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992404:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0e4f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 28 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fec expref: 170 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992405:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022784 00000100:00100000:0.0:1790771166.992415:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022784 00010000:00010000:3.0:1790771166.992426:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992434:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6432 00010000:00010000:1.0:1790771166.992439:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 126 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992444:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992445:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73000/0xfa0c505d97f0e4fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 27 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ffa expref: 169 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992446:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+169:15003:x1877759534022528:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771166.992464:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 126 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992467:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992474:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771166.992510:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0d5ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b00 expref: 169 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992524:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539773952:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771166.992529:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992542:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0e4e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 26 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fde expref: 168 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992560:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0d132 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359d3 expref: 166 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992567:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829a80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.992574:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c73c00/0xfa0c505d97f0e4f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 25 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ff3 expref: 165 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992583:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0be3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35136 expref: 165 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992583:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992593:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6433 00010000:00010000:2.0:1790771166.992601:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0e41e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 24 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fbb expref: 164 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992607:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.992608:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14814:x1877759534022656:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771166.992610:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771166.992618:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771166.992625:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.992630:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992631:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992637:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0ebcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36396 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992643:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0e417 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fb4 expref: 162 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992663:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.992682:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x8e:0x0]: returning size 28314 00010000:00010000:0.0:1790771166.992685:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.992686:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771166.992697:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0e4aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd7 expref: 161 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.992700:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992705:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992723:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992725:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992729:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0e433 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc2 expref: 160 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992747:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992748:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992762:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0e479 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fd0 expref: 160 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992766:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6434 00010000:00010000:3.0:1790771166.992770:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992774:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.992781:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14390:x1877759534022784:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771166.992794:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992795:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992796:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.992803:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0e441 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fc9 expref: 159 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992808:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0ebe2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3639d expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992810:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.992817:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992818:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992841:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992845:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0ebe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992848:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0e409 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fad expref: 158 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992855:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771166.992861:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.992864:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0ebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992866:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992868:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992890:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ebb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992893:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0ebe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992893:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992904:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992906:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35fa6 expref: 157 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992915:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992938:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992943:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992948:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0e368 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f83 expref: 156 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992949:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594800 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:1.0:1790771166.992951:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.992955:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.992957:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771166.992974:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992975:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.992987:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0e2f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f7c expref: 155 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.992991:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0ebe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3639d expref: 131 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.992999:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.992999:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfb02b20000) 00010000:00010000:3.0:1790771166.993007:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.993012:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993025:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3c00/0xfa0c505d97f0ebe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3639d expref: 130 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993031:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0ebb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.993034:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0e2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f60 expref: 154 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993039:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993052:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771166.993059:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771166.993062:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993063:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3c00, rc 0) 00010000:00010000:1.0:1790771166.993072:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.993079:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0e288 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f52 expref: 153 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993080:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.993083:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eba3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3638f expref: 131 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993088:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993090:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14390:x1877759534022784:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 313us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771166.993111:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6434 00010000:00010000:1.0:1790771166.993115:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993123:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3638f expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.993127:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0e27a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f4b expref: 152 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993135:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771166.993143:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771166.993145:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:1.0:1790771166.993150:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993153:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.993154:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.993158:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771166.993162:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00010000:00010000:1.0:1790771166.993164:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ebd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.993166:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771166.993179:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534022912 00010000:00010000:1.0:1790771166.993181:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993185:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534022912 00010000:00010000:1.0:1790771166.993187:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993193:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3face680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14853:x1877759534022272:12345-192.168.204.50@tcp:101:cp.0 Request processed in 926us (1023us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.993195:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993208:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771166.993211:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6431 00010000:00010000:1.0:1790771166.993213:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993218:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:14439:x1877759534022144:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 1392us (1793us total) trans 0 rc -17/-17 00010000:00010000:1.0:1790771166.993221:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993228:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6435 00010000:00010000:1.0:1790771166.993240:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x391d5834 (ffff8bfb0321a300) 00000100:00100000:2.0:1790771166.993241:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6428 00000100:00100000:0.0:1790771166.993247:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14867:x1877759534022912:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771166.993248:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.993253:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993258:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ebdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993261:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.993273:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ebf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363a4 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993284:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0ebcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36396 expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993297:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36396 expref: 130 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993303:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771166.993305:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993311:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:3.0:1790771166.993312:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.993316:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1be00, rc 0) 00010000:00010000:0.0:1790771166.993328:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993333:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023424 00010000:00010000:0.0:1790771166.993336:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993339:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023424 00000100:00100000:1.0:1790771166.993343:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14814:x1877759534022656:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 737us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.993352:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.993354:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.993357:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6433 00010000:00010000:0.0:1790771166.993366:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993373:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993378:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999232 00000100:00100000:3.0:1790771166.993383:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999232 00000100:00100000:2.0:1790771166.993384:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1677 00000100:00100000:2.0:1790771166.993396:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14508:x1877759534023424:12345-192.168.204.50@tcp:49:mkdir.0 00010000:00010000:0.0:1790771166.993407:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993414:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6436 00010000:00010000:0.0:1790771166.993416:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993424:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993428:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:14803:x1877759533999232:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771166.993440:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:0.0:1790771166.993446:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1790771166.993451:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771166.993451:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0ec13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36277 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993453:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14508:x1877759534023424:12345-192.168.204.50@tcp:49:mkdir.0 Request processed in 57us (145us total) trans 0 rc -61/-61 00000004:00010000:0.0:1790771166.993461:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993475:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1677 00010000:00010000:0.0:1790771166.993476:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993509:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993513:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993518:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993519:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993525:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.993531:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993533:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993538:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993544:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993549:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771166.993553:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.993557:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.993565:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00010000:00010000:0.0:1790771166.993566:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ebfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.993570:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771166.993582:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993587:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993596:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771166.993599:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0ec13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36277 expref: 153 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993604:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993626:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993632:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36277 expref: 152 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993637:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771166.993642:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:0.0:1790771166.993645:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993646:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.993667:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a02600, rc 0) 00010000:00010000:0.0:1790771166.993672:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771166.993686:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd6e9df9d (ffff8bfc3607d800) 00000100:00100000:3.0:1790771166.993689:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:14803:x1877759533999232:12345-192.168.204.50@tcp:101:cp.0 Request processed in 264us (339us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.993691:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771166.993696:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993702:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6436 00010000:00010000:0.0:1790771166.993707:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ec05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.993713:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023936 00000100:00100000:1.0:1790771166.993719:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023936 00010000:00010000:0.0:1790771166.993737:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ebf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363a4 expref: 130 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993740:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 127 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993756:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363a4 expref: 129 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.993762:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc13395700) 00010000:00010000:0.0:1790771166.993764:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771166.993767:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:1.0:1790771166.993778:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1776 00000100:00100000:2.0:1790771166.993784:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.993787:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14867:x1877759534022912:12345-192.168.204.50@tcp:101:ln.0 Request processed in 547us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771166.993792:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2396:x1877759534023936:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771166.993799:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6435 00010000:00010000:1.0:1790771166.993803:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771166.993809:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023808 00010000:00010000:1.0:1790771166.993810:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 127 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.993815:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023808 00010000:00010000:1.0:1790771166.993823:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 127 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993824:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534024576 00000100:00100000:0.0:1790771166.993830:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534024576 00010000:00010000:3.0:1790771166.993837:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 152 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993838:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.993845:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0e3d8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361b3 expref: 127 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1678 00000100:00100000:0.0:1790771166.993878:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14066:x1877759534024576:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771166.993878:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1777 00000100:00100000:2.0:1790771166.993885:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.993894:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:2397:x1877759534023808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771166.993903:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771166.993907:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771166.993908:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 152 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993915:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.993923:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993924:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 152 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.993930:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771166.993941:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.993953:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0c7e6 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35772 expref: 152 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.993954:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:14066:x1877759534024576:12345-192.168.204.50@tcp:35:ls.0 Request processed in 83us (364us total) trans 4294968852 rc 0/0 00010000:00010000:1.0:1790771166.993960:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771166.993962:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025216 00000100:00100000:2.0:1790771166.993970:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025216 00000100:00100000:0.0:1790771166.993971:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1678 00000100:00100000:1.0:1790771166.993982:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2396:x1877759534023936:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 192us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771166.993989:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc08974800) 00000100:00100000:1.0:1790771166.993994:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1776 00010000:00010000:3.0:1790771166.993995:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994003:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.994009:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1679 00010000:00010000:3.0:1790771166.994010:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 4/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.994020:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14668:x1877759534025216:12345-192.168.204.50@tcp:35:lfs.0 00010000:00010000:3.0:1790771166.994031:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771166.994056:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:2397:x1877759534023808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.994064:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1777 00000100:00100000:2.0:1790771166.994070:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771166.994095:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023296 00000100:00100000:3.0:1790771166.994099:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023296 00000100:00100000:0.0:1790771166.994106:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14668:x1877759534025216:12345-192.168.204.50@tcp:35:lfs.0 Request processed in 89us (183us total) trans 4294969430 rc 0/0 00000100:00100000:0.0:1790771166.994113:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1679 00000100:00100000:3.0:1790771166.994130:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999360 00000100:00100000:3.0:1790771166.994134:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999360 00000100:00100000:1.0:1790771166.994140:0:13792:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025344 00000100:00100000:1.0:1790771166.994146:0:13792:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025344 00010000:00010000:0.0:1790771166.994150:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.994156:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6437 00010000:00010000:0.0:1790771166.994165:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.994170:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6438 00000100:00100000:2.0:1790771166.994175:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14782:x1877759534023296:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:1.0:1790771166.994184:0:13792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 38 00000100:00100000:3.0:1790771166.994190:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:14595:x1877759533999360:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771166.994192:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771166.994199:0:13792:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:14680:x1877759534025344:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:0.0:1790771166.994200:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994205:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0ec21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363b9 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994217:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994227:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994234:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771166.994238:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994246:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 4/0,0 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994249:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994259:0:13792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 13 locks, starting at 0 00010000:00010000:3.0:1790771166.994259:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.994264:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771166.994269:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994270:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771166.994272:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ec2f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3627e expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994277:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994277:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0cfbf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e359a2 expref: 152 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994296:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994297:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105800/0xfa0c505d97f0eaa7 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994322:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994327:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0beee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353f2 expref: 152 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994334:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994335:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994341:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00000100:00100000:0.0:1790771166.994346:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14813:x1877759534018176:12345-192.168.204.50@tcp:55:chown.0 Request processed in 11197us (11304us total) trans 0 rc -22/-22 00010000:00010000:2.0:1790771166.994360:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994361:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0e96c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3609b expref: 151 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994361:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.994362:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6411 00010000:00010000:2.0:1790771166.994390:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994391:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000004:00200000:3.0:1790771166.994394:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x59:0x0]: returning size 4096 00000004:00200000:3.0:1790771166.994401:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.994406:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0df2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35dca expref: 150 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771166.994414:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994424:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0d77c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b62 expref: 150 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994434:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ec2f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3627e expref: 149 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994442:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0d783 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b9a expref: 149 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994448:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994452:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3627e expref: 148 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994474:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771166.994475:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687400/0xfa0c505d97f0d78a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ba8 expref: 147 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994476:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.994481:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771166.994518:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1a00, rc 0) 00010000:00010000:2.0:1790771166.994519:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994523:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0d7c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35baf expref: 146 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.994550:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:14595:x1877759533999360:12345-192.168.204.50@tcp:101:ln.0 Request processed in 366us (671us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771166.994551:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0d832 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35bc4 expref: 145 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771166.994561:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x12:0x0]: returning size 5134 00000100:00100000:3.0:1790771166.994568:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6438 00000004:00200000:2.0:1790771166.994570:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771166.994582:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0d9eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c73 expref: 143 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771166.994585:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994599:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994601:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0d9f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c88 expref: 142 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994607:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994623:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994625:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994645:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994672:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994680:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0da07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c81 expref: 141 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994681:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994681:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.994690:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994701:0:13774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994714:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0da0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c50 expref: 140 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994714:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.994716:0:13774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994744:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:0.0:1790771166.994746:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03fff100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-mdtlov_UUID:13774:1877759539774080:0@lo:101:mdt00_019.0 00010000:00010000:1.0:1790771166.994748:0:13792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771166.994750:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771166.994757:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.994762:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994767:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994769:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ec28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994781:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.994786:0:13774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771166.994793:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994796:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.994806:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc10429b40 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.994812:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994821:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994822:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994841:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994842:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.994849:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994852:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994871:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994872:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994890:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994895:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xcdd6ff3 (ffff8bfc34224f00) 00010000:00010000:1.0:1790771166.994898:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994900:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.994906:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994913:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ec3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994945:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994946:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0ec21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 132 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994967:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.994976:0:13792:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994977:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 131 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.994993:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:2.0:1790771166.994996:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771166.995000:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0200, rc 0) 00010000:00010000:1.0:1790771166.995003:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995012:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 131 pid: 13766 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771166.995021:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539774208:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.995043:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14782:x1877759534023296:12345-192.168.204.50@tcp:101:ln.0 Request processed in 872us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771166.995053:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6437 00000100:00100000:1.0:1790771166.995062:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829840 going to sleep for 11 seconds 00000100:00100000:2.0:1790771166.995088:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539774080 00000100:00100000:2.0:1790771166.995094:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539774080 00000100:00100000:2.0:1790771166.995135:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1790771166.995146:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:13774:x1877759539774080:12345-0@lo:101:mdt00_019.0 00010000:00010000:2.0:1790771166.995156:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771166.995168:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0ec4b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995185:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995196:0:6499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 4/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995217:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995227:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 124 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.995238:0:6499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6499:1877759539774336:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771166.995278:0:6499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ccc0 going to sleep for 11 seconds 00000001:00080000:0.0:1790771166.995393:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969429 is committed 00000100:00100000:3.0:1790771166.995404:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11371850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14073:x1877759534019584:12345-192.168.204.50@tcp:37:ls.0 Request processed in 10432us (10827us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771166.995411:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1672 00000020:00080000:0.0:1790771166.995414:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 52 batchid updated 00010000:00010000:2.0:1790771166.995432:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.995437:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969425 is committed 00010000:00010000:2.0:1790771166.995445:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995454:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995458:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995463:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.995470:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995471:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771166.995472:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969408 is committed 00010000:00010000:1.0:1790771166.995521:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995526:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.995530:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995535:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771166.995543:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e6f45ec4 reply state 0000000048bf0b73 transno 4294969429 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995546:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x65:0x0].0x0 (ffff8bfb03146600) 00010000:00010000:1.0:1790771166.995552:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.995556:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.995557:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 52 00010000:00010000:0.0:1790771166.995564:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995570:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0e973 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x65:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.995590:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.995597:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.995598:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00080000:3.0:1790771166.995602:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc3fa636c0 with version 83 00000100:00100000:0.0:1790771166.995603:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771166.995609:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.995610:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000020:00080000:3.0:1790771166.995616:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 51 cancel update log [0x240000401:0x3:0x0].40: rc = 0 00010000:00010000:2.0:1790771166.995619:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:1.0:1790771166.995620:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995627:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790771166.995630:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995633:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995645:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00080000:0.0:1790771166.995646:0:12128:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:2.0:1790771166.995665:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0e65c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995669:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.995675:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15003:x1877759534022528:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 3230us (3416us total) trans 4294969429 rc 0/0 00000020:00080000:3.0:1790771166.995675:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 51 cancel update log [0x200000400:0x3:0x0].40: rc = 0 00010000:00010000:1.0:1790771166.995690:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771166.995696:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 52 00000100:00100000:0.0:1790771166.995697:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6432 00010000:00010000:2.0:1790771166.995704:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995708:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x7a94fdef (ffff8bfc34224100) 00000004:00080000:3.0:1790771166.995709:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 83 rpc_version 83 00010000:00010000:1.0:1790771166.995716:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.995721:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995721:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1790771166.995730:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1790771166.995737:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0e9ff lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995742:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.995742:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3fb4e680 x1877759539774592/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1790771166.995753:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995765:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.995772:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995773:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.995777:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539774592:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771166.995790:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995794:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995796:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a02000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.995801:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995814:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995819:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xc8b04d25 (ffff8bfb0321a800) 00010000:00010000:1.0:1790771166.995822:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:2.0:1790771166.995825:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.995826:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771166.995834:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995835:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.995844:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0eaa0 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995852:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0e694 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x6d:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.995854:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771166.995881:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63a80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771166.995885:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.995892:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539774592 00010000:00010000:2.0:1790771166.995895:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.995898:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539774592 00010000:00010000:2.0:1790771166.995906:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995913:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.995917:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.995925:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00010000:00010000:2.0:1790771166.995925:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.995935:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539774592:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1790771166.995943:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771166.995948:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771166.995952:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995958:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ea99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995971:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995978:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995985:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.995991:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.995995:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996002:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996011:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:2.0:1790771166.996014:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771166.996018:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.996023:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7768:x1877759539774592:12345-0@lo:1000:osp_up1-0.0 Request processed in 88us (172us total) trans 4294968853 rc 0/0 00010000:00010000:2.0:1790771166.996030:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104000/0xfa0c505d97f0eaf4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.996034:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:3.0:1790771166.996053:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4e680 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539774592:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1790771166.996055:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996064:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996071:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996076:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771166.996079:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996088:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996096:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771166.996099:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771166.996102:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771166.996108:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ebc6 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.998721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.998743:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.998762:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534006912 00000100:00100000:2.0:1790771166.998768:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534006912 00000100:00100000:2.0:1790771166.998801:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534026880 00000100:00100000:2.0:1790771166.998805:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534026880 00000100:00100000:3.0:1790771166.998822:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6439 00000100:00100000:3.0:1790771166.998833:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14636:x1877759534006912:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:0.0:1790771166.998835:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6440 00000100:00100000:0.0:1790771166.998848:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13733:x1877759534026880:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771166.998848:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771166.998860:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0ec75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36104 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.998861:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771166.998872:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ec7c lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36406 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.998913:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.998918:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00010000:00010000:3.0:1790771166.998922:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.998930:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771166.998937:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00010000:00010000:0.0:1790771166.998961:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ec7c lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36406 expref: 127 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.998970:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771166.998973:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771166.998977:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ec7c lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36406 expref: 127 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.998986:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00010000:00010000:3.0:1790771166.998992:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0800/0xfa0c505d97f0ec75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 123 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771166.999010:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 122 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999015:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13733:x1877759534026880:12345-192.168.204.50@tcp:101:ls.0 Request processed in 168us (269us total) trans 4294968854 rc 301/301 00010000:00010000:3.0:1790771166.999023:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:0.0:1790771166.999027:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6440 00010000:00010000:3.0:1790771166.999029:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1790771166.999033:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee1000, rc 0) 00000100:00100000:3.0:1790771166.999059:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14636:x1877759534006912:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 229us (338us total) trans 4294969431 rc 0/0 00000100:00100000:3.0:1790771166.999064:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6439 00000100:00100000:0.0:1790771166.999429:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.999452:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771166.999470:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.999479:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025856 00000100:00100000:1.0:1790771166.999508:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025728 00000100:00100000:2.0:1790771166.999509:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025856 00000100:00100000:1.0:1790771166.999514:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025728 00000100:00100000:0.0:1790771166.999521:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.999555:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025984 00000100:00100000:0.0:1790771166.999563:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771166.999563:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6441 00000100:00100000:2.0:1790771166.999564:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025984 00000100:00100000:3.0:1790771166.999567:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025600 00000100:00100000:3.0:1790771166.999574:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025600 00000100:00100000:1.0:1790771166.999579:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14669:x1877759534025728:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771166.999588:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.999598:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0ec98 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363f1 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999599:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.999611:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1680 00000100:00100000:0.0:1790771166.999627:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771166.999628:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:12241:x1877759534025856:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771166.999631:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999642:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759533999488 00010000:00010000:1.0:1790771166.999643:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999648:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759533999488 00002000:00100000:3.0:1790771166.999662:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (585728->589823) req@ffff8bfb03ffe680 x1877759534025600/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/0 e 0 to 0 dl 1790771177 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771166.999671:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999685:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030208 00002000:00100000:3.0:1790771166.999688:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ffe680 with x1877759534025600 ext(585728->589823) 00000100:00100000:0.0:1790771166.999689:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030208 00010000:00010000:1.0:1790771166.999696:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771166.999698:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03ffe680 00010000:00010000:1.0:1790771166.999707:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999710:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534014592 00000100:00100000:0.0:1790771166.999714:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534014592 00010000:00010000:1.0:1790771166.999716:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771166.999740:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6442 00000100:00100000:0.0:1790771166.999748:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14552:x1877759533999488:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771166.999757:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771166.999758:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.999770:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0ecb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36285 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999770:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.999771:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12241:x1877759534025856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 146us (336us total) trans 4294968855 rc 0/0 00000100:00100000:3.0:1790771166.999793:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 448 00000100:00100000:2.0:1790771166.999795:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1680 00010000:00010000:1.0:1790771166.999800:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.999805:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534025600:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:0.0:1790771166.999816:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771166.999820:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1681 00010000:00010000:0.0:1790771166.999830:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771166.999832:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x37:0x0]: returning size 38336 00000100:00100000:2.0:1790771166.999837:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13998:x1877759534025984:12345-192.168.204.50@tcp:37:ls.0 00000004:00200000:1.0:1790771166.999842:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771166.999845:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771166.999860:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.999870:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9314 00010000:00010000:1.0:1790771166.999873:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771166.999874:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771166.999885:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999885:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.999906:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999906:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 4/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999931:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771166.999936:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab400/0xfa0c505d97f0ecb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36285 expref: 126 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999941:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.999948:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534025600:12345-192.168.204.50@tcp:3:cat.0 Request processed in 145us (474us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771166.999951:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36285 expref: 125 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999955:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771166.999963:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771166.999965:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 448 00010000:00010000:0.0:1790771166.999970:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771166.999977:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771166.999980:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aaa00, rc 0) 00010000:00010000:1.0:1790771166.999984:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 5/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771166.999994:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:1.0:1790771166.999996:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771166.999999:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 3/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.000006:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14552:x1877759533999488:12345-192.168.204.50@tcp:101:rm.0 Request processed in 258us (449us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.000008:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ec9f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.000018:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6442 00002000:00100000:3.0:1790771167.000019:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (585728->589823) req@ffff8bfb03ffe680 x1877759534025600/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:267/0 lens 488/440 e 0 to 0 dl 1790771177 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771167.000024:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.000037:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6443 00010000:00010000:1.0:1790771167.000044:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.000044:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03ffe680 with x1877759534025600 ext(585728->589823) 00000100:00100000:0.0:1790771167.000050:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13741:x1877759534030208:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.000058:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000062:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.000064:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.000068:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000071:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ecc2 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3640d expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000074:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.000085:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03ffe680 00010000:00010000:1.0:1790771167.000091:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0xcdd6ff3 (ffff8bfc36078500) 00010000:00010000:1.0:1790771167.000096:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.000100:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000107:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eca6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x34:0x0].0xcdd6ff3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000111:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0ecc9 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000121:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0ecc9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000127:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0ecc9 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.000133:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.000139:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0ec98 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f1 expref: 131 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000150:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82600/0xfa0c505d97f0ecad lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f1 expref: 130 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000156:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00010000:00010000:1.0:1790771167.000157:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.000159:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82600, rc 0) 00000100:00100000:3.0:1790771167.000187:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6444 00000100:00100000:1.0:1790771167.000192:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14669:x1877759534025728:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 609us (729us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.000194:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ecc2 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3640d expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.000199:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14893:x1877759534014592:12345-192.168.204.50@tcp:101:timeout.0 00000100:00100000:1.0:1790771167.000209:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6441 00010000:00010000:0.0:1790771167.000226:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa600/0xfa0c505d97f0ecc9 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3640d expref: 130 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000242:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.000245:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.000248:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa600, rc 0) 00000100:00100000:1.0:1790771167.000254:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.000281:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13741:x1877759534030208:12345-192.168.204.50@tcp:101:ls.0 Request processed in 233us (682us total) trans 4294968856 rc 0/0 00000100:00100000:0.0:1790771167.000288:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6443 00000100:00100000:0.0:1790771167.000301:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534024192 00000100:00100000:0.0:1790771167.000304:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534024192 00000100:00100000:1.0:1790771167.000328:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.000337:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534026368 00000100:00100000:0.0:1790771167.000341:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534026368 00000100:00100000:0.0:1790771167.000364:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6445 00000100:00100000:0.0:1790771167.000372:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14868:x1877759534024192:12345-192.168.204.50@tcp:101:fallocate.0 00000100:00100000:1.0:1790771167.000378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.000383:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.000393:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0ecd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363ce expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000397:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534015232 00000100:00100000:1.0:1790771167.000402:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534015232 00010000:00010000:0.0:1790771167.000426:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000434:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6446 00010000:00010000:3.0:1790771167.000438:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.000440:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000448:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14512:x1877759534026368:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771167.000452:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000452:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0ece5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36326 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.000472:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6447 00010000:00010000:1.0:1790771167.000473:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790771167.000481:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000512:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000516:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.000520:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13293:x1877759534015232:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.000532:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0b571 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x37:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34fca expref: 130 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000533:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000537:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000541:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.000557:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000559:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0ecfa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3632d expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000565:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97eff22e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ba6 expref: 129 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000588:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771167.000598:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0df4e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e6b expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000602:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ed01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000605:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771167.000610:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.000611:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000620:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ed01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000621:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.000631:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 76520 00010000:00010000:2.0:1790771167.000640:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0ed0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000642:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 52 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000642:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1e00/0xfa0c505d97f0ece5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000685:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000686:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 4/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000688:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000696:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 128 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000705:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000719:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000724:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771167.000726:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 52 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000727:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.000732:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771167.000737:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04ee0400, rc 0) 00010000:00010000:0.0:1790771167.000748:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000754:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 52 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.000755:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x5b:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.000756:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.000762:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.000764:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.000765:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14893:x1877759534014592:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 568us (1139us total) trans 0 rc 0/0 00000004:00010000:2.0:1790771167.000781:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0ed0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000786:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539774720:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.000788:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6444 00010000:00010000:0.0:1790771167.000791:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000811:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.000813:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.000816:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000822:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0ecde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000827:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0ecfa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3632d expref: 128 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000830:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829300 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.000834:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.000848:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.000851:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000858:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105000/0xfa0c505d97f0ed0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x5b:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3632d expref: 127 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000859:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.000871:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534027648 00010000:00010000:0.0:1790771167.000874:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.000877:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534027648 00010000:00010000:0.0:1790771167.000879:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000886:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x5b:0x0].0x0 (ffff8bfc3607d400) 00010000:00010000:0.0:1790771167.000888:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.000890:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.000897:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105000, rc 0) 00000100:00100000:1.0:1790771167.000898:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.000906:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xdcc87686 (ffff8bfc3607d800) 00010000:00010000:0.0:1790771167.000909:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.000911:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.000914:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534028160 00000100:00100000:3.0:1790771167.000919:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534028160 00010000:00010000:0.0:1790771167.000922:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0ecec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.000929:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6448 00000100:00100000:2.0:1790771167.000935:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13293:x1877759534015232:12345-192.168.204.50@tcp:101:ls.0 Request processed in 449us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.000943:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14757:x1877759534027648:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:2.0:1790771167.000948:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6447 00010000:00010000:0.0:1790771167.000953:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0ecd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ce expref: 120 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.000954:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.000960:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6449 00010000:00010000:1.0:1790771167.000965:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ed1d lrc: 2/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36430 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.000973:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3600/0xfa0c505d97f0ed01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ce expref: 119 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.000974:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14987:x1877759534028160:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00080000:2.0:1790771167.000979:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1790771167.000988:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:0.0:1790771167.000990:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.000992:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3600, rc 0) 00010000:00010000:1.0:1790771167.001009:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.001017:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14868:x1877759534024192:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 644us (761us total) trans 4294969432 rc 0/0 00010000:00010000:1.0:1790771167.001024:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 2/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 130 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.001026:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6445 00010000:00010000:1.0:1790771167.001036:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 4/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.001043:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14987:x1877759534028160:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 71us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.001050:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6449 00010000:00010000:1.0:1790771167.001059:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 130 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.001064:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.001075:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 129 pid: 13761 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001087:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539774848:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.001095:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534028928 00000100:00100000:3.0:1790771167.001099:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534028928 00000100:00100000:1.0:1790771167.001122:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05321900 going to sleep for 11 seconds 00000100:00080000:2.0:1790771167.001134:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790771167.001140:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6450 00000100:00100000:3.0:1790771167.001148:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14588:x1877759534028928:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:3.0:1790771167.001155:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.001167:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0ed2b lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36461 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001191:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ed32 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001198:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001205:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ed32 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001224:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc08b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539773184:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.001241:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36342 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.001256:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03400, rc 0) 00000100:00100000:2.0:1790771167.001257:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.001278:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6494:1877759539773312:192.168.204.50@tcp:104: 00000004:00200000:3.0:1790771167.001289:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.001296:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001297:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:11733:x1877759534016896:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 17670us (18455us total) trans 0 rc 0/0 00000004:00200000:3.0:1790771167.001297:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1790771167.001316:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1048 00010000:00010000:3.0:1790771167.001331:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02000/0xfa0c505d97f0ed2b lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36461 expref: 129 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001348:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534029696 00000100:00100000:1.0:1790771167.001354:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534029696 00002000:00010000:0.0:1790771167.001361:0:13782:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size: 2272 -> 4196581 00000100:00100000:2.0:1790771167.001361:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771167.001368:0:13782:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime: 1790771165 -> 1790771167 00002000:00010000:0.0:1790771167.001371:0:13782:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime: 1790771165 -> 1790771166 00002000:00010000:0.0:1790771167.001375:0:13782:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime: 1790771166 -> 1790771167 00002000:00010000:0.0:1790771167.001378:0:13782:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks: 8 -> 8200 00000100:00100000:1.0:1790771167.001389:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6451 00000100:00100000:0.0:1790771167.001390:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539773440:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771167.001401:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14582:x1877759534029696:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:3.0:1790771167.001408:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ed32 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36461 expref: 128 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.001410:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.001416:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072b1627c/0xfa0c505d97f0eaed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36349 expref: 25 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001418:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb02b20000) 00010000:00010000:1.0:1790771167.001423:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ed39 lrc: 2/0,0 mode: --/CR res: [0x240000402:0xad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36484 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001426:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771167.001431:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06a03800, rc 0) 00010000:00010000:0.0:1790771167.001445:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072b1627c/0xfa0c505d97f0eaed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36349 expref: 25 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.001457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.001458:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ed39 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36484 expref: 131 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.001471:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00010000:00010000:1.0:1790771167.001472:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2600/0xfa0c505d97f0ed39 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xad:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36484 expref: 131 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.001478:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023552 00010000:00010000:1.0:1790771167.001518:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xad:0x0].0x0 (ffff8bfb0321a400) 00010000:00010000:1.0:1790771167.001523:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1790771167.001525:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14588:x1877759534028928:12345-192.168.204.50@tcp:101:ln.0 Request processed in 376us (468us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.001528:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2600, rc 0) 00000100:00100000:2.0:1790771167.001531:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023552 00000100:00100000:0.0:1790771167.001536:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534017920:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 17203us (17370us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.001537:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6450 00000100:00100000:0.0:1790771167.001548:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1050 00000100:00100000:1.0:1790771167.001567:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14582:x1877759534029696:12345-192.168.204.50@tcp:101:touch.0 Request processed in 167us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.001578:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6452 00000100:00100000:0.0:1790771167.001579:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534029824 00000100:00100000:0.0:1790771167.001584:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534029824 00000100:00100000:1.0:1790771167.001588:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6451 00000100:00100000:3.0:1790771167.001590:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14997:x1877759534023552:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771167.001600:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.001605:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 26 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790771167.001610:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790771167.001612:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0ed40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363c0 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.001628:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1778 00000100:00100000:0.0:1790771167.001637:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534029824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.001646:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.001662:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.001667:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 26 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.001669:0:13793:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb size: 2097152 -> 3866624 00002000:00010000:1.0:1790771167.001678:0:13793:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb mtime: 1790771166 -> 1790771167 00000100:00100000:2.0:1790771167.001682:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.001683:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.001686:0:13793:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x2c0000400:0x3:0x0] updating lvb ctime: 1790771166 -> 1790771167 00010000:00010000:0.0:1790771167.001700:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 26 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001702:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001703:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13793:1877759539773568:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771167.001709:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534029952 00000100:00100000:2.0:1790771167.001717:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534029952 00010000:00010000:1.0:1790771167.001728:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001aa462e7/0xfa0c505d97f0eb2c lrc: 1/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36365 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.001740:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009255899a/0xfa0c505d97f05a24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3307b expref: 27 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001740:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.001745:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aa462e7/0xfa0c505d97f0eb2c lrc: 0/0,0 mode: --/PR res: [0x2c0000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36365 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.001758:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1054 00010000:00010000:1.0:1790771167.001775:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592a00, rc 0) 00000100:00100000:2.0:1790771167.001776:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2398:x1877759534029952:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771167.001780:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.001790:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1790771167.001793:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.001794:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.001795:0:9499:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(2 0) 00000100:00100000:1.0:1790771167.001803:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2397:x1877759534020352:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 16118us (16242us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771167.001809:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36342 expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.001810:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006757b7ea/0xfa0c505d97f0ed55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3648b expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.001816:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1052 00010000:00010000:0.0:1790771167.001835:0:9499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36342 expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001842:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001854:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.001860:0:9499:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca611e1e/0xfa0c505d97f0eaca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36342 expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001867:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.001873:0:8406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539775104:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771167.001875:0:9499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539774976:192.168.204.50@tcp:105: 00000004:00200000:3.0:1790771167.001892:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00000100:00100000:0.0:1790771167.001926:0:9499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc03fd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.001931:0:8406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.001945:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.001967:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030336 00000100:00100000:0.0:1790771167.001971:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030336 00000004:00010000:3.0:1790771167.001974:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001983:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.001989:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.002003:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6453 00000100:00100000:1.0:1790771167.002003:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539773696:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.002017:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14078:x1877759534030336:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:1.0:1790771167.002024:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002025:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.002027:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002034:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ed63 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36492 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002047:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.002051:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002060:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002070:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0ed6a lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002072:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.002083:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002091:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0ed6a lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002101:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771167.002110:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.002113:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1790771167.002130:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ed63 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36492 expref: 130 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002130:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030464 00000100:00100000:2.0:1790771167.002137:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030464 00010000:00010000:0.0:1790771167.002148:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0ed6a lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36492 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002150:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.002158:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002161:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb02b20000) 00010000:00010000:0.0:1790771167.002169:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771167.002170:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0ed47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002175:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af600, rc 0) 00000100:00100000:2.0:1790771167.002180:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1055 00010000:00010000:3.0:1790771167.002183:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002190:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002196:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:14924:x1877759534030464:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771167.002199:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.002207:0:12031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.002211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.002221:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14078:x1877759534030336:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 203us (274us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.002222:0:12031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36499 expref: -99 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.002238:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6453 00000100:00100000:0.0:1790771167.002261:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030848 00010000:00010000:2.0:1790771167.002262:0:12031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 29 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002263:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5c00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.002268:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030848 00010000:00010000:3.0:1790771167.002270:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.002285:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790771167.002288:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.002290:0:12031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1790771167.002298:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6454 00010000:00010000:2.0:1790771167.002305:0:12031:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36499 expref: 29 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002307:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.002313:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14616:x1877759534030848:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:1.0:1790771167.002343:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.002343:0:12031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 29 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002351:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002351:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x510a92c1 (ffff8bfb02b20e00) 00010000:00010000:3.0:1790771167.002359:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.002360:0:12031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 29 pid: 13788 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002365:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002370:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 128 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002386:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.002391:0:12031:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539775232:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.002402:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0ed4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.002413:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002428:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.002436:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03a03a00/0xfa0c505d97f0ed40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c0 expref: 122 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002442:0:12031:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.002447:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 128 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002449:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c0 expref: 121 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002463:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534026624 00000100:00100000:2.0:1790771167.002470:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534026624 00010000:00010000:3.0:1790771167.002471:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:0.0:1790771167.002477:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 128 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002477:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.002480:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5800, rc 0) 00000100:00100000:3.0:1790771167.002524:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14997:x1877759534023552:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 936us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.002530:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06374380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539775360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.002533:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.002545:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1056 00000100:00100000:2.0:1790771167.002556:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2396:x1877759534026624:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771167.002566:0:13788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.002567:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d99aa80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.002578:0:13788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ba7f700/0xfa0c505d97f0ed7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363ff expref: -99 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.002579:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6452 00000100:00100000:3.0:1790771167.002602:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023680 00000100:00100000:3.0:1790771167.002606:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023680 00000100:00100000:2.0:1790771167.002624:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539775488:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771167.002645:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.002678:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c180 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.002686:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534029056 00000100:00100000:3.0:1790771167.002688:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6455 00000100:00100000:1.0:1790771167.002691:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534029056 00000100:00100000:3.0:1790771167.002701:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14897:x1877759534023680:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771167.002710:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.002718:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ed86 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363c7 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002721:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534028544 00000100:00100000:1.0:1790771167.002725:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534028544 00000100:00100000:1.0:1790771167.002748:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030080 00000100:00100000:1.0:1790771167.002751:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030080 00010000:00010000:3.0:1790771167.002751:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002753:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534030976 00000100:00100000:2.0:1790771167.002761:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534030976 00010000:00010000:3.0:1790771167.002763:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002768:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 124 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002773:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002788:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002794:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002795:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1779 00000100:00100000:2.0:1790771167.002804:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1682 00000100:00100000:1.0:1790771167.002811:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:2396:x1877759534030080:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.002812:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.002821:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11371050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:15069:x1877759534030976:12345-192.168.204.50@tcp:37:rm.0 00010000:00010000:1.0:1790771167.002822:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.002830:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 124 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002840:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 124 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002852:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03a00/0xfa0c505d97f0ded0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35e3a expref: 124 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002862:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:3.0:1790771167.002863:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002867:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002883:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002885:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002892:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002902:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002902:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.002922:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.002937:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xf:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.002939:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1790771167.002941:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771167.002951:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002958:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:2396:x1877759534030080:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 153us (315us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.002959:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.002972:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1779 00010000:00010000:3.0:1790771167.002973:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002984:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.002988:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.002990:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 879 00010000:00010000:3.0:1790771167.002993:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.003000:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2396:x1877759534029056:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.003001:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003011:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.003015:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771167.003019:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.003022:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003026:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0eb56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3623f expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003029:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0ed8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003049:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003053:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:3.0:1790771167.003055:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003061:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.003064:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003068:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.003071:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003081:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.003086:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2396:x1877759534029056:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (745us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.003096:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xd964d85e (ffff8bfb02b20200) 00000100:00100000:1.0:1790771167.003098:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 879 00010000:00010000:3.0:1790771167.003102:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.003107:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003114:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5e00/0xfa0c505d97f0ed94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.003122:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 880 00000100:00100000:1.0:1790771167.003132:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759534028544:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.003144:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.003148:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ed86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 123 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003160:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eac3 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36350 expref: 131 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003165:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 122 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003179:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:1.0:1790771167.003181:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.003182:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.003189:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.003189:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4200, rc 0) 00000100:00100000:1.0:1790771167.003215:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2396:x1877759534028544:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 86us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.003225:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 880 00000100:00100000:3.0:1790771167.003226:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14897:x1877759534023680:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 525us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.003238:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6455 00000100:00100000:0.0:1790771167.003295:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13208:x1877759534021632:12345-192.168.204.50@tcp:37:ls.0 Request processed in 11719us (11956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.003302:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1675 00000100:00100000:3.0:1790771167.003317:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539773824:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.003341:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36381 expref: 31 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.003356:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593e00, rc 0) 00010000:00010000:0.0:1790771167.003360:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.003367:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.003379:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xa:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.003386:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.003391:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.003419:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.003426:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:15043:x1877759534021248:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 12157us (12249us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.003427:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.003441:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1053 00010000:00010000:0.0:1790771167.003442:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.003455:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06377100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539775616:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1790771167.003481:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.003525:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539775616 00000100:00100000:0.0:1790771167.003526:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1045a300 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.003532:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539775616 00000100:00100000:1.0:1790771167.003561:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1790771167.003568:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6494:x1877759539775616:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1790771167.003595:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.003609:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0eda9 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003629:0:6498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 129 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003639:0:6498:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 4/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003673:0:6498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 129 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.003681:0:6498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 129 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.003688:0:6498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539775744:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.003723:0:6498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05321840 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.018534:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.018570:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534024960 00000100:00100000:0.0:1790771167.018578:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534024960 00000100:00100000:0.0:1790771167.018623:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6456 00000100:00100000:0.0:1790771167.018632:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:15098:x1877759534024960:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:0.0:1790771167.018647:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.018670:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0edb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363e3 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018719:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018730:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018737:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018750:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018756:0:13761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018762:0:13761:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018772:0:13761:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018779:0:13761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.018819:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.018858:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034944 00000100:00100000:0.0:1790771167.018863:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034944 00000100:00100000:0.0:1790771167.018890:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6457 00000100:00100000:0.0:1790771167.018895:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13666:x1877759534034944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.018908:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.018916:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0edcc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36422 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018972:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0edd3 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018983:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0edd3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.018993:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0edd3 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.019004:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.019091:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0edcc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36422 expref: 133 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.019104:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0edd3 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36422 expref: 132 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.019110:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.019112:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.019114:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3400, rc 0) 00000100:00100000:0.0:1790771167.019155:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13666:x1877759534034944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 258us (335us total) trans 4294968857 rc 0/0 00000100:00100000:0.0:1790771167.019162:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6457 00000100:00100000:1.0:1790771167.019532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.019558:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.019579:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534031360 00000100:00100000:3.0:1790771167.019585:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534031360 00000100:00100000:1.0:1790771167.019590:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.019591:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534031872 00000100:00100000:0.0:1790771167.019597:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534031872 00000100:00100000:3.0:1790771167.019619:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032128 00000100:00100000:3.0:1790771167.019624:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032128 00000100:00100000:0.0:1790771167.019640:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1683 00000100:00080000:2.0:1790771167.019642:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790771167.019667:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:13891:x1877759534031872:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.019674:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6458 00000100:00100000:1.0:1790771167.019685:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8a9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001_UUID:6495:1877759539773952:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.019686:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14814:x1877759534031360:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:2.0:1790771167.019692:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6459 00000100:00100000:2.0:1790771167.019710:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14959:x1877759534032128:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771167.019711:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.019719:0:13773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.019741:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0ebf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36396 expref: 126 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.019761:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.019761:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:3.0:1790771167.019769:0:13773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.019770:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:13891:x1877759534031872:12345-192.168.204.50@tcp:35:ls.0 Request processed in 119us (208us total) trans 4294968858 rc 0/0 00000100:00100000:1.0:1790771167.019782:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539774208:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.019783:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1683 00010000:00010000:3.0:1790771167.019789:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.019790:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.019802:0:13792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.019808:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.019815:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.019831:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.019853:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.019867:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 125 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.019881:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566e680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539775872:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.019895:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.019904:0:6499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6499:1877759539774336:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.019925:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.019932:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224500) 00000100:00100000:1.0:1790771167.019934:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.019938:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.019943:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.019950:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 3/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.019955:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05105e00, rc 0) 00000100:00100000:2.0:1790771167.019956:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.019992:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032256 00000100:00100000:2.0:1790771167.019998:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032256 00000100:00100000:0.0:1790771167.020003:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13774:x1877759539774080:12345-0@lo:101:mdt00_019.0 Request processed in 24861us (25221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.020007:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032384 00000100:00100000:0.0:1790771167.020011:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1790771167.020017:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.020024:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.020044:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032768 00000100:00100000:1.0:1790771167.020046:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.020046:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032384 00000100:00100000:0.0:1790771167.020049:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032768 00000100:00100000:2.0:1790771167.020061:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033024 00000100:00100000:2.0:1790771167.020067:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033024 00010000:00010000:3.0:1790771167.020068:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 133 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020070:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 133 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.020077:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1780 00000100:00100000:1.0:1790771167.020093:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759534032256:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.020103:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.020111:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1781 00000100:00100000:3.0:1790771167.020121:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1782 00010000:00010000:1.0:1790771167.020122:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 6/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.020128:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759534032384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.020132:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 881 00000100:00100000:3.0:1790771167.020137:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:2396:x1877759534032768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.020151:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2396:x1877759534033024:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.020151:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.020153:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.020159:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 5/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 26 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020164:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 133 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020164:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 133 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020169:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.020184:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(3 4) 00010000:00010000:1.0:1790771167.020194:0:8425:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(3 4) 00010000:00010000:0.0:1790771167.020195:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1a00/0xfa0c505d97f0ec36 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3627e expref: 126 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020195:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 133 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020200:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 133 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020203:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36381 expref: 30 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020231:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:3.0:1790771167.020235:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c72000/0xfa0c505d97f0ccaf lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e358ad expref: 133 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020237:0:8425:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36381 expref: 30 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020238:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.020245:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0978e lrc: 0/0,0 mode: --/PR res: [0x240000403:0x1b:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e346a1 expref: 133 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020259:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224500) 00000100:00100000:0.0:1790771167.020265:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2396:x1877759534033024:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (219us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.020270:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020280:0:8425:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001028217b/0xfa0c505d97f0eb64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36381 expref: 30 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020281:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00000100:00100000:0.0:1790771167.020282:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 881 00010000:00010000:3.0:1790771167.020286:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020294:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: --/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020309:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.020310:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539776000:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.020315:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.020327:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03fff100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000-mdtlov_UUID:13774:1877759539774080:0@lo:101:mdt00_019.0 00010000:00010000:2.0:1790771167.020336:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020343:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 4/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.020345:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829840 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.020346:0:13797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020361:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.020365:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 4/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.020382:0:13797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001_UUID:13797:1877759539776128:0@lo:105: 00000100:00100000:1.0:1790771167.020383:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.020397:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:2396:x1877759534032384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 273us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.020406:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1781 00000100:00100000:0.0:1790771167.020411:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032896 00000100:00100000:0.0:1790771167.020415:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032896 00000100:00100000:3.0:1790771167.020429:0:13797:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.020434:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.020450:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:3.0:1790771167.020458:0:13797:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f51180 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.020463:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2396:x1877759534032896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.020471:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.020474:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.020477:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020511:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ec0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363a4 expref: 127 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020524:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020529:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc13395700) 00000100:00100000:1.0:1790771167.020529:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.020537:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.020558:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2396:x1877759534032896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 101us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.020566:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 882 00000100:00100000:1.0:1790771167.020567:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.020589:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534029440 00000100:00100000:1.0:1790771167.020594:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534029440 00000100:00100000:0.0:1790771167.020618:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:2.0:1790771167.020627:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000007165e9a reply state 00000000341534e0 transno 4294968859 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.020634:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534023168 00000100:00100000:1.0:1790771167.020641:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534023168 00010000:00010000:2.0:1790771167.020643:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.020646:0:7902:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539776128 00000100:00100000:3.0:1790771167.020668:0:7902:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539776128 00010000:00010000:2.0:1790771167.020672:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:2.0:1790771167.020677:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771167.020681:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790771167.020687:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x1b:0x0]: returning size 4096 00000100:00100000:0.0:1790771167.020688:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.020690:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534027136 00000100:00100000:1.0:1790771167.020695:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534027136 00000100:00100000:3.0:1790771167.020712:0:7902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790771167.020714:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033664 00000100:00100000:0.0:1790771167.020718:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033664 00000100:00100000:1.0:1790771167.020724:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033792 00000100:00100000:3.0:1790771167.020725:0:7902:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:13797:x1877759539776128:12345-0@lo:105: 00000100:00100000:1.0:1790771167.020729:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033792 00010000:00010000:3.0:1790771167.020741:0:7902:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.020742:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:15067:x1877759534022400:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 28494us (28630us total) trans 4294968859 rc 0/0 00000100:00100000:0.0:1790771167.020753:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6460 00000100:00100000:1.0:1790771167.020762:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6461 00010000:00010000:3.0:1790771167.020765:0:7902:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.020768:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14573:x1877759534029440:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:2.0:1790771167.020778:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6430 00000100:00100000:1.0:1790771167.020780:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14482:x1877759534023168:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771167.020782:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.020794:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.020795:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0edef lrc: 2/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36476 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020806:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0edf6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363b2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.020813:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6462 00000100:00100000:2.0:1790771167.020829:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14974:x1877759534027136:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771167.020830:0:7902:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 5/0,1 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020832:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0edfd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020842:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020846:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.020856:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0edfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020860:0:7902:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 5/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020863:0:13769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020864:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ee0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36414 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.020865:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0edfd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020882:0:7902:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020885:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020910:0:13769:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020912:0:7902:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 6/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020928:0:13769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.020939:0:7902:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb063e0400) 00010000:00010000:0.0:1790771167.020946:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020956:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ee12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.020958:0:13774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.020976:0:7902:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-mdtlov_UUID+4:13797:x1877759539776128:12345-0@lo:105: Request processed in 255us (550us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.020981:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0edf6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b2 expref: 133 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.020982:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.020987:0:7902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00010000:2.0:1790771167.021007:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.021012:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033152 00010000:00010000:1.0:1790771167.021013:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f400/0xfa0c505d97f0edfd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x49:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b2 expref: 132 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.021017:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033152 00010000:00010000:1.0:1790771167.021028:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:1.0:1790771167.021031:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771167.021033:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f400, rc 0) 00000004:00200000:2.0:1790771167.021041:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 14473 00000100:00100000:3.0:1790771167.021043:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1684 00000004:00200000:2.0:1790771167.021048:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.021055:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:11807:x1877759534033152:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771167.021059:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14482:x1877759534023168:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 283us (531us total) trans 0 rc 0/0 00000004:00010000:2.0:1790771167.021066:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ee12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.021071:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6461 00000100:00100000:1.0:1790771167.021093:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6463 00010000:00010000:2.0:1790771167.021099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0ee0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x45:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36414 expref: 132 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.021105:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14570:x1877759534033664:12345-192.168.204.50@tcp:36:setfattr.0 00000040:00080000:0.0:1790771167.021127:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].41, 344 off56568 00010000:00010000:2.0:1790771167.021127:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0c00/0xfa0c505d97f0ee12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36414 expref: 131 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.021139:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.021140:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:2.0:1790771167.021147:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.021152:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0c00, rc 0) 00010000:00010000:1.0:1790771167.021156:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.021163:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.021183:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 132 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.021185:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14974:x1877759534027136:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 358us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.021194:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6464 00010000:00010000:1.0:1790771167.021196:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 132 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.021206:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6462 00000100:00100000:0.0:1790771167.021210:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:15075:x1877759534033792:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:1.0:1790771167.021211:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539776256:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.021251:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829a80 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.021299:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:15075:x1877759534033792:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 94us (614us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771167.021306:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6464 00000100:00100000:1.0:1790771167.021370:0:13797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0001_UUID:13797:1877759539776128:0@lo:105: 00010000:00010000:1.0:1790771167.021384:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.021403:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759534032768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 1273us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.021410:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1782 00000001:00080000:2.0:1790771167.021818:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969433 is committed 00000001:00080000:2.0:1790771167.021830:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969431 is committed 00000004:00010000:3.0:1790771167.021874:0:13773:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fe9bedb6 reply state 0000000059cb0577 transno 4294969433 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.021887:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.021895:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:3.0:1790771167.021897:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771167.021939:0:13773:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771167.021943:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00010000:00080000:3.0:1790771167.021976:0:13773:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1790771167.021988:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14814:x1877759534031360:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 2306us (2456us total) trans 4294969433 rc 0/0 00000100:00100000:3.0:1790771167.021993:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6458 00010000:00010000:0.0:1790771167.022012:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022019:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022025:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022028:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef4e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.022031:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022036:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022043:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771167.022045:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.022048:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.022052:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ede8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.024198:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.024258:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534035328 00000100:00100000:2.0:1790771167.024263:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534035328 00000100:00100000:0.0:1790771167.024315:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6465 00000100:00100000:0.0:1790771167.024325:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13665:x1877759534035328:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.024335:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000001:00080000:3.0:1790771167.024339:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969434 is committed 00010000:00010000:0.0:1790771167.024344:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ee20 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3641b expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.024389:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00000040:00080000:1.0:1790771167.024414:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].41, 552 off63760 00000004:00080000:1.0:1790771167.024422:0:13774:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc1045acc0 with version 84 00010000:00010000:0.0:1790771167.024435:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ee20 lrc: 1/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3641b expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.024443:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.024446:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.024449:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0ee20 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3641b expref: 135 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771167.024452:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 84 rpc_version 84 00010000:00010000:0.0:1790771167.024462:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00000020:00100000:3.0:1790771167.024476:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790771167.024506:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc3fb4f100 x1877759539776512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1784/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790771167.024518:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13665:x1877759534035328:12345-192.168.204.50@tcp:101:ls.0 Request processed in 195us (321us total) trans 4294968860 rc 301/301 00000100:00100000:3.0:1790771167.024524:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb4f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539776512:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1790771167.024530:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6465 00000100:00100000:3.0:1790771167.024561:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.024586:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.024597:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539776512 00000100:00100000:0.0:1790771167.024602:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539776512 00000100:00100000:0.0:1790771167.024624:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:0.0:1790771167.024629:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7768:x1877759539776512:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1790771167.024753:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+10:7768:x1877759539776512:12345-0@lo:1000:osp_up1-0.0 Request processed in 124us (191us total) trans 4294968861 rc 0/0 00000100:00100000:0.0:1790771167.024759:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:3.0:1790771167.024805:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb4f100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539776512:0@lo:1000:osp_up1-0.0 00000004:00010000:1.0:1790771167.024838:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000055d4119e reply state 00000000c26ce2be transno 4294969434 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.024849:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.024855:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc08974800) 00010000:00010000:1.0:1790771167.024857:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771167.024858:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.024863:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.024869:0:13774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771167.024877:0:13774:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00000004:00010000:1.0:1790771167.024883:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000055d4119e reply state 00000000c26ce2be transno 4294969434 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.024888:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.024892:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:1.0:1790771167.024894:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771167.024895:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1790771167.024899:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00080000:1.0:1790771167.024937:0:13774:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1790771167.024947:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14383:x1877759534015488:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 42839us (43154us total) trans 4294969434 rc 0/0 00000100:00100000:1.0:1790771167.024953:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6405 00010000:00010000:0.0:1790771167.024967:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.024974:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.024979:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.024985:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.024987:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.024992:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025000:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:0.0:1790771167.025002:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.025004:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025008:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ea61 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x24:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025016:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025021:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025025:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025029:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.025031:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025035:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025043:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff8bfc08974800) 00010000:00010000:0.0:1790771167.025045:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.025047:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.025050:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ea68 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.026161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.026214:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033536 00000100:00100000:2.0:1790771167.026219:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033536 00000100:00100000:2.0:1790771167.026256:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6466 00000100:00100000:2.0:1790771167.026265:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14005:x1877759534033536:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.026277:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.026290:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0ee2e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363ab expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.026298:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.026336:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036096 00010000:00010000:2.0:1790771167.026338:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.026343:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036096 00010000:00010000:2.0:1790771167.026354:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.026362:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.026375:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6467 00010000:00010000:2.0:1790771167.026376:0:13762:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.026386:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13677:x1877759534036096:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.026390:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026396:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.026406:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0ee3c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36429 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026450:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0ee43 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026458:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0ee43 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026465:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0ee43 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.026471:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.026539:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0ee3c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36429 expref: 137 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026549:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0ee43 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36429 expref: 136 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.026554:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.026556:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771167.026558:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ee00, rc 0) 00000100:00100000:1.0:1790771167.026586:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13677:x1877759534036096:12345-192.168.204.50@tcp:101:ls.0 Request processed in 202us (292us total) trans 4294968862 rc 0/0 00000100:00100000:1.0:1790771167.026600:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6467 00000100:00100000:0.0:1790771167.026978:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.026996:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.027011:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.027018:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034048 00000100:00100000:2.0:1790771167.027024:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034048 00000100:00100000:1.0:1790771167.027030:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534032640 00000100:00100000:1.0:1790771167.027036:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534032640 00000100:00100000:0.0:1790771167.027039:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.027071:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1685 00000100:00100000:3.0:1790771167.027072:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034176 00000100:00100000:1.0:1790771167.027073:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034304 00000100:00100000:1.0:1790771167.027077:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034304 00000100:00100000:3.0:1790771167.027081:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034176 00000100:00100000:0.0:1790771167.027083:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14073:x1877759534034048:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.027104:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6468 00000100:00100000:2.0:1790771167.027113:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6469 00000100:00100000:1.0:1790771167.027116:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14595:x1877759534032640:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771167.027126:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.027131:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:15018:x1877759534034304:12345-192.168.204.50@tcp:41:rm.0 00010000:00010000:1.0:1790771167.027137:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0ee51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364b5 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.027143:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1057 00000100:00100000:3.0:1790771167.027160:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:14636:x1877759534034176:12345-192.168.204.50@tcp:101:fallocate.0 00000004:00000024:2.0:1790771167.027167:0:6495:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7841333248 avail 7362322432 00010000:00010000:1.0:1790771167.027173:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.027173:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.027182:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:14073:x1877759534034048:12345-192.168.204.50@tcp:35:ls.0 Request processed in 99us (199us total) trans 4294968863 rc 0/0 00010000:00010000:1.0:1790771167.027186:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.027187:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364ca expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.027198:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1685 00010000:00010000:1.0:1790771167.027206:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027211:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:15018:x1877759534034304:12345-192.168.204.50@tcp:41:rm.0 Request processed in 82us (168us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.027220:0:13786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 19 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027221:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027226:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6469 00000100:00100000:0.0:1790771167.027239:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.027245:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(2 6) 00010000:00010000:1.0:1790771167.027246:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.027252:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(3 6) 00010000:00010000:1.0:1790771167.027261:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027261:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034432 00010000:00010000:3.0:1790771167.027262:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [8192->40959] (req 8192->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ca expref: 23 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027268:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034432 00000100:00100000:0.0:1790771167.027283:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.027295:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.027298:0:13786:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 19 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.027308:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534025472 00010000:00010000:1.0:1790771167.027308:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027310:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1686 00000100:00100000:0.0:1790771167.027314:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534025472 00010000:00010000:1.0:1790771167.027323:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.027326:0:13786:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 19 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027330:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:14613:x1877759534034432:12345-192.168.204.50@tcp:33:lfs.0 00000100:00100000:0.0:1790771167.027343:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6470 00010000:00010000:1.0:1790771167.027343:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.027356:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13269:x1877759534025472:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.027356:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.027358:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3facd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539776640:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.027363:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027371:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027373:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.027381:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000004:00200000:2.0:1790771167.027382:0:13778:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xc:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.027385:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0ee6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363ea expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027386:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:2.0:1790771167.027390:0:13778:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.027392:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.027399:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653b40 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.027402:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0ee58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027414:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790771167.027414:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790771167.027422:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027423:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027434:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027438:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14613:x1877759534034432:12345-192.168.204.50@tcp:33:lfs.0 Request processed in 113us (200us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.027443:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027448:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.027455:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.027456:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027461:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.027463:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1686 00010000:00010000:1.0:1790771167.027477:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027508:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027510:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc36078500) 00010000:00010000:1.0:1790771167.027517:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.027521:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027521:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027537:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0ee66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027538:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027565:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0ee51 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364b5 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027573:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.027575:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.027578:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0ee51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364b5 expref: 131 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027584:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0ee82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027588:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656f600, rc 0) 00010000:00010000:0.0:1790771167.027593:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0ee82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027600:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0ee82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.027614:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.027619:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771167.027620:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14595:x1877759534032640:12345-192.168.204.50@tcp:101:ln.0 Request processed in 505us (618us total) trans 0 rc 301/301 00000004:00010000:0.0:1790771167.027627:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0ee82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.027633:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6468 00010000:00010000:0.0:1790771167.027645:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027664:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027669:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027673:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.027675:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534033408 00010000:00010000:0.0:1790771167.027676:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.027680:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534033408 00010000:00010000:0.0:1790771167.027683:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027692:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.027694:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.027697:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027702:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0ee74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.027710:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1058 00010000:00010000:0.0:1790771167.027711:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027720:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.027720:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759534033408:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771167.027731:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027733:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.027738:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05e84800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.027742:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.027743:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007100f375/0xfa0c505d97f0ee89 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364c3 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027750:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027761:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9b50d0cc (ffff8bfc3da48d00) 00010000:00010000:0.0:1790771167.027762:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.027764:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027768:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0ee7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.027780:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539776768:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771167.027789:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0ee6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ea expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027799:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f200/0xfa0c505d97f0ee82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ea expref: 123 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.027805:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771167.027807:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1790771167.027809:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487f200, rc 0) 00000100:00100000:1.0:1790771167.027824:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.027829:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:13269:x1877759534025472:12345-192.168.204.50@tcp:101:ls.0 Request processed in 476us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.027835:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6470 00000100:00100000:2.0:1790771167.028203:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.028236:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534035584 00000100:00100000:0.0:1790771167.028241:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534035584 00000100:00100000:0.0:1790771167.028265:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 883 00000100:00100000:0.0:1790771167.028272:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759534035584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.028278:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.028288:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02600/0xfa0c505d97f0ec1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36277 expref: 130 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.028296:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:0.0:1790771167.028299:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.028319:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759534035584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.028324:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 883 00000100:00100000:1.0:1790771167.034080:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.034143:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036352 00000100:00100000:2.0:1790771167.034150:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036352 00000100:00100000:2.0:1790771167.034192:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6471 00000100:00100000:2.0:1790771167.034205:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15040:x1877759534036352:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:3.0:1790771167.034215:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.034220:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.034225:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:0.0:1790771167.034242:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.034244:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0e456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36207 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034253:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534038272 00000100:00100000:1.0:1790771167.034259:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534038272 00010000:00010000:2.0:1790771167.034262:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc3607af00) 00000100:00100000:3.0:1790771167.034271:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534024704 00000100:00100000:0.0:1790771167.034275:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.034276:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.034278:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534024704 00010000:00010000:2.0:1790771167.034294:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ee90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364bc expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034298:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534035840 00000100:00100000:1.0:1790771167.034303:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534035840 00000100:00100000:0.0:1790771167.034310:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.034333:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534024320 00000100:00100000:1.0:1790771167.034337:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534024320 00000100:00100000:0.0:1790771167.034338:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.034359:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534026496 00000100:00100000:0.0:1790771167.034364:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534026496 00000100:00100000:1.0:1790771167.034373:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6472 00010000:00010000:2.0:1790771167.034380:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034385:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13668:x1877759534038272:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.034393:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6473 00010000:00010000:1.0:1790771167.034400:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.034404:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.034405:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:14508:x1877759534035840:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771167.034412:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0ee9e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36437 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034419:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.034421:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6474 00010000:00010000:2.0:1790771167.034427:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034432:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0eea5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364df expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.034454:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.034465:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034472:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.034474:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034476:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eeba lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034511:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.034516:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13270:x1877759534024704:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.034519:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eeba lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034536:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034539:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eeba lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.034556:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.034560:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034571:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034581:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034620:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034628:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.034630:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.034634:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0ee9e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36437 expref: 139 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034638:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.034643:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eed6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363dc expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034670:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eeba lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36437 expref: 138 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034677:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.034680:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00000004:00010000:0.0:1790771167.034682:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034682:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00010000:00010000:0.0:1790771167.034698:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034706:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034713:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13668:x1877759534038272:12345-192.168.204.50@tcp:101:ls.0 Request processed in 332us (499us total) trans 4294968864 rc 0/0 00010000:00010000:0.0:1790771167.034717:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034722:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6472 00010000:00010000:0.0:1790771167.034736:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.034740:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034748:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6475 00010000:00010000:0.0:1790771167.034752:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034764:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14831:x1877759534024320:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:0.0:1790771167.034769:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:0.0:1790771167.034774:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.034776:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.034778:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034784:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0eeb3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034790:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0eedd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363d5 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.034796:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034797:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034817:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034826:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.034826:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034833:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034844:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.034848:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034849:0:13763:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771167.034852:0:12128:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x27:0x0], index 1: 0 00010000:00010000:0.0:1790771167.034856:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034869:0:13763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034878:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x59d92b11 (ffff8bfc3da48a00) 00010000:00010000:0.0:1790771167.034884:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.034886:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034891:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0eec1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034902:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6476 00010000:00010000:3.0:1790771167.034906:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.034913:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14510:x1877759534026496:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771167.034916:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0eea5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364df expref: 57 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034927:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.034930:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034934:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364df expref: 56 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034937:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eef9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e363f8 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.034946:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.034957:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d:0x0].0x0 (ffff8bfc310f2000) 00010000:00010000:0.0:1790771167.034965:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.034969:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373400, rc 0) 00010000:00010000:3.0:1790771167.034969:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.034988:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.034988:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0ef00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.034997:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:14508:x1877759534035840:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 593us (723us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.035008:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035011:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035017:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6473 00010000:00010000:2.0:1790771167.035018:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035034:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035035:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035040:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0ef00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035053:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035067:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035075:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.035081:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.035085:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.035086:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.035088:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035090:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:3.0:1790771167.035101:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035109:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036224 00000100:00100000:0.0:1790771167.035114:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036224 00010000:00010000:2.0:1790771167.035117:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035125:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035131:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.035136:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035140:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1687 00010000:00010000:1.0:1790771167.035145:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035157:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13332:x1877759534036224:12345-192.168.204.50@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1790771167.035158:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035161:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035167:0:13768:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035180:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035190:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8bfc34224c00) 00010000:00010000:3.0:1790771167.035198:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035199:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.035201:0:13768:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x40 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035207:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035213:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035231:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104a00/0xfa0c505d97f0ee97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035232:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.035240:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.035251:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006dc25aad reply state 000000007baf8195 transno 4294969435 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035252:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035260:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.035277:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035279:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771167.035288:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.035292:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13332:x1877759534036224:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 137us (204us total) trans 4294969436 rc 0/0 00010000:00010000:3.0:1790771167.035297:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035298:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.035298:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd870248a (ffff8bfc34224700) 00010000:00010000:2.0:1790771167.035308:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.035314:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.035316:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036480 00010000:00010000:3.0:1790771167.035321:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5c00/0xfa0c505d97f0eee4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035322:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036480 00000100:00100000:0.0:1790771167.035327:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1687 00010000:00010000:3.0:1790771167.035340:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035344:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105200/0xfa0c505d97f0ee90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364bc expref: 131 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035347:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035356:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1059 00000100:00100000:0.0:1790771167.035362:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041216 00010000:00010000:3.0:1790771167.035365:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035370:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041216 00000100:00100000:1.0:1790771167.035373:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2398:x1877759534036480:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:3.0:1790771167.035378:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05ef5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.035382:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0ef00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364bc expref: 130 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035385:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035389:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.035403:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035404:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc34224300) 00010000:00010000:1.0:1790771167.035405:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f0ef2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364e6 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035409:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6477 00010000:00010000:2.0:1790771167.035415:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.035420:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00000100:00100000:0.0:1790771167.035423:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13739:x1877759534041216:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.035429:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x61bf1dfb (ffff8bfb02b20400) 00010000:00010000:3.0:1790771167.035436:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.035438:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.035440:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035450:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5600/0xfa0c505d97f0eef2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035451:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ef31 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3644c expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.035456:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:15040:x1877759534036352:12345-192.168.204.50@tcp:101:cp.0 Request processed in 1252us (1375us total) trans 4294969435 rc 0/0 00000100:00100000:1.0:1790771167.035467:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06732d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539776896:192.168.204.50@tcp:106: 00000100:00100000:2.0:1790771167.035479:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6471 00010000:00010000:3.0:1790771167.035527:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4400/0xfa0c505d97f0eed6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363dc expref: 130 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035528:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ef38 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035548:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ef38 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035557:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f51180 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.035565:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ef38 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.035567:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363dc expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.035588:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.035588:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:3.0:1790771167.035596:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790771167.035601:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef4e00, rc 0) 00000100:00100000:1.0:1790771167.035604:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.035638:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13270:x1877759534024704:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1203us (1400us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.035664:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0ef31 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3644c expref: 141 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.035668:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6474 00000100:00100000:2.0:1790771167.035678:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041344 00000100:00100000:2.0:1790771167.035685:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041344 00010000:00010000:0.0:1790771167.035687:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ef38 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3644c expref: 140 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035694:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.035696:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.035699:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373c00, rc 0) 00000100:00100000:0.0:1790771167.035724:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:13739:x1877759534041216:12345-192.168.204.50@tcp:101:ls.0 Request processed in 304us (468us total) trans 4294968865 rc 0/0 00000100:00100000:0.0:1790771167.035730:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6477 00000100:00100000:2.0:1790771167.035740:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6478 00000100:00100000:1.0:1790771167.035741:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.035757:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13667:x1877759534041344:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.035770:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.035777:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036608 00000100:00100000:0.0:1790771167.035782:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036608 00010000:00010000:2.0:1790771167.035782:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0ef46 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36453 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.035809:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539774720:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.035815:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1060 00000100:00100000:0.0:1790771167.035825:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+31:14893:x1877759534036608:12345-192.168.204.50@tcp:101:timeout.0 00010000:00010000:1.0:1790771167.035829:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035831:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.035838:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ef4d lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035842:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364ed expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035857:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ef4d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035865:0:8408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 30 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035871:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ef4d lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035873:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=3s v=(1 6) 00000004:00200000:2.0:1790771167.035884:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:1.0:1790771167.035889:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539774848:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.035890:0:8408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(2 6) 00010000:00010000:0.0:1790771167.035901:0:8408:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ed expref: 32 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.035907:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035924:0:8408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 30 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.035935:0:8408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 30 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035946:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03fff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539777024:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.035964:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0ef46 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36453 expref: 143 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.035979:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1045a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.035988:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.035989:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ef4d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36453 expref: 142 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.035999:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.036003:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.036007:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00000100:00100000:0.0:1790771167.036009:0:9499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:9499:1877759539774976:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.036027:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.036031:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036043:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13667:x1877759534041344:12345-192.168.204.50@tcp:101:ls.0 Request processed in 289us (441us total) trans 4294968866 rc 0/0 00000100:00100000:0.0:1790771167.036052:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2399:x1877759534029824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 34416us (34691us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.036053:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6478 00000100:00100000:0.0:1790771167.036064:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1778 00000100:00100000:1.0:1790771167.036069:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036081:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036992 00000100:00100000:2.0:1790771167.036087:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036992 00000100:00100000:2.0:1790771167.036125:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6479 00000100:00100000:1.0:1790771167.036133:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036139:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14588:x1877759534036992:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:2.0:1790771167.036148:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.036161:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0ef62 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364fb expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.036195:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0ef69 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.036206:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0ef69 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036210:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036223:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0ef69 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036236:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771167.036255:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x2:0x0]: returning size 4096 00000100:00100000:1.0:1790771167.036256:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771167.036263:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1790771167.036277:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036292:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0ef62 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364fb expref: 144 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036301:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036321:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56000/0xfa0c505d97f0ef69 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364fb expref: 143 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036329:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036338:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc34224100) 00010000:00010000:2.0:1790771167.036341:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771167.036345:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56000, rc 0) 00000100:00100000:1.0:1790771167.036350:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036379:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14588:x1877759534036992:12345-192.168.204.50@tcp:101:ln.0 Request processed in 242us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.036381:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036392:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6479 00000100:00100000:2.0:1790771167.036412:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534042624 00000100:00100000:2.0:1790771167.036415:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534042624 00000100:00100000:2.0:1790771167.036438:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534031616 00000100:00100000:1.0:1790771167.036443:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036443:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534031616 00000100:00100000:2.0:1790771167.036467:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534038144 00000100:00100000:1.0:1790771167.036473:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036473:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534038144 00000100:00100000:1.0:1790771167.036523:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036530:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534035712 00000100:00100000:2.0:1790771167.036536:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534035712 00000100:00100000:1.0:1790771167.036547:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036563:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534042752 00000100:00100000:2.0:1790771167.036568:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534042752 00000100:00100000:1.0:1790771167.036573:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036591:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534038656 00000100:00100000:2.0:1790771167.036596:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534038656 00000100:00100000:2.0:1790771167.036625:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6480 00000100:00100000:1.0:1790771167.036630:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036641:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:13738:x1877759534042624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.036669:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.036677:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036682:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ef70 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36445 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036695:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036732:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ef77 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036743:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.036744:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ef77 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.036756:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ef77 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.036766:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771167.036771:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000100:00100000:3.0:1790771167.036802:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13998:x1877759534025984:12345-192.168.204.50@tcp:37:ls.0 Request processed in 36969us (37280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.036809:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1681 00000100:00100000:3.0:1790771167.036825:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037760 00000100:00100000:3.0:1790771167.036828:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037760 00010000:00010000:2.0:1790771167.036835:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0ef70 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36445 expref: 147 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.036854:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534038400 00010000:00010000:2.0:1790771167.036857:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ef77 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36445 expref: 146 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.036859:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534038400 00010000:00010000:2.0:1790771167.036869:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.036872:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.036876:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00000100:00100000:2.0:1790771167.036908:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13738:x1877759534042624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 271us (698us total) trans 4294968867 rc 0/0 00000100:00100000:1.0:1790771167.036918:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.036924:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6480 00000100:00100000:3.0:1790771167.036930:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1688 00000100:00100000:0.0:1790771167.036942:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11371050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:15069:x1877759534030976:12345-192.168.204.50@tcp:37:rm.0 Request processed in 34125us (34561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.036943:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13293:x1877759534037760:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771167.036948:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037376 00000100:00100000:2.0:1790771167.036950:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039168 00000100:00100000:1.0:1790771167.036956:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037376 00000100:00100000:2.0:1790771167.036957:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039168 00000100:00100000:0.0:1790771167.036960:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1682 00010000:00010000:1.0:1790771167.036985:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 57 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.036987:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534034688 00000100:00100000:2.0:1790771167.036993:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534034688 00000100:00100000:0.0:1790771167.036996:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1689 00000100:00100000:0.0:1790771167.037006:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13733:x1877759534038400:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.037021:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037632 00000100:00100000:2.0:1790771167.037026:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6481 00000100:00100000:1.0:1790771167.037028:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037632 00000100:00100000:2.0:1790771167.037040:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14331:x1877759534031616:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:2.0:1790771167.037050:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.037052:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 149 pid: 13761 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037062:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ef85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364ae expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.037077:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534038016 00000100:00100000:0.0:1790771167.037083:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:13733:x1877759534038400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 77us (534us total) trans 4294968868 rc 0/0 00000100:00100000:1.0:1790771167.037084:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534038016 00000100:00100000:0.0:1790771167.037092:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1689 00010000:00010000:2.0:1790771167.037096:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037107:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037116:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037117:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039296 00000100:00100000:1.0:1790771167.037121:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039424 00000100:00100000:0.0:1790771167.037122:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039296 00000100:00100000:1.0:1790771167.037130:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039424 00010000:00010000:2.0:1790771167.037143:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037151:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039552 00010000:00010000:1.0:1790771167.037156:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 32 pid: 13788 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037157:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039552 00010000:00010000:2.0:1790771167.037157:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037178:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 133 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037181:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.037194:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1783 00000100:00100000:1.0:1790771167.037209:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:2396:x1877759534037376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.037214:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1784 00010000:00010000:1.0:1790771167.037225:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.037227:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:2396:x1877759534037632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.037235:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 57 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037237:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037242:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.037254:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 4/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 148 pid: 13761 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037265:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 57 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037266:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037274:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 3/0,0 mode: CW/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 148 pid: 13761 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037292:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037305:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0d705 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35be0 expref: 57 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037306:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0e170 lrc: 0/0,0 mode: --/CW res: [0x240000403:0xf:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ec6 expref: 148 pid: 13761 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.037316:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.037324:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.037331:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771167.037336:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037339:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00000004:00010000:2.0:1790771167.037342:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037346:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037348:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037366:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037366:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037370:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037392:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037397:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037400:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.037404:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037414:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.037418:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037425:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037427:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2396:x1877759534037632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 201us (954us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.037427:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.037447:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1784 00010000:00010000:2.0:1790771167.037448:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.037454:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.037458:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.037460:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:2396:x1877759534037376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 253us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.037469:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1785 00010000:00010000:2.0:1790771167.037477:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0ef8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037504:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2397:x1877759534039424:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.037510:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1783 00010000:00010000:0.0:1790771167.037513:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.037531:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037532:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 32 pid: 13788 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.037541:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1786 00000100:00100000:1.0:1790771167.037558:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2397:x1877759534039552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.037562:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534036736 00000100:00100000:3.0:1790771167.037568:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534036736 00010000:00010000:2.0:1790771167.037575:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037577:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.037579:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 33 pid: 13788 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037588:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037248 00010000:00010000:1.0:1790771167.037590:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 134 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037593:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037248 00010000:00010000:2.0:1790771167.037599:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037607:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037504 00010000:00010000:0.0:1790771167.037612:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1790771167.037614:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037504 00010000:00010000:1.0:1790771167.037619:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 134 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037621:0:13783:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790771167.037624:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.037633:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037634:0:13787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039040 00010000:00010000:0.0:1790771167.037635:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36499 expref: 34 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037641:0:13787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039040 00010000:00010000:1.0:1790771167.037642:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771167.037669:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.037670:0:13783:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x50080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36499 expref: 34 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.037672:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037682:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1061 00010000:00010000:1.0:1790771167.037695:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037698:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+34:2399:x1877759534036736:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.037701:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x391d5834 (ffff8bfc34224200) 00010000:00010000:2.0:1790771167.037711:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.037712:0:13783:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36499 expref: 34 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037713:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.037716:0:13787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.037718:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.037729:0:13787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0efa1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364f4 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037738:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037739:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03fff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539777152:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.037745:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0ef93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037772:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037779:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037783:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc085b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.037796:0:13787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13787:1877759539777280:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771167.037797:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.037800:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0ef85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ae expref: 131 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.037806:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 884 00000100:00100000:0.0:1790771167.037817:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2396:x1877759534038016:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.037825:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.037827:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ae expref: 130 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.037828:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2397:x1877759534039552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 273us (913us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.037839:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0ecbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36285 expref: 134 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.037850:0:13787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05653e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.037851:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1786 00010000:00010000:2.0:1790771167.037856:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:2.0:1790771167.037862:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.037865:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592400, rc 0) 00010000:00010000:0.0:1790771167.037867:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771167.037871:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.037882:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 885 00000100:00100000:2.0:1790771167.037898:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14331:x1877759534031616:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 854us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.037898:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1062 00000100:00100000:0.0:1790771167.037899:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759534038016:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 79us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.037899:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:2396:x1877759534039296:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.037919:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+31:14868:x1877759534037248:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771167.037920:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.037921:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 884 00000100:00100000:2.0:1790771167.037925:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6481 00010000:00010000:3.0:1790771167.037940:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.037943:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0ed6a lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36492 expref: 131 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.037956:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36502 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.037957:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6482 00010000:00010000:1.0:1790771167.037960:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb02b20000) 00010000:00010000:0.0:1790771167.037961:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee1000/0xfa0c505d97f0ec83 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x2:0x0].0x0 bits 0x1f/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36104 expref: 130 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.037971:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.037975:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14695:x1877759534038144:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:0.0:1790771167.037989:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06374380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539775360:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.037996:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2396:x1877759534039296:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 103us (1299us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.038002:0:7771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.038007:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 35 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.038008:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 885 00010000:00010000:2.0:1790771167.038010:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.038020:0:7771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.038026:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0xa:0x0].0x0 since=1s v=(5 8) 00010000:00010000:0.0:1790771167.038027:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038033:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0e591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36231 expref: 129 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038039:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.038040:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(6 8) 00010000:00010000:3.0:1790771167.038059:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [24576->53247] (req 24576->53247) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36502 expref: 32 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038062:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038069:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771167.038078:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.038106:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: --/PW res: [0x240000402:0x35:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038107:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.038109:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 35 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038130:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038138:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.038141:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 35 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038148:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038167:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790771167.038182:0:7771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 88 off11152 00000100:00100000:3.0:1790771167.038192:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539777408:192.168.204.50@tcp:104: 00000004:00080000:0.0:1790771167.038199:0:7771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 167243711962ns, next at 168243709017ns, rc = 0 00010000:00010000:2.0:1790771167.038212:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038222:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc056533c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.038227:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038228:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 128 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.038240:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006daee964 reply state 0000000065588d2f transno 4294969437 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038244:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037120 00000100:00100000:3.0:1790771167.038252:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037120 00010000:00010000:1.0:1790771167.038255:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.038262:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539777536:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.038265:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038271:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 4/0,1 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.038279:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (589824->593919) req@ffff8bfc3fa47b80 x1877759534037120/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771167.038285:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771167.038293:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.038298:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.038298:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c300 going to sleep for 11 seconds 00002000:00100000:3.0:1790771167.038300:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa47b80 with x1877759534037120 ext(589824->593919) 00002000:00010000:3.0:1790771167.038309:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa47b80 00010000:00010000:0.0:1790771167.038311:0:7771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038314:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038320:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038328:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534037888 00000100:00100000:2.0:1790771167.038334:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1063 00000100:00100000:3.0:1790771167.038334:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534037888 00010000:00010000:0.0:1790771167.038337:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x40 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038341:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038349:0:7771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.038349:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/29 (0->18446744073709551615) 00000100:00100000:2.0:1790771167.038354:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+35:2396:x1877759534037504:12345-192.168.204.50@tcp:16:fallocate.0 00002000:00100000:3.0:1790771167.038360:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c31500 with x1877759534037888 ext(0->18446744073709551615) 00010000:00010000:0.0:1790771167.038370:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.038372:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539777664:192.168.204.50@tcp:104: 00002000:00010000:3.0:1790771167.038374:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb05c31500. 00000100:00100000:0.0:1790771167.038396:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771167.038401:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 449 00000100:00100000:1.0:1790771167.038406:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc05321900 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.038416:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534037120:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771167.038443:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14616:x1877759534030848:12345-192.168.204.50@tcp:36:cp.0 Request processed in 36133us (36232us total) trans 4294969437 rc 0/0 00010000:00010000:2.0:1790771167.038445:0:8406:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@0000000069f0e0a5 x1877759539775104) - normal race ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 33 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.038451:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6454 00000100:00100000:0.0:1790771167.038470:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6483 00000100:00100000:2.0:1790771167.038475:0:8406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8406:1877759539775104:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771167.038480:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14803:x1877759534035712:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771167.038506:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.038517:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0efc4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364d8 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038531:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006757b7ea/0xfa0c505d97f0ed55 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3648b expref: 35 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038544:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038553:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006757b7ea/0xfa0c505d97f0ed55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3648b expref: 35 pid: 8406 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038554:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038571:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038573:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534037120:12345-192.168.204.50@tcp:3:cat.0 Request processed in 159us (2270us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.038579:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05104000, rc 0) 00000100:00100000:3.0:1790771167.038592:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 449 00010000:00010000:0.0:1790771167.038594:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.038600:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (589824->593919) req@ffff8bfc3fa47b80 x1877759534037120/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771167.038602:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.038613:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+34:2398:x1877759534029952:12345-192.168.204.50@tcp:101:cp.0 Request processed in 36837us (36934us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771167.038622:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.038626:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa47b80 with x1877759534037120 ext(589824->593919) 00002000:00010000:3.0:1790771167.038634:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa47b80 00000100:00100000:2.0:1790771167.038638:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1054 00010000:00010000:0.0:1790771167.038647:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038668:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 450 00010000:00010000:0.0:1790771167.038671:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038677:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.038681:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+33:2396:x1877759534037888:12345-192.168.204.50@tcp:10:dir_create.sh.0 00000100:00100000:2.0:1790771167.038686:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1064 00010000:00010000:0.0:1790771167.038695:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038700:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.038705:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.038706:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2396:x1877759534039040:12345-192.168.204.50@tcp:2:touch.0 00010000:00010000:0.0:1790771167.038716:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038724:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:0.0:1790771167.038727:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.038730:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 3/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038735:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0efcb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038744:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038748:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038753:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038758:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04caee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.038760:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038765:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038773:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0xd870248a (ffff8bfc3607d800) 00010000:00010000:0.0:1790771167.038775:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.038777:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038784:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0efd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038784:0:13768:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038806:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038820:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0efc4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364d8 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038831:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:0.0:1790771167.038834:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:1.0:1790771167.038834:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00000100:00100000:2.0:1790771167.038838:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2396:x1877759534039040:12345-192.168.204.50@tcp:2:touch.0 Request processed in 136us (2209us total) trans 4294967641 rc 0/0 00000004:00200000:1.0:1790771167.038841:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.038842:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0efc4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364d8 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.038858:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x53/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038860:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00000100:00100000:2.0:1790771167.038863:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1064 00010000:00010000:1.0:1790771167.038877:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.038884:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14803:x1877759534035712:12345-192.168.204.50@tcp:101:cp.0 Request processed in 405us (2604us total) trans 0 rc 301/301 00010000:00010000:1.0:1790771167.038890:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.038892:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6483 00010000:00010000:1.0:1790771167.038904:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038911:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.038917:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6484 00010000:00010000:1.0:1790771167.038920:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038924:0:13788:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@0000000086b979e5 x1877759539775488) - normal race ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 33 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.038929:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13675:x1877759534042752:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.038932:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.038940:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.038941:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.038950:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0efd9 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3643e expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038954:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.038963:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f790cd61/0xfa0c505d97f0c5cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 28672->45055) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3566f expref: 33 pid: 13793 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038969:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.038975:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.038979:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.038982:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:13788:1877759539775488:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771167.038990:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0efe0 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.038993:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0ef07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039001:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0efe0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039009:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0efe0 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039013:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039016:0:13788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ba7f700/0xfa0c505d97f0ed7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ff expref: 33 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.039017:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.039039:0:13788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ba7f700/0xfa0c505d97f0ed7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ff expref: 33 pid: 13788 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039053:0:13788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1800, rc 0) 00010000:00010000:0.0:1790771167.039068:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0efd9 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3643e expref: 148 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039081:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+32:2396:x1877759534026624:12345-192.168.204.50@tcp:101:ln.0 Request processed in 36524us (36780us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771167.039090:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0efe0 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3643e expref: 147 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039095:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1056 00010000:00010000:0.0:1790771167.039102:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.039105:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.039107:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00010000:00010000:1.0:1790771167.039118:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039126:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.039130:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13675:x1877759534042752:12345-192.168.204.50@tcp:101:ls.0 Request processed in 202us (2802us total) trans 4294968869 rc 0/0 00010000:00010000:1.0:1790771167.039144:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.039147:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6484 00010000:00010000:2.0:1790771167.039148:0:12031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006467e7f0/0xfa0c505d97f0eafb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3635e expref: 31 pid: 13788 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039150:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.039167:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6485 00010000:00010000:1.0:1790771167.039172:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.039180:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:15086:x1877759534038656:12345-192.168.204.50@tcp:36:lfs.0 00000100:00100000:2.0:1790771167.039182:0:12031:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12031:1877759539775232:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.039187:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc36078d00) 00010000:00010000:1.0:1790771167.039192:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.039195:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039202:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0ef15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039209:0:12031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d1637d1/0xfa0c505d97f0ed71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36499 expref: 30 pid: 12031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039222:0:12031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60000, rc 0) 00010000:00010000:1.0:1790771167.039235:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0eef9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.039236:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ffc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7771:1877759539777792:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790771167.039250:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:14924:x1877759534030464:12345-192.168.204.50@tcp:101:cp.0 Request processed in 37058us (37152us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.039263:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039263:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1055 00010000:00010000:1.0:1790771167.039274:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771167.039278:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.039281:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9400, rc 0) 00000100:00100000:0.0:1790771167.039286:0:7771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.039307:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14510:x1877759534026496:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 4396us (4967us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.039315:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6486 00000100:00100000:0.0:1790771167.039318:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc085b9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.039324:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6476 00000100:00100000:2.0:1790771167.039330:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14078:x1877759534039168:12345-192.168.204.50@tcp:101:getfattr.0 00000100:00100000:0.0:1790771167.039340:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539777792 00010000:00010000:2.0:1790771167.039341:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.039345:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539777792 00000100:00100000:1.0:1790771167.039352:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6487 00000100:00100000:3.0:1790771167.039354:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:11807:x1877759534033152:12345-192.168.204.50@tcp:37:ls.0 Request processed in 18300us (18924us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.039357:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0efee lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36510 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.039367:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1684 00000100:00100000:1.0:1790771167.039371:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14958:x1877759534034688:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:0.0:1790771167.039378:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00010000:00010000:1.0:1790771167.039385:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.039390:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7771:x1877759539777792:12345-0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1790771167.039400:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0eff5 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364d1 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039405:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0effc lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039422:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0effc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039432:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f003 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.039433:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.039439:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0effc lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039445:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f003 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.039454:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039808 00010000:00010000:1.0:1790771167.039458:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f003 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.039458:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039808 00000004:00200000:2.0:1790771167.039465:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000401:0x2:0x0]: returning size 4096 00000100:00100000:0.0:1790771167.039471:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:7771:x1877759539777792:12345-0@lo:1000:mdt00_003.0 Request processed in 84us (186us total) trans 0 rc 1/1 00000004:00200000:2.0:1790771167.039472:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:3.0:1790771167.039479:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6488 00000100:00100000:3.0:1790771167.039514:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:14669:x1877759534039808:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771167.039522:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.039530:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00010000:00010000:3.0:1790771167.039533:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f00a lrc: 2/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36517 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039536:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0efee lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36510 expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.039556:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0f011 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039558:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039563:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0effc lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36510 expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.039572:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0f011 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039575:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039592:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0eff5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364d1 expref: 130 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.039594:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0f011 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039595:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc34224100) 00010000:00010000:2.0:1790771167.039604:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00200000:0.0:1790771167.039611:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 0 00010000:00010000:2.0:1790771167.039612:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06390800, rc 0) 00000004:00200000:0.0:1790771167.039619:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.039631:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039635:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f003 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364d1 expref: 129 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039645:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:14078:x1877759534039168:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 318us (2966us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.039664:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:0.0:1790771167.039671:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0ed1d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36430 expref: 149 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.039672:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1790771167.039673:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6486 00010000:00010000:1.0:1790771167.039679:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4aa00, rc 0) 00010000:00010000:3.0:1790771167.039687:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f00a lrc: 0/0,0 mode: --/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36517 expref: 150 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039695:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36430 expref: 147 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039702:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:3.0:1790771167.039704:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf2400/0xfa0c505d97f0f011 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x37:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36517 expref: 147 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039707:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:1.0:1790771167.039712:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14958:x1877759534034688:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 345us (2964us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.039713:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b000, rc 0) 00010000:00010000:3.0:1790771167.039731:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x37:0x0].0x0 (ffff8bfc3da48f00) 00000100:00100000:1.0:1790771167.039732:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6487 00010000:00010000:3.0:1790771167.039734:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1790771167.039739:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:14757:x1877759534027648:12345-192.168.204.50@tcp:101:cp.0 Request processed in 38798us (38895us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.039741:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2400, rc 0) 00000100:00100000:0.0:1790771167.039749:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6448 00000100:00100000:3.0:1790771167.039767:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14669:x1877759534039808:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 279us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.039774:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6488 00010000:00010000:0.0:1790771167.039781:0:13769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039788:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.039806:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 0 00000004:00200000:0.0:1790771167.039809:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.039817:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039828:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.039838:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0edef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 128 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.039853:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.039854:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043008 00010000:00010000:0.0:1790771167.039862:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:2.0:1790771167.039862:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043008 00010000:00010000:0.0:1790771167.039866:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771167.039870:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3ab200, rc 0) 00000100:00100000:3.0:1790771167.039884:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.039891:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14573:x1877759534029440:12345-192.168.204.50@tcp:101:ln.0 Request processed in 19128us (19420us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.039898:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6460 00000100:00100000:2.0:1790771167.039908:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6489 00000100:00100000:2.0:1790771167.039920:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:13743:x1877759534043008:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.039926:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534039680 00000100:00100000:0.0:1790771167.039931:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534039680 00010000:00010000:2.0:1790771167.039931:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.039947:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f018 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3645a expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.039964:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 886 00000100:00100000:0.0:1790771167.039974:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2397:x1877759534039680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.039982:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.039993:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5800/0xfa0c505d97f0ed5c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c0 expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.039998:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f01f lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040002:0:6498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001_UUID:6498:1877759539775744:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.040004:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:0.0:1790771167.040012:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.040021:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f01f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040026:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040030:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534039680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 57us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.040039:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f01f lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040050:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 886 00010000:00010000:1.0:1790771167.040052:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771167.040059:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000004:00200000:2.0:1790771167.040063:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.040064:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040072:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3facd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:13786:1877759539776640:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.040079:0:6498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 3/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 9 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040081:0:7771:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294969408 gen 2 00000004:00080000:0.0:1790771167.040088:0:7771:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294969408 committed transno 4294969408 00010000:00010000:1.0:1790771167.040089:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656e000, rc 0) 00010000:00010000:3.0:1790771167.040093:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [8192->40959] (req 8192->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ca expref: 24 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040105:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05ef5e00, rc 0) 00000100:00100000:0.0:1790771167.040108:0:7771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03ffc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:7771:1877759539777792:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790771167.040128:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:14636:x1877759534034176:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 12972us (13114us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.040132:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f018 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3645a expref: 149 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040137:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:6494:x1877759539775616:12345-0@lo:101:mdt00_001.0 Request processed in 36568us (36652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.040138:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1057 00000100:00100000:0.0:1790771167.040150:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:15086:x1877759534038656:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 971us (3576us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771167.040157:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1790771167.040164:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6485 00010000:00010000:2.0:1790771167.040171:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f01f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3645a expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040186:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.040190:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.040193:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391400, rc 0) 00000100:00100000:1.0:1790771167.040199:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3d8abb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:8425:1877759539776000:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771167.040215:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.040216:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06731c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6493:1877759539776256:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.040224:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13743:x1877759534043008:12345-192.168.204.50@tcp:101:ls.0 Request processed in 305us (401us total) trans 4294968870 rc 0/0 00000100:00100000:3.0:1790771167.040227:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.040237:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+33:2396:x1877759534032256:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 20145us (20340us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.040238:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.040239:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6489 00000100:00100000:1.0:1790771167.040257:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1780 00000100:00100000:3.0:1790771167.040261:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.040266:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040704 00000100:00100000:2.0:1790771167.040271:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040704 00000100:00100000:3.0:1790771167.040291:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771167.040299:0:13779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x1d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790771167.040303:0:13779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x1d:0x0] updating lvb mtime from disk: 1790771164 -> 1790771167 00002000:00010000:0.0:1790771167.040306:0:13779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x1d:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771167.040308:0:13779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x1d:0x0] updating lvb ctime from disk: 1790771164 -> 1790771167 00000100:00100000:1.0:1790771167.040310:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040320 00002000:00010000:0.0:1790771167.040311:0:13779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x1d:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1790771167.040314:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6490 00000100:00100000:1.0:1790771167.040316:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040320 00000100:00100000:3.0:1790771167.040322:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.040333:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15018:x1877759534040704:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771167.040338:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 148 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040340:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+32:2396:x1877759534037888:12345-192.168.204.50@tcp:10:dir_create.sh.0 Request processed in 1659us (3957us total) trans 4294967638 rc 0/0 00000100:00100000:3.0:1790771167.040343:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040832 00010000:00010000:2.0:1790771167.040346:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.040349:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040832 00000100:00100000:0.0:1790771167.040358:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 450 00010000:00010000:2.0:1790771167.040362:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f02d lrc: 2/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36525 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.040363:0:13779:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/29 (0->18446744073709551615) 00002000:00100000:0.0:1790771167.040368:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c31500 with x1877759534037888 ext(0->18446744073709551615) 00010000:00010000:3.0:1790771167.040371:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040372:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041088 00002000:00010000:0.0:1790771167.040376:0:13779:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb05c31500. 00000100:00100000:1.0:1790771167.040378:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041088 00000100:00100000:3.0:1790771167.040410:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1787 00010000:00010000:2.0:1790771167.040417:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040421:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1788 00000100:00100000:3.0:1790771167.040423:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:2397:x1877759534040320:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.040436:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759534040832:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.040437:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.040438:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 887 00010000:00010000:2.0:1790771167.040444:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040449:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 149 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040450:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.040459:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:2397:x1877759534041088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.040460:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040462:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040478:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.040482:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 149 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040516:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0edd3 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36422 expref: 149 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040524:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040530:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040537:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b9e00/0xfa0c505d97f0e218 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f6e expref: 148 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040538:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.040549:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.040553:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0400/0xfa0c505d97f0ecf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36326 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040556:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040569:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00000100:00100000:1.0:1790771167.040575:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2397:x1877759534041088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 121us (252us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.040579:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771167.040583:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040584:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040586:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040599:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 887 00010000:00010000:0.0:1790771167.040611:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040616:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040619:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040641:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040646:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.040669:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.040680:0:13781:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime: 0 -> 1790771165 00010000:00010000:2.0:1790771167.040681:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040682:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2397:x1877759534040832:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 250us (391us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.040685:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 8 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040695:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06732a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:13781:1877759539776768:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771167.040701:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1788 00010000:00010000:2.0:1790771167.040710:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040718:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6480:1877759539777920:0@lo:105: 00010000:00010000:1.0:1790771167.040726:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007100f375/0xfa0c505d97f0ee89 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364c3 expref: 31 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040737:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.040738:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7e:0x0]: returning size 38336 00010000:00010000:1.0:1790771167.040746:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007100f375/0xfa0c505d97f0ee89 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364c3 expref: 31 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.040747:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.040753:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040754:0:6480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1790771167.040766:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040775:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656e400, rc 0) 00010000:00010000:2.0:1790771167.040780:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040784:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63a80 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.040794:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040799:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2399:x1877759534033408:12345-192.168.204.50@tcp:101:cp.0 Request processed in 13081us (13348us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771167.040815:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040820:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1058 00010000:00010000:0.0:1790771167.040826:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040827:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.040834:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040837:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040847:0:6477:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539777920 00010000:00010000:0.0:1790771167.040852:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040852:0:6477:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539777920 00010000:00010000:2.0:1790771167.040852:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.040868:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.040870:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.040876:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040881:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00010000:00010000:2.0:1790771167.040882:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.040892:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040893:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.040894:0:6477:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6480:x1877759539777920:12345-0@lo:105: 00000100:00100000:3.0:1790771167.040895:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040960 00000100:00100000:3.0:1790771167.040902:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040960 00010000:00010000:1.0:1790771167.040912:0:6477:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040915:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.040916:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:0.0:1790771167.040923:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790771167.040928:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.040928:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->38335) req@ffff8bfb057b0a80 x1877759534040960/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771167.040929:0:6477:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040937:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc13395700) 00010000:00010000:2.0:1790771167.040946:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.040952:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0ee19 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040955:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040956:0:6477:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1790771167.040965:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b0a80 with x1877759534040960 ext(0->38335) 00010000:00010000:3.0:1790771167.040978:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 20 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.040986:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.040986:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f034 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.040990:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 20 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.040999:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14570:x1877759534033664:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 19896us (20379us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771167.041012:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 5/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.041019:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb057b0a80 00000100:00100000:0.0:1790771167.041020:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6463 00010000:00010000:2.0:1790771167.041021:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041044:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 99 00010000:00010000:2.0:1790771167.041046:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041048:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040576 00010000:00010000:1.0:1790771167.041049:0:6477:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 5/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041054:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040576 00000100:00100000:3.0:1790771167.041057:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534040960:12345-192.168.204.50@tcp:4:cp.0 00010000:00010000:0.0:1790771167.041071:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 130 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041073:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.041078:0:6477:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb058af400) 00010000:00010000:2.0:1790771167.041089:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.041094:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041102:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1789 00010000:00010000:2.0:1790771167.041105:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041113:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2397:x1877759534040576:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.041125:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.041130:0:6477:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6480:x1877759539777920:12345-0@lo:105: Request processed in 235us (377us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.041131:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xd870248a (ffff8bfc34224900) 00010000:00010000:0.0:1790771167.041132:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 130 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041142:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.041150:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 2/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.041152:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00010000:0.0:1790771167.041167:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 130 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041167:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f03b lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041182:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04879880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001_UUID:6480:1877759539777920:0@lo:105: 00010000:00010000:0.0:1790771167.041189:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00010000:00010000:0.0:1790771167.041193:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041199:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.041201:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.041207:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041216:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:2397:x1877759534040320:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 796us (961us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.041221:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.041222:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f02d lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36525 expref: 131 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041226:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1787 00000100:00100000:1.0:1790771167.041230:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06377100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539775616:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1790771167.041248:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2397:x1877759534040576:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 135us (428us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.041250:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041255:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36525 expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041268:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1789 00000100:00100000:3.0:1790771167.041278:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.041281:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7e:0x0].0x0 (ffff8bfb0282ad00) 00010000:00010000:2.0:1790771167.041286:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.041290:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594400, rc 0) 00000004:00080000:1.0:1790771167.041293:0:6494:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000403:0x6e:0x0] 00000100:00100000:0.0:1790771167.041299:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041472 00000100:00100000:0.0:1790771167.041304:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041472 00000100:00100000:2.0:1790771167.041319:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3facd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:15018:x1877759534040704:12345-192.168.204.50@tcp:101:rm.0 Request processed in 992us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.041328:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6491 00000100:00100000:0.0:1790771167.041338:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14482:x1877759534041472:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:3.0:1790771167.041340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.041342:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6490 00010000:00010000:0.0:1790771167.041363:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.041377:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a02c00/0xfa0c505d97f0ea92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36112 expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.041381:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041600 00000100:00100000:1.0:1790771167.041385:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539778048:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790771167.041387:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.041390:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041600 00010000:00010000:0.0:1790771167.041402:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771167.041405:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.041418:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.041439:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534040448 00000100:00100000:2.0:1790771167.041441:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 888 00000100:00100000:1.0:1790771167.041446:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.041446:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534040448 00000100:00100000:2.0:1790771167.041458:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:2396:x1877759534041600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.041469:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.041471:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.041481:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1065 00010000:00010000:0.0:1790771167.041508:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041509:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2398:x1877759534040448:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:2.0:1790771167.041520:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0ee43 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36429 expref: 146 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041522:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.041524:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041532:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039d73694/0xfa0c505d97f0f050 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3651e expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771167.041537:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967637 is committed 00010000:00010000:0.0:1790771167.041543:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790771167.041546:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967636 is committed 00000001:00080000:1.0:1790771167.041557:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967631 is committed 00010000:00010000:2.0:1790771167.041572:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.041577:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.041577:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539778176:192.168.204.50@tcp:106: 00000001:00080000:0.0:1790771167.041586:0:13772:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969438 00000001:00080000:1.0:1790771167.041587:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967620 is committed 00000100:00100000:2.0:1790771167.041606:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:2396:x1877759534041600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 150us (281us total) trans 0 rc 0/0 00000004:00010000:0.0:1790771167.041608:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009352cce2 reply state 000000008fc26b60 transno 4294969439 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.041615:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3fa63a80 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.041624:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534041856 00010000:00010000:0.0:1790771167.041625:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.041627:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 888 00000100:00100000:1.0:1790771167.041631:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534041856 00010000:00010000:0.0:1790771167.041639:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771167.041641:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.041643:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771167.041682:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.041686:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1690 00000100:00100000:1.0:1790771167.041697:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:13890:x1877759534041856:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.041702:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14482:x1877759534041472:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 363us (428us total) trans 4294969439 rc 0/0 00000100:00100000:3.0:1790771167.041707:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534042112 00000100:00100000:0.0:1790771167.041712:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6491 00000100:00100000:3.0:1790771167.041714:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534042112 00000020:00080000:0.0:1790771167.041716:0:13772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1790771167.041720:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759534037504:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 3369us (5368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.041732:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1063 00000100:00100000:0.0:1790771167.041746:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539778048 00000100:00100000:0.0:1790771167.041750:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539778048 00000100:00100000:3.0:1790771167.041753:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6492 00000100:00100000:3.0:1790771167.041762:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14875:x1877759534042112:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:0.0:1790771167.041785:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00010000:00010000:2.0:1790771167.041790:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0ec44 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363b9 expref: 129 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.041794:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:13890:x1877759534041856:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (412us total) trans 4294968871 rc 0/0 00000100:00100000:0.0:1790771167.041797:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6494:x1877759539778048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790771167.041820:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1690 00000100:00100000:2.0:1790771167.041826:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566e680 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539775872:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.041847:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041857:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041864:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041866:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:6494:x1877759539778048:12345-0@lo:1000:mdt00_001.0 Request processed in 73us (427us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.041874:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041881:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:1.0:1790771167.041884:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539778048:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1790771167.041896:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041903:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041913:0:13770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.041920:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.041948:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539778304:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1790771167.041953:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041964:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.041975:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.041976:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.041986:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.041992:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.041996:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.042005:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07829840 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.042006:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.042023:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x12:0x0].0x0 (ffff8bfc310f2700) 00000100:00100000:0.0:1790771167.042024:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539778304 00010000:00010000:2.0:1790771167.042028:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771167.042030:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539778304 00010000:00010000:2.0:1790771167.042034:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.042043:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0ede1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x12:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.042046:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534042368 00000100:00100000:1.0:1790771167.042052:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534042368 00000100:00100000:0.0:1790771167.042066:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1790771167.042075:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6494:x1877759539778304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790771167.042090:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14959:x1877759534032128:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 22384us (22501us total) trans 0 rc -61/-61 00000100:00100000:1.0:1790771167.042098:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1691 00000100:00100000:2.0:1790771167.042106:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6459 00000100:00100000:1.0:1790771167.042115:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13208:x1877759534042368:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.042134:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:6494:x1877759539778304:12345-0@lo:1000:mdt00_001.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.042141:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1790771167.042187:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6494:1877759539778304:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1790771167.042214:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13208:x1877759534042368:12345-192.168.204.50@tcp:35:ls.0 Request processed in 104us (223us total) trans 4294969441 rc 0/0 00000100:00100000:1.0:1790771167.042220:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1691 00000040:00080000:0.0:1790771167.042395:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].42, 776 off57344 00000040:00080000:0.0:1790771167.042430:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].42, 856 off64616 00000004:00080000:0.0:1790771167.042434:0:6494:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfc085b9a80 with version 85 00000004:00080000:3.0:1790771167.042461:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 85 rpc_version 85 00000020:00100000:3.0:1790771167.042480:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1790771167.042601:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb057b3b80 x1877759539778560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1928/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790771167.042752:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539778560:0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771167.042763:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.042792:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.042798:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534042880 00000100:00100000:0.0:1790771167.042803:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534042880 00002000:00010000:0.0:1790771167.042816:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/14 (9314->18446744073709551615) 00000100:00100000:1.0:1790771167.042817:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:0.0:1790771167.042823:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d90a80 with x1877759534042880 ext(9314->18446744073709551615) 00002000:00010000:0.0:1790771167.042829:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03d90a80. 00000100:00100000:2.0:1790771167.042837:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043136 00000100:00100000:1.0:1790771167.042841:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043264 00000100:00100000:2.0:1790771167.042845:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043136 00000100:00100000:1.0:1790771167.042846:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043264 00000100:00100000:0.0:1790771167.042852:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 451 00000100:00100000:0.0:1790771167.042862:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759534042880:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:3.0:1790771167.042876:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.042886:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 889 00000100:00100000:2.0:1790771167.042898:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6493 00000100:00100000:1.0:1790771167.042899:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:2396:x1877759534043264:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.042902:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc07f1ad80 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.042913:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.042917:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14508:x1877759534043136:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:3.0:1790771167.042923:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539778560 00010000:00010000:1.0:1790771167.042927:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0eeba lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36437 expref: 145 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.042928:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539778560 00010000:00010000:2.0:1790771167.042929:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.042942:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.042946:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.042947:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f05e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36533 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.042964:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:1.0:1790771167.042972:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2396:x1877759534043264:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.042974:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7768:x1877759539778560:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771167.042985:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 889 00010000:00010000:2.0:1790771167.042991:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0f065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.043003:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0f065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.043013:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0f065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.043026:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771167.043040:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5d:0x0]: returning size 4096 00000100:00100000:1.0:1790771167.043042:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043392 00000004:00200000:2.0:1790771167.043046:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771167.043048:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043392 00010000:00010000:2.0:1790771167.043076:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f05e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x5d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36533 expref: 132 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.043077:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 890 00000100:00100000:1.0:1790771167.043091:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:2396:x1877759534043392:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.043099:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594c00/0xfa0c505d97f0f065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36533 expref: 131 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043102:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790771167.043105:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 47794 -> 9314 00002000:00010000:0.0:1790771167.043111:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771165 -> 1790771167 00002000:00010000:0.0:1790771167.043116:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:2.0:1790771167.043118:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d:0x0].0x0 (ffff8bfc3da48700) 00002000:00010000:0.0:1790771167.043119:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771165 -> 1790771167 00010000:00010000:1.0:1790771167.043123:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0eecf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x5d:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364df expref: 56 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.043124:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 56 -> 8 00010000:00010000:2.0:1790771167.043126:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771167.043133:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594c00, rc 0) 00010000:00010000:1.0:1790771167.043147:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5d:0x0].0x0 (ffff8bfc310f2000) 00010000:00010000:1.0:1790771167.043150:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.043154:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2399:x1877759534042880:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 294us (390us total) trans 4294967639 rc 0/0 00000100:00100000:3.0:1790771167.043157:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7768:x1877759539778560:12345-0@lo:1000:osp_up1-0.0 Request processed in 185us (281us total) trans 4294968872 rc 0/0 00000100:00100000:0.0:1790771167.043164:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 451 00002000:00010000:0.0:1790771167.043168:0:13789:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/14 (9314->18446744073709551615) 00000100:00100000:3.0:1790771167.043169:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1790771167.043173:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:14508:x1877759534043136:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 259us (374us total) trans 0 rc 0/0 00002000:00100000:0.0:1790771167.043176:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d90a80 with x1877759534042880 ext(9314->18446744073709551615) 00000100:00100000:1.0:1790771167.043177:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2396:x1877759534043392:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (149us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771167.043185:0:13789:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb03d90a80. 00000100:00100000:2.0:1790771167.043193:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6493 00000100:00100000:1.0:1790771167.043198:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 890 00000100:00100000:2.0:1790771167.043329:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b3b80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539778560:0@lo:1000:osp_up1-0.0 00000004:00080000:1.0:1790771167.043354:0:6494:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000403:0x6e:0x0] 00010000:00010000:1.0:1790771167.043360:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043366:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043376:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043389:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043395:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043403:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043410:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.043414:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043422:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043434:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:1.0:1790771167.043436:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.043438:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043444:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043448:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043469:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 3/0,0 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043474:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104c00/0xfa0c505d97f0ead1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.043506:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c75bea49 reply state 0000000011a4658b transno 4294969442 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.043514:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043515:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.043532:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.043534:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0xd964d85e (ffff8bfc3607db00) 00010000:00010000:1.0:1790771167.043540:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.043544:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790771167.043560:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.043563:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771167.043579:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14422:x1877759534016640:12345-192.168.204.50@tcp:36:ln.0 Request processed in 60908us (61012us total) trans 4294969442 rc 0/0 00010000:00010000:0.0:1790771167.043585:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593000/0xfa0c505d97f0eb3a lrc: 0/0,0 mode: --/CR res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36373 expref: 131 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.043589:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6408 00010000:00010000:0.0:1790771167.043606:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36373 expref: 130 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.043612:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771167.043614:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.043617:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592000, rc 0) 00000100:00100000:0.0:1790771167.043645:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14678:x1877759534020608:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 57612us (57747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.043666:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6422 00000100:00100000:0.0:1790771167.044628:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.044669:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045312 00000100:00100000:2.0:1790771167.044674:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045312 00000100:00100000:2.0:1790771167.044708:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6494 00000100:00100000:2.0:1790771167.044717:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:13664:x1877759534045312:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.044728:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.044738:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f06c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36468 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.044786:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f073 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.044798:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f073 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.044807:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f073 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.044816:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.044870:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f06c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36468 expref: 147 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.044884:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f073 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36468 expref: 146 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.044892:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.044895:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.044898:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594e00, rc 0) 00000100:00100000:2.0:1790771167.044931:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:13664:x1877759534045312:12345-192.168.204.50@tcp:101:ls.0 Request processed in 215us (302us total) trans 4294968873 rc 0/0 00000100:00100000:2.0:1790771167.044938:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6494 00000100:00100000:2.0:1790771167.047073:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.047110:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045824 00000100:00100000:0.0:1790771167.047114:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045824 00000100:00100000:0.0:1790771167.047140:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6495 00000100:00100000:0.0:1790771167.047145:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:13734:x1877759534045824:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.047154:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.047161:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f081 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3646f expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047196:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0f088 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047204:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0f088 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047209:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0f088 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.047214:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.047259:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f081 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3646f expref: 149 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047274:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04cae600/0xfa0c505d97f0f088 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3646f expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047281:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:0.0:1790771167.047283:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.047285:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04cae600, rc 0) 00000100:00100000:0.0:1790771167.047309:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:13734:x1877759534045824:12345-192.168.204.50@tcp:101:ls.0 Request processed in 164us (237us total) trans 4294968874 rc 0/0 00000100:00100000:0.0:1790771167.047313:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6495 00000100:00100000:3.0:1790771167.047472:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.047551:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043520 00000100:00100000:2.0:1790771167.047557:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043520 00000100:00100000:3.0:1790771167.047580:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.047593:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043648 00000100:00100000:2.0:1790771167.047599:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043648 00000100:00100000:1.0:1790771167.047611:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6496 00000100:00100000:3.0:1790771167.047624:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.047625:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14494:x1877759534043520:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:0.0:1790771167.047628:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6497 00000100:00100000:0.0:1790771167.047643:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:15087:x1877759534043648:12345-192.168.204.50@tcp:36:chmod.0 00010000:00010000:1.0:1790771167.047666:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1790771167.047680:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0ea5a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36135 expref: 130 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047693:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.047696:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043776 00010000:00010000:1.0:1790771167.047700:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0ea06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3615f expref: 129 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.047704:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043776 00010000:00010000:0.0:1790771167.047708:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047717:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.047723:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5a00/0xfa0c505d97f0e9a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360c5 expref: 128 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047728:0:13764:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.047735:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 131 pid: 13766 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.047738:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.047743:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0e9c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360e8 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047747:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.047772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.047787:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef5200/0xfa0c505d97f0e949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36094 expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.047787:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534043904 00000100:00100000:3.0:1790771167.047794:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534043904 00010000:00010000:1.0:1790771167.047802:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771167.047802:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044160 00010000:00010000:1.0:1790771167.047808:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.047809:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044160 00000100:00100000:0.0:1790771167.047814:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06732d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539776896:192.168.204.50@tcp:106: 00010000:00010000:1.0:1790771167.047832:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.047835:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1790 00010000:00010000:0.0:1790771167.047837:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f0ef2a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364e6 expref: 25 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.047850:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6498 00010000:00010000:1.0:1790771167.047853:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.047856:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759534043776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.047867:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e17ac562/0xfa0c505d97f0ef2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364e6 expref: 25 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.047869:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:13270:x1877759534044160:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.047873:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.047883:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.047887:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.047895:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 133 pid: 13766 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.047896:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9600, rc 0) 00010000:00010000:1.0:1790771167.047906:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.047906:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36541 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.047915:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 133 pid: 13766 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.047929:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.047930:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2398:x1877759534036480:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 12557us (12631us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771167.047945:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 2/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.047948:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.047949:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1059 00010000:00010000:3.0:1790771167.047958:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0aa57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x69:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34c51 expref: 134 pid: 13766 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.047972:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 4/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 134 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.047982:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 891 00010000:00010000:3.0:1790771167.047983:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:3.0:1790771167.047991:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.047992:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:2397:x1877759534043904:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.047992:0:13771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048008:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.048017:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048024:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4e00/0xfa0c505d97f0ef0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x11/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363dc expref: 133 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.048024:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 133 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.048036:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048050:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff8bfc3607d100) 00010000:00010000:2.0:1790771167.048054:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.048056:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.048061:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.048067:0:13771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.048072:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.048076:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2397:x1877759534043904:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.048092:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 891 00010000:00010000:2.0:1790771167.048098:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594600, rc 0) 00000100:00100000:3.0:1790771167.048110:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2397:x1877759534043776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 259us (487us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.048120:0:13792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.048121:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1790 00010000:00010000:0.0:1790771167.048131:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.048133:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13270:x1877759534044160:12345-192.168.204.50@tcp:101:ls.0 Request processed in 268us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.048147:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6498 00010000:00010000:0.0:1790771167.048155:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048163:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048169:0:13792:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048188:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048197:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 129 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.048210:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06374700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539778688:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.048229:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.048259:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d8ef9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.048267:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048275:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.048276:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044288 00000100:00100000:3.0:1790771167.048284:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044288 00010000:00010000:1.0:1790771167.048285:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.048297:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab24566f reply state 0000000036a5356e transno 4294969443 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048304:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048309:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfb0282aa00) 00010000:00010000:1.0:1790771167.048311:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.048313:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790771167.048316:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.048320:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048325:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048331:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048337:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.048340:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.048345:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.048349:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048353:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048360:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.048362:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.048365:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048371:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f09d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.048377:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044032 00000100:00100000:0.0:1790771167.048381:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044032 00000004:00010000:1.0:1790771167.048383:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab24566f reply state 0000000036a5356e transno 4294969443 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048395:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048404:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfb0282ab00) 00010000:00010000:1.0:1790771167.048410:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.048415:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1790771167.048416:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1066 00000100:00100000:2.0:1790771167.048417:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.048427:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759534044032:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771167.048434:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.048446:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3653a expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.048447:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045440 00000100:00100000:3.0:1790771167.048454:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6499 00000100:00100000:1.0:1790771167.048455:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045440 00002000:00010000:0.0:1790771167.048464:0:13796:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1790771167.048474:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13265:x1877759534044288:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.048475:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=167s v=(0 0) 00010000:00010000:0.0:1790771167.048507:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790771167.048515:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 25 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.048521:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.048524:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 892 00010000:00010000:0.0:1790771167.048529:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 25 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.048538:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36548 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.048539:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:2397:x1877759534045440:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.048540:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487f600, rc 0) 00000100:00100000:2.0:1790771167.048547:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.048554:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.048568:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373c00/0xfa0c505d97f0ef38 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3644c expref: 148 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.048576:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2398:x1877759534044032:12345-192.168.204.50@tcp:101:cp.0 Request processed in 144us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.048576:0:13769:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 131 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048580:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.048589:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.048592:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1066 00010000:00010000:3.0:1790771167.048606:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 131 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.048617:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2397:x1877759534045440:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (206us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.048619:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771167.048627:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.048630:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 892 00000100:00100000:0.0:1790771167.048632:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03fff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8408:1877759539777024:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.048646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.048668:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ed expref: 29 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.048668:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045568 00000100:00100000:1.0:1790771167.048674:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045568 00010000:00010000:0.0:1790771167.048682:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372800, rc 0) 00010000:00010000:1.0:1790771167.048692:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 24 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.048717:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:14893:x1877759534036608:12345-192.168.204.50@tcp:101:timeout.0 Request processed in 12893us (12979us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.048722:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1791 00010000:00010000:3.0:1790771167.048729:0:13769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 131 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.048730:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1060 00000100:00100000:1.0:1790771167.048736:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759534045568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.048749:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.048752:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1ba00, rc 0) 00000100:00100000:0.0:1790771167.048754:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044416 00000100:00100000:2.0:1790771167.048754:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.048759:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044416 00010000:00010000:1.0:1790771167.048761:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 24 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048772:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 24 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.048785:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4650b11/0xfa0c505d97f06839 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e337c1 expref: 24 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.048785:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045952 00000100:00100000:0.0:1790771167.048791:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6500 00000100:00100000:2.0:1790771167.048793:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045952 00000100:00100000:0.0:1790771167.048803:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:13266:x1877759534044416:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.048804:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(2 6) 00010000:00010000:1.0:1790771167.048813:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(2 6) 00010000:00010000:0.0:1790771167.048816:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.048821:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ed expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048826:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3654f expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.048832:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:13265:x1877759534044288:12345-192.168.204.50@tcp:101:ls.0 Request processed in 361us (602us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.048833:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ed expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.048840:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 893 00010000:00010000:0.0:1790771167.048853:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 133 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.048858:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6499 00000100:00100000:2.0:1790771167.048859:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2397:x1877759534045952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.048867:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000421edf07/0xfa0c505d97f0ef54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ed expref: 28 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048876:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 132 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.048879:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.048899:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.048900:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0ef4d lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36453 expref: 147 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.048902:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539778816:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.048905:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.048912:0:13766:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 132 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.048925:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373400, rc 0) 00010000:00010000:2.0:1790771167.048929:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.048935:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.048944:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4240 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.048949:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:13266:x1877759534044416:12345-192.168.204.50@tcp:101:ls.0 Request processed in 148us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.048956:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6500 00000100:00100000:2.0:1790771167.048967:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:2397:x1877759534045952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 112us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.048976:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 893 00000100:00100000:1.0:1790771167.048984:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14494:x1877759534043520:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 1363us (1513us total) trans 4294969443 rc 0/0 00000100:00100000:1.0:1790771167.048991:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6496 00000100:00100000:3.0:1790771167.049693:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13293:x1877759534037760:12345-192.168.204.50@tcp:37:ls.0 Request processed in 12754us (13564us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.049702:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1688 00000100:00100000:2.0:1790771167.050827:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.050859:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046208 00000100:00100000:2.0:1790771167.050863:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.050865:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046208 00000100:00100000:0.0:1790771167.050891:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046336 00000100:00100000:0.0:1790771167.050894:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046336 00000100:00100000:3.0:1790771167.050906:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6501 00000100:00100000:3.0:1790771167.050916:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:14640:x1877759534046208:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:0.0:1790771167.050920:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6502 00010000:00010000:3.0:1790771167.050928:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.050933:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13678:x1877759534046336:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.050933:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 11 locks, starting at 1 00010000:00010000:0.0:1790771167.050944:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.050948:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0ddb1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d3e expref: 147 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.050952:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f0d5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3647d expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.050966:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03c00/0xfa0c505d97f0ddaa lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d45 expref: 147 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.050977:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668800/0xfa0c505d97f0dd9c lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d37 expref: 146 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.050986:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0dd6b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d30 expref: 145 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.050992:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f0dc lrc: 3/1,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.050997:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0dd3a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35d29 expref: 144 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051004:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f0dc lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051010:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0dae0 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cf1 expref: 143 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051014:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f0dc lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.051023:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.051025:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0d9b3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35ce3 expref: 142 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051036:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0d99e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cdc expref: 141 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051044:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105a00/0xfa0c505d97f0d990 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cd5 expref: 141 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051056:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105600/0xfa0c505d97f0d966 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cce expref: 140 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051066:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.051069:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f0d5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3647d expref: 140 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051070:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.051078:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0f0ea lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364a0 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051085:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f0dc lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3647d expref: 139 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051092:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.051094:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.051096:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372200, rc 0) 00000100:00100000:0.0:1790771167.051121:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13678:x1877759534046336:12345-192.168.204.50@tcp:101:ls.0 Request processed in 194us (262us total) trans 4294968875 rc 0/0 00000100:00100000:0.0:1790771167.051126:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6502 00010000:00010000:3.0:1790771167.051136:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051145:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051151:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051162:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051309:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051319:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051328:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.051358:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046464 00000100:00100000:1.0:1790771167.051364:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046464 00010000:00010000:3.0:1790771167.051377:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0f0ff lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051390:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.051390:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0f0ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051403:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0f0ff lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.051406:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03fff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:13783:1877759539777152:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771167.051408:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1692 00000100:00100000:0.0:1790771167.051420:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.051426:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:11865:x1877759534046464:12345-192.168.204.50@tcp:35:ls.0 00000004:00200000:3.0:1790771167.051427:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 5177344 00010000:00010000:2.0:1790771167.051432:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.051441:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.051478:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2397:x1877759534039424:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13995us (14714us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.051513:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1785 00000100:00100000:1.0:1790771167.051563:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:11865:x1877759534046464:12345-192.168.204.50@tcp:35:ls.0 Request processed in 141us (235us total) trans 4294968877 rc 0/0 00000100:00100000:1.0:1790771167.051570:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1692 00000100:00100000:2.0:1790771167.051570:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046720 00000100:00100000:2.0:1790771167.051578:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046720 00010000:00010000:2.0:1790771167.051600:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 132 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.051627:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046848 00000100:00100000:1.0:1790771167.051632:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046848 00000100:00100000:2.0:1790771167.051635:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1792 00010000:00010000:3.0:1790771167.051641:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.051665:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2396:x1877759534046720:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.051670:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.051678:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.051679:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 894 00010000:00010000:2.0:1790771167.051690:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 132 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.051695:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2396:x1877759534046848:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.051709:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.051716:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 132 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.051723:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0ef77 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36445 expref: 142 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051739:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.051740:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.051741:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0eb25 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3636c expref: 132 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.051748:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.051760:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051766:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.051768:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:1.0:1790771167.051773:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2396:x1877759534046848:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (356us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.051777:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051784:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044544 00000100:00100000:0.0:1790771167.051790:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044544 00000100:00100000:1.0:1790771167.051794:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 894 00010000:00010000:2.0:1790771167.051797:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051810:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.051816:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051817:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051820:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047232 00000100:00100000:0.0:1790771167.051825:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047232 00002000:00010000:1.0:1790771167.051828:0:13787:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks: 8 -> 56 00000100:00100000:1.0:1790771167.051842:0:13787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:13787:1877759539777280:192.168.204.50@tcp:106: 00010000:00010000:2.0:1790771167.051844:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051845:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6503 00010000:00010000:3.0:1790771167.051845:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.051859:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:13263:x1877759534044544:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.051864:0:13787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0efa1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364f4 expref: 27 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051872:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.051873:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.051873:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051879:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.051881:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000901d803b/0xfa0c505d97f0efa1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364f4 expref: 27 pid: 13787 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051884:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36556 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051886:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.051899:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.051910:0:13787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00010000:00010000:3.0:1790771167.051913:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f0f1 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051922:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 134 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.051938:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534036736:12345-192.168.204.50@tcp:101:rm.0 Request processed in 14238us (15904us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771167.051940:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.051941:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 134 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.051941:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.051950:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1061 00010000:00010000:0.0:1790771167.051964:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.051972:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.051974:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:2396:x1877759534046720:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 326us (581us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.051979:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.051980:0:7771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 134 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.051982:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90000 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0001_UUID:13765:1877759539777664:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.052001:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.052001:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1792 00010000:00010000:3.0:1790771167.052006:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052007:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372000, rc 0) 00010000:00010000:3.0:1790771167.052023:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.052028:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.052035:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:13263:x1877759534044544:12345-192.168.204.50@tcp:101:ls.0 Request processed in 177us (591us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.052038:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052039:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.052044:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6503 00000100:00100000:1.0:1790771167.052055:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6504 00010000:00010000:2.0:1790771167.052064:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052066:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9537b590 (ffff8bfb02b20400) 00000100:00100000:1.0:1790771167.052071:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:14948:x1877759534047232:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:3.0:1790771167.052076:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.052082:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052091:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f0f8 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052125:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052135:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0f0ea lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a0 expref: 141 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052136:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052160:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.052164:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb6b1884 reply state 000000003a68b74a transno 4294969444 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052167:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0f0ff lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a0 expref: 140 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052173:0:13774:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052189:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052196:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052196:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:2.0:1790771167.052201:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.052206:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771167.052210:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052217:0:13767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052223:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052231:0:13767:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.052233:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539777408:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.052246:0:13767:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052253:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 3/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [24576->53247] (req 24576->53247) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36502 expref: 23 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052257:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.052271:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3ab400, rc 0) 00010000:00010000:3.0:1790771167.052271:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771167.052278:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1bc00, rc 0) 00000100:00100000:2.0:1790771167.052299:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.052301:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:14868:x1877759534037248:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 14389us (16232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.052307:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1062 00000100:00100000:3.0:1790771167.052316:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:14640:x1877759534046208:12345-192.168.204.50@tcp:101:dd.0 Request processed in 1399us (1486us total) trans 4294968876 rc 0/0 00000100:00100000:3.0:1790771167.052326:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6501 00000100:00100000:2.0:1790771167.052342:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:15091:x1877759534020864:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 66263us (66353us total) trans 4294969444 rc 0/0 00000100:00100000:2.0:1790771167.052352:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6423 00010000:00010000:2.0:1790771167.052389:0:13763:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.052395:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566d880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12128:1877759539777536:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.052401:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052412:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052418:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052420:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.052427:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x33:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.052435:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.052447:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.052450:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052456:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052470:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052518:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0eedd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363d5 expref: 134 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.052537:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363d5 expref: 133 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.052545:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.052546:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.052551:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.052555:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996000, rc 0) 00010000:00010000:0.0:1790771167.052574:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052581:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052586:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.052595:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:14831:x1877759534024320:12345-192.168.204.50@tcp:101:ln.0 Request processed in 17834us (18284us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.052596:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05105800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.052608:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6475 00010000:00010000:0.0:1790771167.052637:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052643:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052668:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.052671:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.052676:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052683:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105800/0xfa0c505d97f0ee35 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052696:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052703:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052710:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052717:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.052721:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052729:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052743:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc19631f00) 00010000:00010000:0.0:1790771167.052746:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.052753:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.052753:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759534040960:12345-192.168.204.50@tcp:4:cp.0 Request processed in 11696us (11887us total) trans 4294967642 rc 0/0 00010000:00010000:0.0:1790771167.052771:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f11b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.052773:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 99 00002000:00100000:3.0:1790771167.052788:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->38335) req@ffff8bfb057b0a80 x1877759534040960/t4294967642(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/448 e 0 to 0 dl 1790771178 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771167.052799:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b0a80 with x1877759534040960 ext(0->38335) 00010000:00010000:0.0:1790771167.052803:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0ee2e lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ab expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052810:0:8412:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 22 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052814:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.052820:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.052826:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0ee2e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363ab expref: 125 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.052833:0:8412:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 22 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.052837:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aee00, rc 0) 00002000:00010000:3.0:1790771167.052847:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb057b0a80 00000100:00100000:0.0:1790771167.052867:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14005:x1877759534033536:12345-192.168.204.50@tcp:101:ls.0 Request processed in 26604us (26707us total) trans 4294969445 rc 301/301 00000100:00100000:0.0:1790771167.052872:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6466 00000100:00100000:1.0:1790771167.058155:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.058197:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534048896 00000100:00100000:0.0:1790771167.058203:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534048896 00000100:00100000:0.0:1790771167.058236:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6505 00000100:00100000:0.0:1790771167.058246:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13735:x1877759534048896:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.058261:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.058272:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f129 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e364a7 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.058328:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0f130 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.058337:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0f130 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.058343:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0f130 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.058349:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.058393:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f129 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a7 expref: 143 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.058403:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0f130 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a7 expref: 142 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.058408:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:0.0:1790771167.058410:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.058412:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:0.0:1790771167.058440:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13735:x1877759534048896:12345-192.168.204.50@tcp:101:ls.0 Request processed in 197us (288us total) trans 4294968878 rc 0/0 00000100:00100000:0.0:1790771167.058444:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6505 00000100:00100000:1.0:1790771167.058911:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.058931:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.058952:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.058953:0:12031:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047104 00000100:00100000:2.0:1790771167.058960:0:12031:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047104 00000100:00100000:1.0:1790771167.058977:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.058984:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047616 00000100:00100000:0.0:1790771167.058988:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047488 00000100:00100000:3.0:1790771167.058992:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047616 00000100:00100000:0.0:1790771167.058993:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047488 00000100:00100000:1.0:1790771167.059002:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047872 00000100:00100000:1.0:1790771167.059007:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047872 00000100:00100000:2.0:1790771167.059012:0:12031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1067 00010000:00010000:0.0:1790771167.059014:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 125 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059031:0:12031:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2398:x1877759534047104:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771167.059047:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1793 00000100:00100000:3.0:1790771167.059049:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6506 00000100:00100000:1.0:1790771167.059055:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 895 00000100:00100000:0.0:1790771167.059060:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2397:x1877759534047488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.059066:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14482:x1877759534047616:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:1.0:1790771167.059070:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:2397:x1877759534047872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.059073:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.059082:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 125 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.059084:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.059089:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.059094:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 125 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.059101:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0f13e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3658e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059108:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031600/0xfa0c505d97f0efe0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3643e expref: 142 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.059109:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104600/0xfa0c505d97f0e9e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x73:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360ef expref: 125 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.059127:0:12031:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 38336 00010000:00010000:0.0:1790771167.059135:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00002000:00010000:2.0:1790771167.059137:0:12031:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00010000:00010000:0.0:1790771167.059141:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.059143:0:12031:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:1.0:1790771167.059145:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00002000:00010000:2.0:1790771167.059152:0:12031:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771166 -> 1790771167 00010000:00010000:3.0:1790771167.059153:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0f13e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3658e expref: 125 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059154:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.059159:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.059160:0:12031:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 80 00010000:00010000:0.0:1790771167.059177:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.059182:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759534047872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 115us (204us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.059184:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1be00/0xfa0c505d97f0f13e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x49:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3658e expref: 125 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.059189:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.059203:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 895 00000100:00100000:2.0:1790771167.059204:0:12031:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2398:x1877759534047104:12345-192.168.204.50@tcp:2:cp.0 Request processed in 176us (287us total) trans 4294967643 rc 0/0 00010000:00010000:0.0:1790771167.059209:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059223:0:12031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1067 00000100:00100000:1.0:1790771167.059240:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.059240:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:0.0:1790771167.059243:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.059248:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771167.059252:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1be00, rc 0) 00000100:00100000:2.0:1790771167.059262:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047360 00000100:00100000:2.0:1790771167.059269:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047360 00000100:00100000:0.0:1790771167.059277:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2397:x1877759534047488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 219us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.059291:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1793 00000100:00100000:3.0:1790771167.059294:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14482:x1877759534047616:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 228us (353us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.059295:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.059300:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.059316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6506 00000100:00100000:0.0:1790771167.059321:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534047744 00000100:00100000:0.0:1790771167.059326:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534047744 00010000:00010000:0.0:1790771167.059344:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1794 00000100:00100000:1.0:1790771167.059354:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.059358:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059373:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759534047360:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.059373:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.059384:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534048000 00000100:00100000:0.0:1790771167.059388:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534048000 00010000:00010000:2.0:1790771167.059389:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.059393:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1795 00010000:00010000:2.0:1790771167.059407:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.059409:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2397:x1877759534047744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.059417:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 896 00010000:00010000:1.0:1790771167.059430:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.059432:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759534048000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.059435:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059439:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.059441:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.059454:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f01f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3645a expref: 141 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.059471:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.059471:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.059478:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.059478:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f430b34d/0xfa0c505d97f0d116 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 24576->40959) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35a20 expref: 26 pid: 12031 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.059518:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759534048000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.059518:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02a00/0xfa0c505d97f0e9dc lrc: 0/0,0 mode: --/PR res: [0x240000402:0x37:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36318 expref: 55 pid: 13762 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.059538:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 896 00010000:00010000:1.0:1790771167.059552:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:2.0:1790771167.059556:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(6 8) 00010000:00010000:1.0:1790771167.059558:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.059566:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(6 8) 00010000:00010000:1.0:1790771167.059569:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059578:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.059583:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->53247) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36502 expref: 22 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.059597:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->53247) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36502 expref: 22 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059600:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.059625:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2397:x1877759534047744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 222us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.059631:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1795 00010000:00010000:2.0:1790771167.059637:0:6480:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008a5e848a/0xfa0c505d97f0efa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 24576->53247) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36502 expref: 22 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059672:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059677:0:6480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539778944:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771167.059681:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.059740:0:6480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cc00 going to sleep for 11 seconds 00000040:00080000:3.0:1790771167.059816:0:12128:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 88 off11240 00000004:00200000:1.0:1790771167.059853:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x37:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.059862:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059868:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059872:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059876:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.059878:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059883:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059890:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x0 (ffff8bfb0321e100) 00010000:00010000:1.0:1790771167.059892:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771167.059895:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 2/0,0 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059899:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0efbd lrc: 0/0,0 mode: --/EX res: [0x240000402:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059918:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059922:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.059925:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f27b1f6f reply state 00000000708611fc transno 4294969446 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059927:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059941:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.059945:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059953:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.059954:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.059961:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3600dd00) 00010000:00010000:1.0:1790771167.059965:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.059968:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.059969:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771167.059976:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0ed08 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.059977:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771167.059984:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.059998:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006a44463f reply state 0000000054140c7c transno 4294968879 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060001:0:12128:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.060009:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060013:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.060016:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc36078600) 00010000:00010000:1.0:1790771167.060023:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.060026:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790771167.060032:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060041:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.060061:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:14512:x1877759534026368:12345-192.168.204.50@tcp:36:rm.0 Request processed in 59618us (59734us total) trans 4294968879 rc 0/0 00000100:00100000:1.0:1790771167.060067:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6446 00000100:00100000:3.0:1790771167.060070:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.060101:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060111:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.060139:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:14695:x1877759534038144:12345-192.168.204.50@tcp:36:chown.0 Request processed in 22170us (23880us total) trans 4294969446 rc 0/0 00000100:00100000:3.0:1790771167.060149:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6482 00000001:00080000:2.0:1790771167.060157:0:13770:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969440 00000004:00010000:2.0:1790771167.060183:0:13770:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f5203f1a reply state 00000000f3540b7c transno 4294969447 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060195:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060203:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:2.0:1790771167.060206:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.060209:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060217:0:13770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060224:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060232:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.060240:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.060264:0:13770:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771167.060282:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.060289:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.060329:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+135:14875:x1877759534042112:12345-192.168.204.50@tcp:36:cp.0 Request processed in 18566us (18646us total) trans 4294969447 rc 0/0 00000100:00100000:2.0:1790771167.060338:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6492 00000020:00080000:2.0:1790771167.060344:0:13770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00010000:0.0:1790771167.060347:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000059486b2d reply state 00000000744f4927 transno 4294969448 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.060361:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.060366:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771167.060368:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.060370:0:13764:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.060376:0:13764:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.060380:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.060399:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771167.060439:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+136:15087:x1877759534043648:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 12801us (12862us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1790771167.060444:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6497 00010000:00010000:3.0:1790771167.060480:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060517:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771167.060807:0:13774:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].40, 88 off11328 00000004:00010000:3.0:1790771167.060843:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a55ff200 reply state 00000000c77da51d transno 4294969449 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060855:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.060863:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:3.0:1790771167.060867:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771167.060870:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771167.060928:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:14948:x1877759534047232:12345-192.168.204.50@tcp:36:chown.0 Request processed in 8860us (9164us total) trans 4294969449 rc 0/0 00000100:00100000:3.0:1790771167.060938:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6504 00000100:00100000:1.0:1790771167.061334:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.061360:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.061373:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534048640 00000100:00100000:3.0:1790771167.061380:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534048640 00000100:00100000:1.0:1790771167.061387:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.061391:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534048384 00000100:00100000:0.0:1790771167.061396:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534048384 00002000:00100000:0.0:1790771167.061420:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (593920->598015) req@ffff8bfb03d91180 x1877759534048384/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771167.061427:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6507 00000100:00100000:2.0:1790771167.061429:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534048512 00002000:00100000:0.0:1790771167.061435:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d91180 with x1877759534048384 ext(593920->598015) 00000100:00100000:2.0:1790771167.061438:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534048512 00002000:00010000:0.0:1790771167.061440:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d91180 00000100:00100000:3.0:1790771167.061447:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14078:x1877759534048640:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:3.0:1790771167.061460:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.061464:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 452 00000100:00100000:1.0:1790771167.061470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.061473:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f145 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3659c expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.061479:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759534048384:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:2.0:1790771167.061527:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 897 00000100:00100000:1.0:1790771167.061530:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044800 00000100:00100000:1.0:1790771167.061534:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044800 00000100:00100000:2.0:1790771167.061542:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+141:2397:x1877759534048512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.061554:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.061560:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6508 00000100:00100000:1.0:1790771167.061570:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+137:13264:x1877759534044800:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.061570:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0effc lrc: 0/0,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36510 expref: 141 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.061584:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.061592:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff8bfc34224100) 00010000:00010000:3.0:1790771167.061595:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f14c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.061597:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36564 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.061598:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.061614:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759534048384:12345-192.168.204.50@tcp:3:cat.0 Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.061623:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 452 00010000:00010000:3.0:1790771167.061624:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f14c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771167.061632:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000400:0xb:0x0] (593920->598015) req@ffff8bfb03d91180 x1877759534048384/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1790771167.061633:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:2397:x1877759534048512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 92us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.061634:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 138 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.061667:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f14c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.061673:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 897 00002000:00100000:0.0:1790771167.061684:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03d91180 with x1877759534048384 ext(593920->598015) 00002000:00010000:0.0:1790771167.061691:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03d91180 00010000:00010000:1.0:1790771167.061702:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 138 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.061709:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.061711:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.061714:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 138 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.061714:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1790771167.061723:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1790771167.061726:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b800, rc 0) 00000100:00100000:1.0:1790771167.061753:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+138:13264:x1877759534044800:12345-192.168.204.50@tcp:101:ls.0 Request processed in 186us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.061756:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f145 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3659c expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.061762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6508 00002000:00010000:2.0:1790771167.061765:0:8676:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb size: 14473 -> 18808832 00002000:00010000:2.0:1790771167.061773:0:8676:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb mtime: 1790771166 -> 1790771167 00002000:00010000:2.0:1790771167.061778:0:8676:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb atime: 0 -> 1790771161 00002000:00010000:2.0:1790771167.061780:0:8676:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb ctime: 1790771166 -> 1790771167 00002000:00010000:2.0:1790771167.061784:0:8676:0:(ofd_lvb.c:284:ofd_lvbo_update()) res: [0x280000401:0x13:0x0] updating lvb blocks: 0 -> 1 00010000:00010000:3.0:1790771167.061791:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b400/0xfa0c505d97f0f14c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3659c expref: 125 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.061798:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8676:1877759539778176:192.168.204.50@tcp:106: 00010000:00010000:3.0:1790771167.061814:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb02b20000) 00010000:00010000:3.0:1790771167.061818:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771167.061821:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b400, rc 0) 00010000:00010000:2.0:1790771167.061827:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000039d73694/0xfa0c505d97f0f050 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3651e expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.061850:0:8676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039d73694/0xfa0c505d97f0f050 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3651e expref: 25 pid: 8676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.061860:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60200, rc 0) 00000100:00100000:2.0:1790771167.061913:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759534040448:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 20403us (20492us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.061915:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14078:x1877759534048640:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 469us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.061930:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1065 00000100:00100000:3.0:1790771167.061933:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6507 00000100:00100000:1.0:1790771167.062710:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.062744:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050560 00000100:00100000:0.0:1790771167.062749:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050560 00000100:00100000:0.0:1790771167.062773:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6509 00000100:00100000:0.0:1790771167.062779:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+140:13741:x1877759534050560:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.062787:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.062794:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f15a lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36509 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.062830:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f161 lrc: 3/1,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.062838:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f161 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.062844:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f161 lrc: 3/1,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.062849:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x34:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.062884:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f15a lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36509 expref: 143 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.062893:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f161 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36509 expref: 142 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.062899:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:0.0:1790771167.062901:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.062902:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596600, rc 0) 00000100:00100000:0.0:1790771167.062926:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:13741:x1877759534050560:12345-192.168.204.50@tcp:101:ls.0 Request processed in 147us (216us total) trans 4294968880 rc 0/0 00000100:00100000:0.0:1790771167.062930:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6509 00000100:00100000:1.0:1790771167.063000:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.063019:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.063034:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.063051:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.063060:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534049920 00000100:00100000:0.0:1790771167.063065:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534049920 00000100:00100000:2.0:1790771167.063075:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044672 00000100:00100000:3.0:1790771167.063078:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534049408 00000100:00100000:2.0:1790771167.063083:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044672 00000100:00100000:3.0:1790771167.063085:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534049408 00000100:00100000:1.0:1790771167.063087:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.063097:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 898 00000100:00100000:0.0:1790771167.063107:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2397:x1877759534049920:12345-192.168.204.50@tcp:103:mrename.0 00010000:00010000:0.0:1790771167.063114:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.063129:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487fa00/0xfa0c505d97ef5f2e lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d734 expref: 54 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.063132:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050048 00000100:00100000:3.0:1790771167.063133:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1693 00000100:00100000:1.0:1790771167.063137:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.063140:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050048 00000100:00100000:3.0:1790771167.063149:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11371450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+139:11733:x1877759534049408:12345-192.168.204.50@tcp:35:dir_create.sh.0 00010000:00010000:0.0:1790771167.063152:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:0.0:1790771167.063156:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.063173:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050432 00000100:00100000:2.0:1790771167.063178:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050432 00000100:00100000:0.0:1790771167.063188:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:2397:x1877759534049920:12345-192.168.204.50@tcp:103:mrename.0 Request processed in 80us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.063188:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.063197:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 898 00000100:00100000:0.0:1790771167.063212:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050304 00000100:00100000:0.0:1790771167.063217:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050304 00000100:00100000:2.0:1790771167.063219:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050816 00000100:00100000:2.0:1790771167.063226:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050816 00000100:00100000:0.0:1790771167.063260:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 899 00000100:00100000:2.0:1790771167.063268:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6510 00000100:00100000:0.0:1790771167.063275:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2397:x1877759534050304:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.063276:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.063285:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:13260:x1877759534044672:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.063287:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.063296:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.063301:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06594e00/0xfa0c505d97f0f073 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36468 expref: 144 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063301:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534049152 00000100:00100000:1.0:1790771167.063307:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534049152 00010000:00010000:2.0:1790771167.063311:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3655d expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.063314:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.063320:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.063337:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11371450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:11733:x1877759534049408:12345-192.168.204.50@tcp:35:dir_create.sh.0 Request processed in 190us (334us total) trans 4294969450 rc 0/0 00010000:00010000:2.0:1790771167.063345:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 141 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.063346:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:2397:x1877759534050304:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.063346:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1068 00000100:00100000:3.0:1790771167.063352:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1693 00000100:00100000:1.0:1790771167.063361:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534049152:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:0.0:1790771167.063367:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 899 00010000:00010000:2.0:1790771167.063378:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 140 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.063382:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.063398:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f176 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365a3 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.063398:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.063405:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.063412:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6511 00010000:00010000:2.0:1790771167.063414:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 140 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.063426:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14667:x1877759534050048:12345-192.168.204.50@tcp:36:lfs.0 00010000:00010000:2.0:1790771167.063430:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595e00, rc 0) 00000100:00100000:3.0:1790771167.063430:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6512 00000100:00100000:1.0:1790771167.063447:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539779072:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771167.063449:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14452:x1877759534050432:12345-192.168.204.50@tcp:101:chown.0 00000100:00100000:2.0:1790771167.063464:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08b00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+140:13260:x1877759534044672:12345-192.168.204.50@tcp:101:ls.0 Request processed in 182us (440us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.063464:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.063474:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6510 00010000:00010000:3.0:1790771167.063478:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0f17d lrc: 2/0,0 mode: --/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365b8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.063508:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06731180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:13766:1877759539779200:0@lo:1000:mdt00_011.0 00000100:00100000:2.0:1790771167.063528:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6513 00000100:00100000:2.0:1790771167.063539:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14842:x1877759534050816:12345-192.168.204.50@tcp:36:chmod.0 00000100:00100000:1.0:1790771167.063543:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4c00 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.063546:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0f17d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b8 expref: 143 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.063554:0:13766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790771167.063568:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1a400/0xfa0c505d97f0f17d lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x6e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b8 expref: 143 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.063570:0:13772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.063576:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1045a900 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.063592:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687a00/0xfa0c505d97f0d80f lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35c1f expref: 53 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.063596:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:3.0:1790771167.063603:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771167.063607:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a400, rc 0) 00010000:00010000:2.0:1790771167.063612:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.063618:0:13772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.063632:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.063637:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14452:x1877759534050432:12345-192.168.204.50@tcp:101:chown.0 Request processed in 193us (551us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.063670:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 52 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.063670:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6512 00010000:00010000:2.0:1790771167.063686:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 143 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063695:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539779200 00000100:00100000:1.0:1790771167.063700:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539779200 00010000:00010000:2.0:1790771167.063705:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 5/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063733:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00010000:00010000:2.0:1790771167.063734:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 143 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063743:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13766:x1877759539779200:12345-0@lo:1000:mdt00_011.0 00010000:00010000:2.0:1790771167.063753:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 143 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.063767:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539779328:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.063826:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 52 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063836:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13766:x1877759539779200:12345-0@lo:1000:mdt00_011.0 Request processed in 92us (282us total) trans 0 rc 1/1 00010000:00010000:2.0:1790771167.063842:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 52 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.063850:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1790771167.063863:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566d180 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539779456:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.063906:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c900 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.063923:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06731180 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0001-mdtlov_UUID:13766:1877759539779200:0@lo:1000:mdt00_011.0 00000100:00100000:1.0:1790771167.063979:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3d8a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14667:x1877759534050048:12345-192.168.204.50@tcp:36:lfs.0 Request processed in 555us (925us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771167.063986:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6511 00000100:00100000:0.0:1790771167.064845:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.064874:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534051200 00000100:00100000:1.0:1790771167.064879:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534051200 00000100:00100000:1.0:1790771167.064902:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6514 00000100:00100000:1.0:1790771167.064908:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14803:x1877759534051200:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771167.064917:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.064918:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790771167.064928:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0eb9c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36254 expref: 125 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.064940:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771167.064943:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.064948:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f18b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36595 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.064987:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.064995:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065000:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065014:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 139 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065020:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 139 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.065027:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f919c00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539779584:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.065060:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4600 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.065306:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.065327:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.065334:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06374700 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539778688:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.065353:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.065353:0:13792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.065353:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534050944 00000100:00100000:2.0:1790771167.065359:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534044928 00000100:00100000:3.0:1790771167.065360:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534050944 00000100:00100000:2.0:1790771167.065367:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534044928 00000100:00100000:0.0:1790771167.065377:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534051072 00000100:00100000:0.0:1790771167.065382:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534051072 00000100:00100000:3.0:1790771167.065395:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6515 00010000:00010000:0.0:1790771167.065399:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 141 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.065412:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14588:x1877759534050944:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:2.0:1790771167.065417:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6516 00000100:00100000:1.0:1790771167.065423:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.065427:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1796 00000100:00100000:2.0:1790771167.065435:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:13262:x1877759534044928:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.065440:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:2397:x1877759534051072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.065444:0:13764:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.065447:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045056 00010000:00010000:2.0:1790771167.065452:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.065453:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.065453:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045056 00010000:00010000:3.0:1790771167.065465:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06a03800/0xfa0c505d97f0ed32 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36461 expref: 126 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065466:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 142 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065468:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3656b expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.065507:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6517 00010000:00010000:0.0:1790771167.065514:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 142 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.065520:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13271:x1877759534045056:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.065523:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff8bfb02b20000) 00010000:00010000:3.0:1790771167.065535:0:13764:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.065539:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.065544:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05105400/0xfa0c505d97f0c681 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x41:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e355c0 expref: 142 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065551:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36572 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065555:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:2.0:1790771167.065562:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065564:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065581:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065587:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065589:0:6493:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 143 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.065607:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.065608:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 143 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.065612:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14588:x1877759534050944:12345-192.168.204.50@tcp:36:ln.0 Request processed in 199us (297us total) trans 0 rc -17/-17 00010000:00010000:2.0:1790771167.065613:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 143 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065617:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.065625:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.065630:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:2397:x1877759534051072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 192us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.065633:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 143 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.065634:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6515 00000100:00100000:0.0:1790771167.065662:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1796 00010000:00010000:1.0:1790771167.065663:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373e00, rc 0) 00010000:00010000:2.0:1790771167.065664:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.065670:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.065676:0:13770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 142 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065686:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594800, rc 0) 00000100:00100000:1.0:1790771167.065692:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13271:x1877759534045056:12345-192.168.204.50@tcp:101:ls.0 Request processed in 174us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.065699:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6517 00000100:00100000:2.0:1790771167.065722:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:13262:x1877759534044928:12345-192.168.204.50@tcp:101:ls.0 Request processed in 291us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.065730:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6516 00000100:00100000:1.0:1790771167.065742:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0000_UUID:13784:1877759539778816:192.168.204.50@tcp:105: 00010000:00010000:1.0:1790771167.065759:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.065761:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.065787:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534045184 00000100:00100000:1.0:1790771167.065793:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759534045568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 17053us (17251us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.065795:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534045184 00000100:00100000:1.0:1790771167.065808:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1791 00000100:00100000:3.0:1790771167.065839:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6518 00000100:00100000:3.0:1790771167.065851:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+141:13261:x1877759534045184:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.065864:0:13792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.065874:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065940:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.065952:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36579 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065973:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065983:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 3/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.065991:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.065994:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.065998:0:12030:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 142 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066006:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594a00, rc 0) 00000100:00100000:2.0:1790771167.066038:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:13261:x1877759534045184:12345-192.168.204.50@tcp:101:ls.0 Request processed in 190us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.066046:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6518 00000004:00200000:1.0:1790771167.066063:0:13792:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x41:0x0]: returning size 1 00010000:00010000:1.0:1790771167.066079:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066086:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066091:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066095:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aaa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.066098:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066103:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066109:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x41:0x0].0x0 (ffff8bfc0ab7e700) 00010000:00010000:1.0:1790771167.066110:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771167.066113:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066116:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f0b2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.066131:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051b9dfb7 reply state 000000004fb4d360 transno 4294969451 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066138:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066144:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:1.0:1790771167.066145:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:1.0:1790771167.066147:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1790771167.066152:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051b9dfb7 reply state 000000004fb4d360 transno 4294969451 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066157:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066162:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.066163:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.066165:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066170:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066174:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.066190:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1790771167.066193:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066197:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066203:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066208:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.066209:0:13761:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066210:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066227:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066231:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066234:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.066240:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.066246:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 141 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066253:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 141 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066261:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 141 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066267:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 141 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066273:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 141 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066278:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 141 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066284:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 141 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066290:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 141 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066296:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 141 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066297:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0f1ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x69:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066311:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 141 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066313:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066322:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 141 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066325:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0f1ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066333:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 141 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.066336:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x69:0x0]: returning size 38336 00010000:00010000:1.0:1790771167.066347:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066355:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 141 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.066359:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.066368:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066373:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066397:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.066400:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534051712 00000100:00100000:2.0:1790771167.066407:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534051712 00010000:00010000:1.0:1790771167.066413:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066424:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066433:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066440:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.066444:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6519 00010000:00010000:1.0:1790771167.066452:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.066459:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14494:x1877759534051712:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771167.066461:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066474:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066477:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.066481:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066526:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f1bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365c6 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066527:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066547:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066554:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066561:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066567:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066572:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066577:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aea00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.066580:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066585:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 142 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066586:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066587:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066612:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.066615:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.066616:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779712:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.066617:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.066623:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066639:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0edbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066643:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066661:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066675:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066681:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066683:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066684:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066689:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05e84400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.066694:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.066702:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.066711:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f918380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779840:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.066716:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066717:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066734:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc36078a00) 00010000:00010000:0.0:1790771167.066739:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.066747:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066747:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 142 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066747:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066768:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0edc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.066770:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.066779:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779968:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.066801:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0edb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363e3 expref: 143 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.066809:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 142 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066814:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596800/0xfa0c505d97f0f1ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x69:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363e3 expref: 142 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.066825:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00000100:00100000:1.0:1790771167.066829:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780096:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.066841:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00010000:00010000:0.0:1790771167.066844:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.066846:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596800, rc 0) 00010000:00010000:1.0:1790771167.066868:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 142 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.066877:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:15098:x1877759534024960:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 48243us (48347us total) trans 4294969452 rc 0/0 00010000:00010000:2.0:1790771167.066880:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.066882:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780224:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.066892:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6456 00010000:00010000:2.0:1790771167.066901:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066909:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.066912:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534046592 00000100:00100000:0.0:1790771167.066916:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534046592 00010000:00010000:1.0:1790771167.066919:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 141 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066923:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.066931:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f919500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780352:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.066937:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.066944:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.066950:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6520 00010000:00010000:2.0:1790771167.066960:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.066964:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+142:15027:x1877759534046592:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771167.066965:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 142 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.066979:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.066983:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771167.066984:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780480:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.066989:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f1d8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36580 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.066992:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.066999:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.067012:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36580 expref: 143 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067012:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f1c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067016:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 143 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.067042:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36580 expref: 143 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.067043:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03d90e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780608:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.067058:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.067059:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.067061:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.067066:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06596000, rc 0) 00010000:00010000:1.0:1790771167.067072:0:13792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 143 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067075:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.067093:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06192300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780736:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.067094:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:15027:x1877759534046592:12345-192.168.204.50@tcp:101:chown.0 Request processed in 128us (392us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.067094:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.067115:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6520 00010000:00010000:2.0:1790771167.067116:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.067119:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4540 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.067122:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067131:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067145:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfb0282ab00) 00010000:00010000:2.0:1790771167.067148:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.067152:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067159:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f1ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.067171:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534051968 00000100:00100000:1.0:1790771167.067176:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534051968 00010000:00010000:2.0:1790771167.067192:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f1bc lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365c6 expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.067206:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771167.067207:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1069 00010000:00010000:2.0:1790771167.067213:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1790771167.067219:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:15040:x1877759534051968:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:2.0:1790771167.067221:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f1bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365c6 expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067233:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.067237:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595600, rc 0) 00010000:00010000:1.0:1790771167.067246:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365cd expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067270:0:13782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 28 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.067278:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14494:x1877759534051712:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 819us (919us total) trans 4294969453 rc 301/301 00010000:00010000:1.0:1790771167.067289:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1790771167.067294:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6519 00010000:00010000:1.0:1790771167.067297:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771167.067306:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365cd expref: 28 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067329:0:13782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 28 pid: 13796 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067341:0:13782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 28 pid: 13796 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.067351:0:13782:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539780864:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.067383:0:13782:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.067434:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.067511:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534052096 00000100:00100000:1.0:1790771167.067516:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534052096 00000100:00100000:1.0:1790771167.067547:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6521 00000100:00100000:1.0:1790771167.067553:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+142:14640:x1877759534052096:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:1.0:1790771167.067560:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.067569:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0f1e6 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365d4 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067584:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0f1ed lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067590:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0f1ed lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067596:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0f1ed lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067682:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372400/0xfa0c505d97f0f1e6 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365d4 expref: 144 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067692:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372c00/0xfa0c505d97f0f1ed lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365d4 expref: 143 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.067697:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:1.0:1790771167.067699:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790771167.067701:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372c00, rc 0) 00000100:00100000:1.0:1790771167.067725:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+143:14640:x1877759534052096:12345-192.168.204.50@tcp:101:dd.0 Request processed in 173us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.067729:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6521 00000100:00100000:0.0:1790771167.068853:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.068909:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534053248 00000100:00100000:3.0:1790771167.068914:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534053248 00000100:00100000:0.0:1790771167.068922:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.068942:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.068967:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.068967:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534052608 00000100:00100000:2.0:1790771167.068969:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534052352 00000100:00100000:1.0:1790771167.068974:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534052608 00000100:00100000:2.0:1790771167.068978:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534052352 00010000:00010000:2.0:1790771167.069001:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 23 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.069014:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6522 00000100:00100000:0.0:1790771167.069023:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6523 00000100:00100000:1.0:1790771167.069028:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14007:x1877759534053248:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771167.069036:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1797 00000100:00100000:0.0:1790771167.069038:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+143:14895:x1877759534052608:12345-192.168.204.50@tcp:36:truncate.0 00010000:00010000:1.0:1790771167.069039:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.069051:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2397:x1877759534052352:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.069052:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f1f4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365e2 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069066:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.069079:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 23 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069095:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069095:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 23 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069114:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.069122:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x73:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069124:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069124:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(3 6) 00010000:00010000:2.0:1790771167.069136:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(3 6) 00010000:00010000:0.0:1790771167.069142:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069149:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ca expref: 28 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069150:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.069158:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069175:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069185:0:13791:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ca expref: 28 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069187:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771167.069207:0:13764:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969454 00000004:00010000:0.0:1790771167.069227:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070f39171 reply state 00000000a03035aa transno 4294969455 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.069231:0:13791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d9f5cc66/0xfa0c505d97f0ee5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 8192->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ca expref: 28 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.069239:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.069244:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.069247:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771167.069249:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:13791:1877759539780992:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.069252:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.069255:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.069279:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069286:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069291:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069296:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ac00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.069299:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.069302:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14895:x1877759534052608:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 268us (357us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1790771167.069310:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.069311:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6523 00000020:00080000:0.0:1790771167.069318:0:13764:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771167.069322:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069333:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771167.069335:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.069338:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069343:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f1fb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069351:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069356:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069360:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069364:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.069367:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069373:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069382:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb0282a000) 00010000:00010000:1.0:1790771167.069385:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.069388:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069397:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f209 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.069416:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534052992 00000100:00100000:2.0:1790771167.069422:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534052992 00010000:00010000:1.0:1790771167.069434:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f1f4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e2 expref: 130 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069443:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771167.069444:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.069448:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f1f4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e2 expref: 130 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.069457:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00000100:00100000:2.0:1790771167.069461:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1694 00000100:00100000:2.0:1790771167.069474:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14005:x1877759534052992:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.069513:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14007:x1877759534053248:12345-192.168.204.50@tcp:101:ls.0 Request processed in 490us (658us total) trans 4294969456 rc 301/301 00000100:00100000:1.0:1790771167.069519:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6522 00000100:00100000:2.0:1790771167.069617:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14005:x1877759534052992:12345-192.168.204.50@tcp:35:ls.0 Request processed in 145us (649us total) trans 4294969457 rc 0/0 00000100:00100000:2.0:1790771167.069628:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1694 00000100:00100000:2.0:1790771167.069751:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.069783:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534052736 00000100:00100000:0.0:1790771167.069787:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534052736 00002000:00100000:0.0:1790771167.069805:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8bfb0566f100 x1877759534052736/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'timeout.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.069812:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566f100 with x1877759534052736 ext(0->4095) 00002000:00010000:0.0:1790771167.069815:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0566f100 00000100:00100000:0.0:1790771167.069833:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 453 00000100:00100000:0.0:1790771167.069839:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534052736:12345-192.168.204.50@tcp:3:timeout.0 00000100:00100000:1.0:1790771167.069894:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.069916:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534052736:12345-192.168.204.50@tcp:3:timeout.0 Request processed in 77us (165us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790771167.069923:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 453 00002000:00100000:0.0:1790771167.069929:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8bfb0566f100 x1877759534052736/t0(0) o3->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:268/0 lens 488/4536 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 4096/4096 job:'timeout.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.069935:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0566f100 with x1877759534052736 ext(0->4095) 00002000:00010000:0.0:1790771167.069939:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfb0566f100 00000100:00100000:2.0:1790771167.069940:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534053632 00000100:00100000:2.0:1790771167.069946:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534053632 00000100:00100000:2.0:1790771167.069988:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1070 00000100:00100000:2.0:1790771167.069999:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:14482:x1877759534053632:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:2.0:1790771167.070008:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.070020:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365e9 expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.070040:0:13796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 21 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.070057:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x14:0x0].0x0 since=2s v=(1 0) 00010000:00010000:2.0:1790771167.070061:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1790771167.070066:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e9 expref: 25 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.070087:0:13796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 21 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.070099:0:13796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 21 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.070112:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539781120:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.070157:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.071767:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.071785:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.071808:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534053888 00000100:00100000:1.0:1790771167.071813:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534053888 00000100:00100000:3.0:1790771167.071817:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.071853:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054016 00000100:00100000:1.0:1790771167.071857:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054016 00000100:00100000:3.0:1790771167.071865:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1695 00000100:00100000:3.0:1790771167.071876:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:14512:x1877759534053888:12345-192.168.204.50@tcp:49:rm.0 00000100:00100000:0.0:1790771167.071879:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054272 00000100:00100000:2.0:1790771167.071886:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1696 00000100:00100000:0.0:1790771167.071887:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054272 00000100:00100000:2.0:1790771167.071902:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:14582:x1877759534054016:12345-192.168.204.50@tcp:35:touch.0 00000100:00100000:0.0:1790771167.071930:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6524 00000100:00100000:3.0:1790771167.071936:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:14512:x1877759534053888:12345-192.168.204.50@tcp:49:rm.0 Request processed in 60us (165us total) trans 0 rc -61/-61 00000100:00100000:0.0:1790771167.071944:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+146:14897:x1877759534054272:12345-192.168.204.50@tcp:36:setfattr.0 00000100:00100000:3.0:1790771167.071945:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1695 00000100:00100000:1.0:1790771167.071970:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.071983:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.071995:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 128 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.071999:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054144 00000100:00100000:1.0:1790771167.072004:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054144 00010000:00010000:0.0:1790771167.072012:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.072019:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 146 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.072025:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 6/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.072036:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1071 00010000:00010000:0.0:1790771167.072045:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 146 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.072047:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:2396:x1877759534054144:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:0.0:1790771167.072060:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 146 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.072069:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781248:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.072077:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.072093:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:14582:x1877759534054016:12345-192.168.204.50@tcp:35:touch.0 Request processed in 192us (303us total) trans 4294968881 rc 0/0 00000100:00100000:3.0:1790771167.072098:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054400 00000100:00100000:3.0:1790771167.072103:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054400 00000100:00100000:2.0:1790771167.072104:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1696 00010000:00010000:0.0:1790771167.072127:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 128 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.072136:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1697 00002000:00010000:1.0:1790771167.072139:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4196581 -> 4196581 00010000:00010000:0.0:1790771167.072141:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 128 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.072144:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00002000:00010000:1.0:1790771167.072152:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771166 00000100:00100000:2.0:1790771167.072154:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:13666:x1877759534054400:12345-192.168.204.50@tcp:35:ls.0 00002000:00010000:1.0:1790771167.072159:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:1.0:1790771167.072167:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:0.0:1790771167.072172:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781376:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.072176:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.072192:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759534054144:12345-192.168.204.50@tcp:2:chown.0 Request processed in 149us (222us total) trans 4294967644 rc 0/0 00000100:00100000:1.0:1790771167.072199:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1071 00010000:00010000:0.0:1790771167.072225:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 128 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.072236:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.072247:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 128 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.072256:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781504:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.072270:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13666:x1877759534054400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 122us (194us total) trans 4294968882 rc 0/0 00000100:00100000:0.0:1790771167.072279:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc1045a900 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.072287:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1697 00000100:00100000:0.0:1790771167.072302:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054528 00000100:00100000:0.0:1790771167.072306:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054528 00000100:00100000:0.0:1790771167.072335:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 454 00000100:00100000:2.0:1790771167.072344:0:6480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6480:1877759539778944:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.072345:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759534054528:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771167.072347:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054656 00000100:00100000:1.0:1790771167.072354:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054656 00010000:00010000:2.0:1790771167.072371:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.072388:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 900 00000100:00100000:1.0:1790771167.072398:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:2396:x1877759534054656:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.072406:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.072409:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759534047360:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13043us (13167us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.072419:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f0dc lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3647d expref: 145 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.072424:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1794 00010000:00010000:1.0:1790771167.072440:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.072443:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.072450:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.072454:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.072478:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+144:2396:x1877759534054656:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.072507:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 900 00002000:00010000:0.0:1790771167.072535:0:13789:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb size from disk: 76520 -> 76520 00002000:00010000:0.0:1790771167.072539:0:13789:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771167.072541:0:13789:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790771167.072543:0:13789:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00002000:00010000:0.0:1790771167.072545:0:13789:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xa:0x0] updating lvb blocks from disk: 120 -> 136 00000100:00100000:0.0:1790771167.072579:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759534054528:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 237us (405us total) trans 4294967640 rc 0/0 00000100:00100000:0.0:1790771167.072586:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 454 00000100:00100000:1.0:1790771167.072614:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.072640:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054912 00000100:00100000:3.0:1790771167.072644:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054912 00002000:00100000:3.0:1790771167.072677:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (598016->602111) req@ffff8bfb06193800 x1877759534054912/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771167.072685:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06193800 with x1877759534054912 ext(598016->602111) 00002000:00010000:3.0:1790771167.072688:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06193800 00000100:00100000:3.0:1790771167.072707:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 455 00000100:00100000:3.0:1790771167.072714:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759534054912:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771167.072854:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759534054912:12345-192.168.204.50@tcp:3:cat.0 Request processed in 140us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.072860:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 455 00002000:00100000:3.0:1790771167.072865:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (598016->602111) req@ffff8bfb06193800 x1877759534054912/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771167.072872:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06193800 with x1877759534054912 ext(598016->602111) 00002000:00010000:3.0:1790771167.072874:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06193800 00000100:00100000:1.0:1790771167.073558:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.073583:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.073619:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055040 00000100:00100000:0.0:1790771167.073626:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055040 00000100:00100000:3.0:1790771167.073627:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055296 00000100:00100000:3.0:1790771167.073634:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055296 00000100:00100000:0.0:1790771167.073677:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1698 00000100:00100000:0.0:1790771167.073686:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:13665:x1877759534055040:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.073690:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1699 00000100:00100000:3.0:1790771167.073704:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:14987:x1877759534055296:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:0.0:1790771167.073806:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13665:x1877759534055040:12345-192.168.204.50@tcp:35:ls.0 Request processed in 119us (246us total) trans 4294968883 rc 0/0 00000100:00100000:0.0:1790771167.073815:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1698 00000100:00100000:3.0:1790771167.073836:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14987:x1877759534055296:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 136us (252us total) trans 4294968884 rc 0/0 00000100:00100000:3.0:1790771167.073844:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1699 00000100:00100000:1.0:1790771167.075141:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.075183:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.075210:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.075215:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534054784 00000100:00100000:2.0:1790771167.075222:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534054784 00000100:00100000:3.0:1790771167.075234:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055424 00000100:00100000:1.0:1790771167.075239:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.075240:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055424 00000100:00100000:2.0:1790771167.075257:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055808 00000100:00100000:2.0:1790771167.075261:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055808 00000100:00100000:0.0:1790771167.075271:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055680 00000100:00100000:0.0:1790771167.075277:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055680 00000100:00100000:3.0:1790771167.075281:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6525 00000100:00100000:3.0:1790771167.075291:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:13269:x1877759534054784:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:2.0:1790771167.075297:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6526 00010000:00010000:3.0:1790771167.075303:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.075309:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6527 00000100:00100000:2.0:1790771167.075310:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:14757:x1877759534055424:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771167.075316:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f225 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3652c expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.075318:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 901 00000100:00100000:1.0:1790771167.075330:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+148:15018:x1877759534055808:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771167.075332:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2399:x1877759534055680:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.075339:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.075347:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.075356:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0ed24 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36430 expref: 147 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075364:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f161 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36509 expref: 147 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075364:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.075369:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771167.075372:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790771167.075378:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.075388:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075395:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594400/0xfa0c505d97f0f042 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36525 expref: 149 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075396:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:0.0:1790771167.075406:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.075407:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075409:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075426:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f08535 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x7e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e33ffc expref: 148 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.075431:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075437:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075438:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7e:0x0].0x0 (ffff8bfb0282ad00) 00010000:00010000:2.0:1790771167.075441:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.075445:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+145:2399:x1877759534055680:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 112us (230us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.075459:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4c00/0xfa0c505d97f0cdf1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e358c2 expref: 147 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075460:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.075465:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 901 00010000:00010000:3.0:1790771167.075502:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075510:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc13395700) 00010000:00010000:1.0:1790771167.075518:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.075533:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.075537:0:6493:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d9d30ef4 reply state 00000000254d10ec transno 4294968885 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075544:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.075551:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075554:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.075554:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.075567:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771167.075570:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.075572:0:6493:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.075576:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: --/PW res: [0x200000403:0xc:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075584:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075591:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075595:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075603:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075607:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075612:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075616:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.075619:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.075625:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14757:x1877759534055424:12345-192.168.204.50@tcp:36:cp.0 Request processed in 318us (440us total) trans 4294968885 rc 0/0 00010000:00010000:3.0:1790771167.075628:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.075635:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6526 00010000:00010000:1.0:1790771167.075637:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075664:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075672:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075720:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.075723:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.075726:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 3/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075733:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f22c lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075741:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075746:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075750:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075754:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.075756:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075761:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075765:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfb02b20400) 00010000:00010000:3.0:1790771167.075767:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.075769:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075773:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f23a lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771167.075799:0:13769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].44, 64 off11632 00010000:00010000:3.0:1790771167.075814:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f225 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3652c expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075823:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.075825:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771167.075828:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f225 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3652c expref: 148 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075831:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.075836:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe3200, rc 0) 00010000:00010000:1.0:1790771167.075841:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075849:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075854:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075859:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075862:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075883:0:13769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771167.075892:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075898:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075900:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771167.075907:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075909:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075915:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.075920:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075921:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82e00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:0.0:1790771167.075927:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075932:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.075933:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:13269:x1877759534054784:12345-192.168.204.50@tcp:101:ls.0 Request processed in 640us (790us total) trans 4294969458 rc 301/301 00010000:00010000:0.0:1790771167.075936:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.075953:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6525 00010000:00010000:1.0:1790771167.075958:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7e:0x0].0x0 (ffff8bfb0282a700) 00010000:00010000:1.0:1790771167.075962:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771167.075965:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075971:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7e:0x0].0x0 (ffff8bfb0282a700) 00010000:00010000:1.0:1790771167.075971:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f256 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x7e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075977:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790771167.075983:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 1/0,0 mode: --/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.075989:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f25d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x7e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075991:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.075998:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.076002:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.076003:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.076005:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.076008:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.076014:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076018:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.076020:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076024:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076030:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfb0282a000) 00010000:00010000:1.0:1790771167.076031:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.076033:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 3/0,0 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076037:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f241 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.076045:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002d4597c1 reply state 0000000069a43819 transno 4294969459 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076052:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.076056:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xd870248a (ffff8bfb0282a400) 00010000:00010000:1.0:1790771167.076058:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.076059:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.076092:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:15018:x1877759534055808:12345-192.168.204.50@tcp:36:rm.0 Request processed in 771us (855us total) trans 4294969459 rc 0/0 00000100:00100000:1.0:1790771167.076098:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6527 00000100:00100000:0.0:1790771167.077052:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.077080:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056064 00000100:00100000:2.0:1790771167.077085:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056064 00000100:00100000:2.0:1790771167.077112:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1700 00000100:00100000:2.0:1790771167.077119:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+147:15027:x1877759534056064:12345-192.168.204.50@tcp:37:chown.0 00000100:00100000:1.0:1790771167.077209:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91a680 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780096:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.082288:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.082326:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.082343:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056832 00000100:00100000:1.0:1790771167.082349:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056832 00000100:00100000:2.0:1790771167.082385:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057216 00000100:00100000:2.0:1790771167.082392:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057216 00000100:00100000:1.0:1790771167.082393:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6528 00000100:00100000:1.0:1790771167.082407:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15037:x1877759534056832:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771167.082420:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.082431:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6529 00010000:00010000:1.0:1790771167.082433:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f264 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365aa expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.082443:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+149:15069:x1877759534057216:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.082458:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.082468:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f26b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36587 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.082519:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f272 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.082529:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.082536:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f272 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.082543:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9314 00010000:00010000:2.0:1790771167.082545:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f279 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.082556:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f279 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.082563:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f279 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.082570:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.082606:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f264 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365aa expref: 132 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.082619:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f272 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365aa expref: 131 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.082624:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.082626:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.082629:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4a000, rc 0) 00010000:00010000:2.0:1790771167.082640:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f26b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36587 expref: 152 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.082675:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595600/0xfa0c505d97f0f279 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36587 expref: 151 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.082677:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:15037:x1877759534056832:12345-192.168.204.50@tcp:101:cp.0 Request processed in 272us (389us total) trans 4294969460 rc 0/0 00000100:00100000:1.0:1790771167.082692:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6528 00010000:00010000:2.0:1790771167.082694:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:2.0:1790771167.082697:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.082700:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595600, rc 0) 00000100:00100000:2.0:1790771167.082725:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+151:15069:x1877759534057216:12345-192.168.204.50@tcp:101:rm.0 Request processed in 286us (398us total) trans 4294969461 rc 0/0 00000100:00100000:2.0:1790771167.082730:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6529 00000100:00100000:1.0:1790771167.091458:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91b100 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780224:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.091528:0:13781:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.50@tcp) returned -22 from glimpse AST (req@00000000636e6a8d x1877759539779072) - normal race ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 24 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.091545:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f919500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780352:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.091559:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004151cd0b/0xfa0c505d97f0d840 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35cb2 expref: 24 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.091570:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539779072:192.168.204.50@tcp:106: 00000100:00100000:1.0:1790771167.091585:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f919c00 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539779584:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.091603:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.091607:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f176 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365a3 expref: 28 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.091632:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.091639:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539779328:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.091641:0:13781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f176 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365a3 expref: 28 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.091642:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780480:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.091679:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031600, rc 0) 00000100:00100000:3.0:1790771167.091683:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566d180 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539779456:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.091704:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056448 00000100:00100000:1.0:1790771167.091710:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056448 00010000:00010000:3.0:1790771167.091712:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.091725:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759534049152:12345-192.168.204.50@tcp:101:ln.0 Request processed in 28367us (28453us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771167.091733:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1068 00000100:00100000:1.0:1790771167.091749:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1701 00000100:00100000:1.0:1790771167.091759:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:13293:x1877759534056448:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.091800:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.091838:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056704 00000100:00100000:2.0:1790771167.091842:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056704 00000100:00100000:2.0:1790771167.091873:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6530 00000100:00100000:1.0:1790771167.091878:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:13293:x1877759534056448:12345-192.168.204.50@tcp:35:ls.0 Request processed in 122us (251us total) trans 4294969462 rc 0/0 00000100:00100000:2.0:1790771167.091883:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+151:14958:x1877759534056704:12345-192.168.204.50@tcp:36:truncate.0 00000100:00100000:1.0:1790771167.091894:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1701 00010000:00010000:2.0:1790771167.091909:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.091926:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0ebbf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3638f expref: 151 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.091938:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00000100:00100000:1.0:1790771167.091942:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779712:192.168.204.50@tcp:105: 00010000:00010000:2.0:1790771167.091943:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.091964:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f918380 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779840:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771167.091982:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03d90e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780608:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771167.092000:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06192300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539780736:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771167.092018:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91ad80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539779968:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.092028:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.092048:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092050:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056960 00000100:00100000:0.0:1790771167.092056:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056960 00010000:00010000:2.0:1790771167.092061:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092063:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.092077:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092079:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0ec52 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x44a19400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092090:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1702 00000100:00100000:3.0:1790771167.092097:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.092105:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14007:x1877759534056960:12345-192.168.204.50@tcp:35:ls.0 00000004:00010000:1.0:1790771167.092110:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000051b9dfb7 reply state 000000004fb4d360 transno 4294969451 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.092125:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058112 00010000:00010000:1.0:1790771167.092126:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.092130:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058112 00000001:00080000:2.0:1790771167.092131:0:6494:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969463 00010000:00010000:1.0:1790771167.092145:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc36078200) 00010000:00010000:1.0:1790771167.092148:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.092151:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00000004:00010000:2.0:1790771167.092155:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001289d1b9 reply state 00000000d22b9c17 transno 4294969464 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.092163:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6531 00010000:00010000:2.0:1790771167.092174:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.092176:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:14710:x1877759534058112:12345-192.168.204.50@tcp:101:file_concat.sh.0 00000100:00100000:1.0:1790771167.092191:0:13792:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14680:x1877759534025344:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 97993us (98125us total) trans 4294969451 rc 0/0 00010000:00010000:2.0:1790771167.092191:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:3.0:1790771167.092192:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.092197:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.092201:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.092207:0:13792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 38 00010000:00010000:3.0:1790771167.092207:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0f295 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365db expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092227:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14007:x1877759534056960:12345-192.168.204.50@tcp:35:ls.0 Request processed in 114us (188us total) trans 4294969465 rc 0/0 00000100:00100000:0.0:1790771167.092234:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1702 00000100:00100000:1.0:1790771167.092258:0:13782:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:13782:1877759539780864:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.092259:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:14958:x1877759534056704:12345-192.168.204.50@tcp:36:truncate.0 Request processed in 377us (458us total) trans 4294969464 rc 0/0 00000100:00100000:2.0:1790771167.092272:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6530 00000020:00080000:2.0:1790771167.092276:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790771167.092285:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365cd expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092290:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092297:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373c00, rc 0) 00010000:00010000:3.0:1790771167.092303:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092312:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092328:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092329:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.092335:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:15040:x1877759534051968:12345-192.168.204.50@tcp:101:cp.0 Request processed in 25115us (25566us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.092342:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.092349:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1069 00010000:00010000:3.0:1790771167.092353:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092363:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059264 00000100:00100000:0.0:1790771167.092368:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059264 00010000:00010000:3.0:1790771167.092372:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f2aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092379:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092384:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f2aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092393:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092399:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092405:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6532 00010000:00010000:3.0:1790771167.092409:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.092416:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+152:14538:x1877759534059264:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:3.0:1790771167.092417:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092428:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.092431:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.092433:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.092435:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092441:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.092444:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f2b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365b1 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092450:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771167.092454:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.092457:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.092459:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057600 00010000:00010000:3.0:1790771167.092463:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0f29c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.092465:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057600 00010000:00010000:3.0:1790771167.092477:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092482:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092512:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092518:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.092522:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6533 00010000:00010000:0.0:1790771167.092524:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092524:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.092536:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:14924:x1877759534057600:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771167.092541:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092553:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xea196397 (ffff8bfb02b20400) 00010000:00010000:0.0:1790771167.092554:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092556:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.092560:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092561:0:7771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.092572:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3200/0xfa0c505d97f0f2a3 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.092575:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092579:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02e00/0xfa0c505d97f0e98f lrc: 0/0,0 mode: --/PR res: [0x240000402:0xae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3621c expref: 148 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.092599:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092601:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfc113f3d00) 00010000:00010000:3.0:1790771167.092601:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0f295 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365db expref: 148 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.092614:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092615:0:7771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.092622:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f2aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365db expref: 147 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.092625:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.092643:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:3.0:1790771167.092659:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771167.092662:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04fe2000, rc 0) 00010000:00010000:1.0:1790771167.092664:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092674:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092681:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.092692:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:14710:x1877759534058112:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 517us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.092701:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6531 00000004:00010000:1.0:1790771167.092736:0:7771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ff22066 reply state 0000000082136df3 transno 4294968886 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092744:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092750:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfb0282a000) 00010000:00010000:1.0:1790771167.092752:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.092755:0:7771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771167.092759:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.092801:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:14924:x1877759534057600:12345-192.168.204.50@tcp:36:cp.0 Request processed in 270us (371us total) trans 4294968886 rc 0/0 00000100:00100000:1.0:1790771167.092808:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6533 00000100:00100000:3.0:1790771167.092821:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.092826:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059776 00000100:00100000:1.0:1790771167.092830:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059776 00000100:00100000:3.0:1790771167.092854:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.092863:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6534 00000100:00100000:1.0:1790771167.092870:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:14001:x1877759534059776:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.092878:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.092888:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f2cd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365f0 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771167.092899:0:13764:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x27:0x0], index 0: 0 00010000:00010000:1.0:1790771167.092929:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092942:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.092952:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.092964:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:15027:x1877759534056064:12345-192.168.204.50@tcp:37:chown.0 Request processed in 15843us (15910us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.092973:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.092975:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1700 00000100:00100000:3.0:1790771167.092980:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.092990:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093002:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093011:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093020:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093025:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:13796:1877759539781120:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.093029:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093043:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e9 expref: 24 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093054:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.093055:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.093056:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594e00, rc 0) 00000100:00100000:3.0:1790771167.093066:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.093070:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093076:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093082:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.093086:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:14482:x1877759534053632:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 23087us (23190us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.093087:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093102:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1070 00010000:00010000:1.0:1790771167.093104:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093104:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.093108:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093124:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057984 00010000:00010000:1.0:1790771167.093129:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093129:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057984 00010000:00010000:0.0:1790771167.093133:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:3.0:1790771167.093134:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.093142:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.093145:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093148:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093154:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093162:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f2b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093162:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1072 00000100:00100000:3.0:1790771167.093166:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.093173:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.093178:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+24:15098:x1877759534057984:12345-192.168.204.50@tcp:101:fallocate.0 00010000:00010000:1.0:1790771167.093179:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.093182:0:13764:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000461b7d8d reply state 00000000cace6b62 transno 4294969466 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093190:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057472 00000100:00100000:3.0:1790771167.093197:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057472 00010000:00010000:2.0:1790771167.093198:0:13796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.093203:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093206:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093210:0:13796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365fe expref: -99 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.093219:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 53 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093227:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc19631f00) 00010000:00010000:1.0:1790771167.093229:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.093235:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.093239:0:13764:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.093239:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.093245:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093250:0:13796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 25 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093253:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f2d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093262:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057856 00010000:00010000:0.0:1790771167.093264:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596600/0xfa0c505d97f0f2b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b1 expref: 154 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093268:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057856 00010000:00010000:1.0:1790771167.093275:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093280:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x1c:0x0].0x0 since=1s v=(6 1) 00010000:00010000:3.0:1790771167.093290:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 26 pid: 13796 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093292:0:13796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(7 1) 00010000:00010000:1.0:1790771167.093293:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093296:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b1 expref: 153 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093310:0:13796:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [4096->28671] (req 4096->28671) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365fe expref: 25 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093316:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093328:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055552 00000100:00100000:3.0:1790771167.093333:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055552 00010000:00010000:1.0:1790771167.093337:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.093344:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093346:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb0:0x0].0x0 (ffff8bfc19631400) 00010000:00010000:0.0:1790771167.093353:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771167.093353:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057088 00010000:00010000:0.0:1790771167.093357:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487fa00, rc 0) 00000100:00100000:3.0:1790771167.093359:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057088 00010000:00010000:2.0:1790771167.093364:0:13796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 26 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093365:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.093375:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 149 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093389:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+154:14538:x1877759534059264:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 972us (1061us total) trans 4294969466 rc 0/0 00010000:00010000:2.0:1790771167.093394:0:13796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 26 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093396:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfb0282ad00) 00000100:00100000:3.0:1790771167.093400:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057728 00000100:00100000:0.0:1790771167.093402:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6532 00000100:00100000:3.0:1790771167.093405:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057728 00010000:00010000:1.0:1790771167.093406:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.093414:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093421:0:13796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539781632:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.093422:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 154 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093427:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f2db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093440:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1798 00000100:00100000:0.0:1790771167.093456:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:2396:x1877759534057472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.093461:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1799 00010000:00010000:0.0:1790771167.093466:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.093474:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759534057856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.093475:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 53 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093477:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f2cd lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365f0 expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093512:0:13796:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cb40 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.093513:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.093529:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 26 pid: 13796 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093530:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.093536:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 53 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.093537:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.093546:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f2cd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365f0 expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093550:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1800 00010000:00010000:3.0:1790771167.093553:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 26 pid: 13796 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093567:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+149:2396:x1877759534057088:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.093574:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4ac00, rc 0) 00010000:00010000:0.0:1790771167.093579:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597600/0xfa0c505d97f0e257 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e360cc expref: 53 pid: 12128 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093584:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.093589:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006abb9439/0xfa0c505d97f0f0c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3653a expref: 26 pid: 13796 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093594:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.093596:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 149 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.093599:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:14001:x1877759534059776:12345-192.168.204.50@tcp:101:ls.0 Request processed in 727us (840us total) trans 4294969467 rc 301/301 00010000:00010000:0.0:1790771167.093603:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.093608:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790771167.093618:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1790771167.093619:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6534 00010000:00010000:0.0:1790771167.093627:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.093634:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365cd expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.093646:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534055936 00010000:00010000:0.0:1790771167.093661:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.093666:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 149 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.093667:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534055936 00010000:00010000:3.0:1790771167.093667:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365cd expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093684:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:2396:x1877759534057472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 231us (829us total) trans 0 rc 0/0 00002000:00100000:1.0:1790771167.093695:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x3:0x0] (0->4194303) req@ffff8bfb057b1500 x1877759534055936/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771167.093696:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0e3b5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e361d6 expref: 149 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093701:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1798 00010000:00010000:3.0:1790771167.093718:0:7434:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000089af20d4/0xfa0c505d97f0f1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365cd expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093724:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1801 00010000:00010000:2.0:1790771167.093724:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.093734:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: --/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093739:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+154:2396:x1877759534057728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.093753:0:7434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539781760:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.093756:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1790771167.093757:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b1500 with x1877759534055936 ext(0->4194303) 00010000:00010000:2.0:1790771167.093760:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.093766:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb057b1500 00010000:00010000:0.0:1790771167.093767:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 154 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.093775:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093782:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 154 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.093797:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 456 00010000:00010000:2.0:1790771167.093799:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.093801:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04ee0c00/0xfa0c505d97f0e00b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x59:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35f75 expref: 154 pid: 6495 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093801:0:7434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d394900 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.093811:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2396:x1877759534055936:12345-192.168.204.50@tcp:4:dd.0 00010000:00010000:0.0:1790771167.093821:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00000100:00100000:2.0:1790771167.093823:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:2396:x1877759534057088:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 258us (691us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.093826:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.093834:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1800 00010000:00010000:0.0:1790771167.093836:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093842:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 902 00010000:00010000:0.0:1790771167.093845:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.093854:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:2396:x1877759534055552:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.093863:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093865:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.093866:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.093874:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.093887:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0f130 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x34:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a7 expref: 147 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.093888:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:2396:x1877759534057728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 149us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.093907:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1801 00010000:00010000:3.0:1790771167.093911:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x34:0x0].0x0 (ffff8bfc3da48b00) 00010000:00010000:3.0:1790771167.093915:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.093934:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+146:2396:x1877759534055552:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 84us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.093941:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 902 00010000:00010000:0.0:1790771167.093955:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093962:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093979:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x59:0x0].0xd870248a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093985:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.093991:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.094004:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.094028:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.094066:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.094095:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.094108:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058496 00000100:00100000:3.0:1790771167.094111:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058496 00000100:00100000:3.0:1790771167.094136:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058880 00000100:00100000:3.0:1790771167.094138:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058880 00000100:00100000:3.0:1790771167.094161:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6535 00000100:00100000:3.0:1790771167.094168:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+147:13666:x1877759534058496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.094177:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:0.0:1790771167.094187:0:13765:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x28:0x0], index 1: 0 00010000:00010000:3.0:1790771167.094187:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f305 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36605 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094247:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094257:0:13773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 2/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094265:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 4/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094296:0:13773:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094300:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0f313 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094305:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094316:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0f313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094328:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0f313 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.094336:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6536 00000100:00100000:3.0:1790771167.094344:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+148:14640:x1877759534058880:12345-192.168.204.50@tcp:36:dd.0 00000100:00100000:2.0:1790771167.094352:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058368 00010000:00010000:0.0:1790771167.094358:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.094358:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058368 00010000:00010000:3.0:1790771167.094366:0:13769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.094369:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094378:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 153 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094380:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0f0ff lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364a0 expref: 148 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094381:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094408:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771167.094409:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.094413:0:13769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.094417:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.094419:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1802 00010000:00010000:0.0:1790771167.094429:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.094431:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:2396:x1877759534058368:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.094443:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:2.0:1790771167.094444:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.094449:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.094452:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 153 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094453:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094471:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f192 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094474:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 153 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094509:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000100:00100000:3.0:1790771167.094510:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.094517:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.094518:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fd514259 reply state 000000007b0dfb21 transno 4294969468 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094530:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094536:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.094539:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.094544:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.094553:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0xd870248a (ffff8bfc19631b00) 00010000:00010000:0.0:1790771167.094557:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.094560:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.094566:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:2396:x1877759534058368:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 136us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.094571:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.094581:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1802 00010000:00010000:0.0:1790771167.094589:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f18b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36595 expref: 135 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.094604:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059008 00010000:00010000:0.0:1790771167.094606:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0f313 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36595 expref: 134 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.094607:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.094612:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059008 00010000:00010000:0.0:1790771167.094622:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb8:0x0].0x0 (ffff8bfc19631900) 00010000:00010000:0.0:1790771167.094624:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.094627:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e400, rc 0) 00010000:00010000:2.0:1790771167.094636:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 136 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.094638:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.094669:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14803:x1877759534051200:12345-192.168.204.50@tcp:101:cp.0 Request processed in 29741us (29804us total) trans 4294969468 rc 0/0 00000100:00100000:0.0:1790771167.094676:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6514 00000100:00100000:3.0:1790771167.094689:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.094710:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058240 00000100:00100000:0.0:1790771167.094715:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058240 00000100:00100000:3.0:1790771167.094735:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:0.0:1790771167.094737:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (0->4) req@ffff8bfc3f9d8380 x1877759534058240/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 496/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dir_create.sh.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.094745:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f9d8380 with x1877759534058240 ext(0->4) 00010000:00010000:0.0:1790771167.094751:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 23 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.094763:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 23 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.094774:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3f9d8380 00000100:00100000:2.0:1790771167.094786:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534058752 00000100:00100000:2.0:1790771167.094792:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534058752 00000100:00100000:0.0:1790771167.094794:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060288 00000100:00100000:0.0:1790771167.094799:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060288 00010000:00010000:3.0:1790771167.094803:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f321 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094811:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 136 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094812:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f321 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771167.094820:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (602112->606207) req@ffff8bfb05c30700 x1877759534060288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771167.094834:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f321 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771167.094836:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c30700 with x1877759534060288 ext(602112->606207) 00002000:00010000:0.0:1790771167.094842:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c30700 00000100:00100000:2.0:1790771167.094849:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1803 00000100:00100000:2.0:1790771167.094859:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2396:x1877759534059008:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.094866:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 100 00010000:00010000:2.0:1790771167.094867:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.094873:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 136 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771167.094876:0:13769:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294968888 00000100:00100000:0.0:1790771167.094878:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2396:x1877759534058240:12345-192.168.204.50@tcp:4:dir_create.sh.0 00010000:00010000:2.0:1790771167.094893:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 136 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094905:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00000004:00010000:3.0:1790771167.094905:0:13769:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ce93a60 reply state 00000000a21fc6c6 transno 4294968889 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f321 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094911:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094926:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.094926:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84800/0xfa0c505d97f0f321 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.094945:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.094946:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:3.0:1790771167.094949:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.094951:0:13769:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.094961:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:2396:x1877759534059008:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 104us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.094966:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1803 00000100:00100000:2.0:1790771167.094980:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1804 00000100:00100000:2.0:1790771167.094988:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759534058752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.094993:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+150:14640:x1877759534058880:12345-192.168.204.50@tcp:36:dd.0 Request processed in 647us (894us total) trans 4294968889 rc 0/0 00010000:00010000:2.0:1790771167.094999:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.095000:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6536 00010000:00010000:2.0:1790771167.095005:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 135 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.095006:0:13769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771167.095019:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 135 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.095028:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:2.0:1790771167.095032:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.095039:0:9499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.095044:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.095052:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.095060:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.095081:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759534058752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 93us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.095088:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.095093:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1804 00000100:00100000:3.0:1790771167.095106:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059520 00000100:00100000:3.0:1790771167.095110:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059520 00000100:00100000:2.0:1790771167.095119:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060160 00000100:00100000:2.0:1790771167.095124:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060160 00000100:00100000:3.0:1790771167.095135:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060032 00000100:00100000:3.0:1790771167.095139:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060032 00000100:00100000:2.0:1790771167.095148:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1073 00000100:00100000:2.0:1790771167.095156:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759534060160:12345-192.168.204.50@tcp:2:chmod.0 00000100:00100000:3.0:1790771167.095161:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060416 00000100:00100000:3.0:1790771167.095164:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060416 00000100:00100000:3.0:1790771167.095177:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1703 00000100:00100000:3.0:1790771167.095185:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+151:12242:x1877759534059520:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.095206:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060544 00000100:00100000:0.0:1790771167.095212:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060544 00002000:00010000:2.0:1790771167.095232:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4196581 -> 4196581 00002000:00010000:2.0:1790771167.095236:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.095238:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771167.095241:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.095244:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:0.0:1790771167.095246:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1704 00000100:00100000:0.0:1790771167.095259:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:14494:x1877759534060032:12345-192.168.204.50@tcp:35:mkdir.0 00000100:00100000:2.0:1790771167.095265:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2397:x1877759534060160:12345-192.168.204.50@tcp:2:chmod.0 Request processed in 107us (578us total) trans 4294967645 rc 0/0 00000100:00100000:2.0:1790771167.095272:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1073 00000100:00100000:3.0:1790771167.095290:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:12242:x1877759534059520:12345-192.168.204.50@tcp:35:ls.0 Request processed in 102us (718us total) trans 4294968890 rc 0/0 00000100:00100000:2.0:1790771167.095297:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1705 00000100:00100000:3.0:1790771167.095305:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1703 00000100:00100000:2.0:1790771167.095309:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11371c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:13677:x1877759534060416:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.095329:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1706 00000100:00100000:3.0:1790771167.095339:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+152:13741:x1877759534060544:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.095393:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14494:x1877759534060032:12345-192.168.204.50@tcp:35:mkdir.0 Request processed in 136us (754us total) trans 4294969469 rc 0/0 00000100:00100000:0.0:1790771167.095399:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1704 00000100:00100000:2.0:1790771167.095405:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11371c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+154:13677:x1877759534060416:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (353us total) trans 4294968891 rc 0/0 00000100:00100000:2.0:1790771167.095412:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1705 00000100:00100000:0.0:1790771167.095433:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 457 00000100:00100000:3.0:1790771167.095434:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+153:13741:x1877759534060544:12345-192.168.204.50@tcp:35:ls.0 Request processed in 92us (344us total) trans 4294968892 rc 0/0 00000100:00100000:3.0:1790771167.095443:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1706 00000100:00100000:0.0:1790771167.095447:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759534060288:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771167.095508:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.095529:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060672 00000100:00100000:3.0:1790771167.095532:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060672 00000100:00100000:3.0:1790771167.095560:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6537 00000100:00100000:0.0:1790771167.095566:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759534060288:12345-192.168.204.50@tcp:3:cat.0 Request processed in 118us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.095572:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:14868:x1877759534060672:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:0.0:1790771167.095582:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 457 00002000:00100000:0.0:1790771167.095590:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (602112->606207) req@ffff8bfb05c30700 x1877759534060288/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.095597:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb05c30700 with x1877759534060288 ext(602112->606207) 00002000:00010000:0.0:1790771167.095601:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb05c30700 00000100:00100000:3.0:1790771167.095622:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+153:14868:x1877759534060672:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 52us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.095629:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6537 00000100:00100000:2.0:1790771167.095643:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.095677:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+25:2396:x1877759534058240:12345-192.168.204.50@tcp:4:dir_create.sh.0 Request processed in 803us (1647us total) trans 4294967641 rc 0/0 00000100:00100000:2.0:1790771167.095678:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534060800 00000100:00100000:2.0:1790771167.095684:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534060800 00000100:00100000:0.0:1790771167.095688:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 100 00002000:00100000:0.0:1790771167.095693:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x14:0x0] (0->4) req@ffff8bfc3f9d8380 x1877759534058240/t4294967641(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 496/448 e 0 to 0 dl 1790771178 ref 1 fl Complete:H/600/0 rc 0/0 job:'dir_create.sh.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.095704:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3f9d8380 with x1877759534058240 ext(0->4) 00010000:00010000:0.0:1790771167.095709:0:13779:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 25 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.095718:0:13779:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 25 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.095725:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8bfc3f9d8380 00000100:00100000:3.0:1790771167.095733:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6538 00000100:00100000:3.0:1790771167.095745:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:13968:x1877759534060800:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771167.095753:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.095763:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f328 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36613 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.095780:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4200/0xfa0c505d97f0ed9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363c7 expref: 152 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095792:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.095795:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba3100 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781248:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.095796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.095809:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095819:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.095820:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104200/0xfa0c505d97f0eb02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36223 expref: 137 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.095844:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781376:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.095852:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.095859:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0ead8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3622a expref: 136 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095866:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.095869:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.095884:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.095885:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539781504:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.095890:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061184 00000100:00100000:2.0:1790771167.095898:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061184 00010000:00010000:0.0:1790771167.095925:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095932:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.095939:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095942:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.095951:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6539 00010000:00010000:0.0:1790771167.095960:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.095962:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.095991:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+152:14831:x1877759534061184:12345-192.168.204.50@tcp:36:ln.0 00000004:00200000:3.0:1790771167.095993:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x10:0x0]: returning size 5844 00000004:00200000:3.0:1790771167.095999:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790771167.096010:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096016:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.096017:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096024:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096029:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096040:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096045:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aaa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.096048:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096049:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0eeeb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363d5 expref: 153 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790771167.096058:0:13774:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969470 00010000:00010000:3.0:1790771167.096061:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096074:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:3.0:1790771167.096076:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771167.096079:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.096081:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.096085:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.096087:0:13774:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007492a146 reply state 000000006d5c363f transno 4294969471 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096091:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f32f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096107:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096113:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096113:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096116:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096135:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096139:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00010000:00010000:0.0:1790771167.096148:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771167.096154:0:13774:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.096154:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096154:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096173:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aa200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.096176:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096184:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096185:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.096192:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+154:14897:x1877759534054272:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 24248us (24372us total) trans 4294969471 rc 0/0 00010000:00010000:2.0:1790771167.096206:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096207:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfb02b20100) 00000100:00100000:0.0:1790771167.096214:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6524 00010000:00010000:3.0:1790771167.096215:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.096219:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1790771167.096223:0:13774:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790771167.096224:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096226:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f336 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.096257:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061056 00000100:00100000:0.0:1790771167.096261:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061056 00010000:00010000:3.0:1790771167.096269:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f328 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36613 expref: 136 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096286:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36613 expref: 135 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096295:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00000100:00100000:0.0:1790771167.096296:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1707 00010000:00010000:3.0:1790771167.096300:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771167.096304:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b000, rc 0) 00000100:00100000:0.0:1790771167.096310:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+154:13269:x1877759534061056:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.096325:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13968:x1877759534060800:12345-192.168.204.50@tcp:101:rm.0 Request processed in 582us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.096331:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6538 00000001:00080000:2.0:1790771167.096355:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968887 is committed 00000001:00080000:2.0:1790771167.096376:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968886 is committed 00000100:00100000:3.0:1790771167.096382:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.096397:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+155:13269:x1877759534061056:12345-192.168.204.50@tcp:35:ls.0 Request processed in 90us (621us total) trans 4294969472 rc 0/0 00000100:00100000:0.0:1790771167.096404:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1707 00000100:00100000:3.0:1790771167.096407:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534056576 00000100:00100000:3.0:1790771167.096411:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534056576 00000001:00080000:2.0:1790771167.096420:0:7423:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 4294968872 is committed 00010000:00010000:0.0:1790771167.096435:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096443:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.096447:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1074 00010000:00010000:0.0:1790771167.096455:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.096462:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534056576:12345-192.168.204.50@tcp:2:chown.0 00010000:00010000:0.0:1790771167.096463:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.096469:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096476:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096510:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0xd6e9df9d (ffff8bfc34224d00) 00010000:00010000:0.0:1790771167.096513:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.096516:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096522:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0e846 lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x2:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096529:0:13785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059648 00000100:00100000:1.0:1790771167.096534:0:13785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059648 00010000:00010000:0.0:1790771167.096557:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.096557:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb size from disk: 14368 -> 14368 00002000:00010000:3.0:1790771167.096562:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb mtime from disk: 1790771166 -> 1790771166 00002000:00010000:3.0:1790771167.096569:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:1.0:1790771167.096571:0:13785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 39 00002000:00010000:3.0:1790771167.096575:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:0.0:1790771167.096580:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.096580:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771167.096587:0:13785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+155:14678:x1877759534059648:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:0.0:1790771167.096593:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.096595:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000c96da67 reply state 000000001822cba8 transno 4294968887 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096604:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1600 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.096604:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534056576:12345-192.168.204.50@tcp:2:chown.0 Request processed in 144us (220us total) trans 4294967642 rc 0/0 00010000:00010000:1.0:1790771167.096610:0:13785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.096611:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096623:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.096623:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1074 00010000:00010000:1.0:1790771167.096629:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0eb41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36373 expref: 155 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096630:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096664:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.096669:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x37:0x0].0x84832a57 (ffff8bfc113f3000) 00010000:00010000:2.0:1790771167.096669:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.096673:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:2.0:1790771167.096674:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096675:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.096681:0:13785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.096682:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.096685:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.096693:0:13772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096695:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0e93b lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x37:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096705:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 4/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.096716:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096725:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.096725:0:13785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.096734:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790771167.096737:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:2.0:1790771167.096742:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.096747:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.096749:0:13785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096759:0:13773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096763:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096778:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06192300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539781888:0@lo:101:mdt_io00_003.0 00010000:00080000:2.0:1790771167.096779:0:13772:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:3.0:1790771167.096779:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096780:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06a03000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.096787:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096792:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096800:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xa6:0x0].0xd870248a (ffff8bfc113f3b00) 00000100:00100000:2.0:1790771167.096802:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+42:14842:x1877759534050816:12345-192.168.204.50@tcp:36:chmod.0 Request processed in 33263us (33618us total) trans 4294968887 rc 0/0 00000004:00200000:3.0:1790771167.096802:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.096803:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1790771167.096808:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.096810:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096820:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1790771167.096820:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.096824:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6513 00010000:00010000:0.0:1790771167.096830:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a03000/0xfa0c505d97f0e988 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xa6:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096847:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4480 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.096855:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096856:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f305 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.096861:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539781888 00000100:00100000:2.0:1790771167.096868:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539781888 00000100:00100000:1.0:1790771167.096870:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061312 00010000:00010000:0.0:1790771167.096873:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096877:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061312 00010000:00010000:0.0:1790771167.096887:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096894:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 98 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096897:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.096903:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00010000:00010000:0.0:1790771167.096905:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.096912:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:2.0:1790771167.096918:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:13785:x1877759539781888:12345-0@lo:101:mdt_io00_003.0 00010000:00010000:3.0:1790771167.096919:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771167.096920:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.096921:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1708 00010000:00010000:3.0:1790771167.096924:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84400, rc 0) 00010000:00010000:2.0:1790771167.096933:0:13776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.096941:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:1.0:1790771167.096941:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+155:15018:x1877759534061312:12345-192.168.204.50@tcp:49:rm.0 00010000:00010000:2.0:1790771167.096945:0:13776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f359 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f352 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096947:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.096950:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13666:x1877759534058496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 2779us (2879us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.096954:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.096968:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6535 00010000:00010000:0.0:1790771167.096974:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0e9d5 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096979:0:13776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f359 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f352 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.096990:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.096992:0:13776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f359 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f352 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097003:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097007:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+155:15018:x1877759534061312:12345-192.168.204.50@tcp:49:rm.0 Request processed in 67us (274us total) trans 0 rc -61/-61 00010000:00010000:2.0:1790771167.097014:0:13776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:3.0:1790771167.097020:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.097023:0:13776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.097028:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097028:0:13776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06390800, rc 0) 00000100:00100000:1.0:1790771167.097032:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1708 00010000:00010000:0.0:1790771167.097040:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.097044:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097049:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097058:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xad:0x0].0x0 (ffff8bfb0321a400) 00010000:00010000:0.0:1790771167.097060:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.097062:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534059136 00010000:00010000:0.0:1790771167.097063:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097068:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534059136 00010000:00010000:0.0:1790771167.097071:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0eb33 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xad:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097079:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:13785:x1877759539781888:12345-0@lo:101:mdt_io00_003.0 Request processed in 163us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.097080:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.097086:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097092:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00010000:00010000:0.0:1790771167.097097:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097098:0:8408:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061440 00000100:00100000:1.0:1790771167.097105:0:8408:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061440 00000100:00100000:3.0:1790771167.097106:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534051456 00010000:00010000:0.0:1790771167.097107:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097112:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534051456 00010000:00010000:0.0:1790771167.097114:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.097118:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097127:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097131:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-OST0001_UUID:13791:1877759539780992:192.168.204.50@tcp:105: 00010000:00010000:0.0:1790771167.097136:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x1b:0x0].0x0 (ffff8bfc13348e00) 00010000:00010000:0.0:1790771167.097140:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.097144:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097144:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1075 00010000:00010000:2.0:1790771167.097146:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.097154:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0ebaa lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097160:0:8408:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759534059136:12345-192.168.204.50@tcp:101:ln.0 00000100:00100000:2.0:1790771167.097167:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759534052352:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 28118us (28243us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.097170:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.097172:0:8408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.097180:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097181:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1797 00010000:00010000:1.0:1790771167.097184:0:8408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e75f0b5/0xfa0c505d97f0f360 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3660c expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097199:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6540 00010000:00010000:0.0:1790771167.097202:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097210:0:13785:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294968872 gen 2 00010000:00010000:0.0:1790771167.097211:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb048b8000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.097214:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+155:15120:x1877759534051456:12345-192.168.204.50@tcp:101:chmod.0 00000004:00080000:2.0:1790771167.097217:0:13785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968853 committed transno 4294968872 00010000:00010000:0.0:1790771167.097219:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097224:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.097227:0:8408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539782016:192.168.204.50@tcp:106: 00000004:00080000:2.0:1790771167.097231:0:13785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968861 committed transno 4294968872 00010000:00010000:0.0:1790771167.097233:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771167.097237:0:13785:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc1045af00 refcount 2 committed 0 result 0 batchid 53 00010000:00010000:3.0:1790771167.097237:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0f367 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365bf expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771167.097245:0:13785:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c300 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc1045acc0 00010000:00010000:0.0:1790771167.097250:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x84832a57 (ffff8bfc36078600) 00000020:00080000:2.0:1790771167.097253:0:13785:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].41 00010000:00010000:0.0:1790771167.097256:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:2.0:1790771167.097259:0:13785:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4cd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb06b57400 00010000:00010000:0.0:1790771167.097262:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771167.097263:0:13785:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].41 00000100:00100000:1.0:1790771167.097268:0:8408:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb43c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.097276:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb048b8000/0xfa0c505d97f0efaf lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x35:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771167.097284:0:13785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294968872 committed transno 4294968872 00010000:00010000:3.0:1790771167.097291:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0f367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365bf expref: 156 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097297:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097298:0:13787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1076 00000100:00100000:2.0:1790771167.097305:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06192300 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539781888:0@lo:101:mdt_io00_003.0 00010000:00010000:0.0:1790771167.097310:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097311:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0f367 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365bf expref: 156 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.097314:0:13787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534061440:12345-192.168.204.50@tcp:2:cp.0 00010000:00010000:2.0:1790771167.097327:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097331:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097341:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:0.0:1790771167.097348:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.097349:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771167.097354:0:13785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097356:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097356:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b800, rc 0) 00010000:00010000:0.0:1790771167.097376:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097379:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+156:15120:x1877759534051456:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 169us (302us total) trans 0 rc 0/0 00000004:00080000:2.0:1790771167.097383:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00002000:00010000:1.0:1790771167.097386:0:13787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1790771167.097388:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771167.097396:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:1.0:1790771167.097396:0:13787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb mtime from disk: 1790771167 -> 1674053537 00000100:00100000:3.0:1790771167.097396:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6540 00010000:00010000:0.0:1790771167.097401:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.097405:0:13787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb atime from disk: 0 -> 1752421453 00010000:00010000:2.0:1790771167.097405:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097408:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f233 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.097414:0:13787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00000020:00080000:3.0:1790771167.097417:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 53 committed batchid 52 00002000:00010000:1.0:1790771167.097425:0:13787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x7:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1790771167.097428:0:13785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097432:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097435:0:13785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097441:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.097446:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 52 00000100:00100000:1.0:1790771167.097452:0:13787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2399:x1877759534061440:12345-192.168.204.50@tcp:2:cp.0 Request processed in 139us (435us total) trans 4294967646 rc 0/0 00010000:00010000:0.0:1790771167.097453:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097454:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782144:0@lo:101:mdt_io00_003.0 00010000:00010000:0.0:1790771167.097468:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.097470:0:13787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1076 00010000:00010000:0.0:1790771167.097473:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097480:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.097501:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097511:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfb0282a000) 00010000:00010000:0.0:1790771167.097513:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.097515:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097520:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771167.097529:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f2c6 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097538:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.097543:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.097564:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061568 00000100:00100000:2.0:1790771167.097567:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539782144 00000100:00100000:3.0:1790771167.097568:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061568 00000100:00100000:2.0:1790771167.097572:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539782144 00010000:00010000:0.0:1790771167.097581:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097589:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 2/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097594:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097599:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 903 00010000:00010000:0.0:1790771167.097600:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.097605:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 3/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097613:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:2396:x1877759534061568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.097618:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00010000:00010000:0.0:1790771167.097627:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 4/0,0 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097628:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.097636:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:13785:x1877759539782144:12345-0@lo:101:mdt_io00_003.0 00010000:00010000:0.0:1790771167.097642:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.097644:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f272 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365aa expref: 135 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097645:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771167.097662:0:7449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.097667:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 2/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097675:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f184 lrc: 0/0,0 mode: --/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097677:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771167.097678:0:7449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f375 lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f36e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097685:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.097696:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534057344 00010000:00010000:2.0:1790771167.097700:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f375 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f36e expref: 9 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.097701:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534057344 00000100:00100000:3.0:1790771167.097709:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:2396:x1877759534061568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 98us (172us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.097716:0:7449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f375 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f36e expref: 9 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097725:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 903 00010000:00010000:2.0:1790771167.097726:0:7449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc0ab7ff00) 00000100:00100000:0.0:1790771167.097731:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6541 00010000:00010000:2.0:1790771167.097732:0:7449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.097737:0:7449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391e00, rc 0) 00000100:00100000:0.0:1790771167.097743:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14512:x1877759534057344:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:0.0:1790771167.097752:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.097764:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0f37c lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e365f7 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097774:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782144:12345-0@lo:101:mdt_io00_003.0 Request processed in 143us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.097780:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00010000:00010000:0.0:1790771167.097795:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.097797:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.097807:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097815:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097823:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061824 00010000:00010000:0.0:1790771167.097828:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097828:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061824 00000100:00100000:3.0:1790771167.097832:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.097842:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097848:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097859:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534061952 00000100:00100000:2.0:1790771167.097862:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534061952 00000100:00100000:3.0:1790771167.097875:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6542 00000100:00100000:3.0:1790771167.097888:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:15037:x1877759534061824:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:0.0:1790771167.097892:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097902:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6543 00010000:00010000:0.0:1790771167.097903:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.097912:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:13293:x1877759534061952:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.097914:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.097915:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097923:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.097930:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0eae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e361f2 expref: 134 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097934:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f398 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3661a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.097942:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00000004:00200000:0.0:1790771167.097943:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x47:0x0]: returning size 0 00000004:00200000:0.0:1790771167.097949:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.097950:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1790771167.097963:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x47:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097969:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f39f lrc: 3/1,0 mode: --/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097972:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.097984:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f39f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.097985:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098002:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098003:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f39f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098016:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.098019:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.098033:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x3b:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.098039:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.098043:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.098043:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.098049:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f39f lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098063:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.098067:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098068:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098078:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f398 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3661a expref: 97 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098088:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098099:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfc3da48d00) 00010000:00010000:0.0:1790771167.098101:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000001:00080000:3.0:1790771167.098102:0:13771:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294969473 00010000:00010000:2.0:1790771167.098103:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391c00/0xfa0c505d97f0f39f lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x3b:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3661a expref: 96 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098105:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.098118:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000004430748 reply state 00000000f2cee5c9 transno 4294969474 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098124:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0f383 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098125:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008da00) 00010000:00010000:2.0:1790771167.098133:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790771167.098136:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098138:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391c00, rc 0) 00010000:00010000:0.0:1790771167.098144:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.098148:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771167.098152:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.098152:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.098156:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.098161:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:13293:x1877759534061952:12345-192.168.204.50@tcp:101:ls.0 Request processed in 250us (329us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.098164:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098175:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fc00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.098176:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6543 00010000:00010000:0.0:1790771167.098179:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098189:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.098197:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:15037:x1877759534061824:12345-192.168.204.50@tcp:36:cp.0 Request processed in 312us (400us total) trans 4294969474 rc 0/0 00010000:00010000:0.0:1790771167.098205:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x391d5834 (ffff8bfc113f3c00) 00000100:00100000:3.0:1790771167.098205:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6542 00000100:00100000:2.0:1790771167.098208:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782144:0@lo:101:mdt_io00_003.0 00000020:00080000:3.0:1790771167.098211:0:13771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790771167.098213:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.098220:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098225:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.098231:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0f38a lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098235:0:13785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790771167.098254:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00000100:00100000:3.0:1790771167.098261:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.098267:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0f37c lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365f7 expref: 96 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.098282:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782272:0@lo:1000:mdt_io00_003.0 00000100:00100000:3.0:1790771167.098287:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534062208 00010000:00010000:0.0:1790771167.098290:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365f7 expref: 95 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.098293:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534062208 00010000:00010000:0.0:1790771167.098299:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x47:0x0].0x0 (ffff8bfb0321ef00) 00010000:00010000:0.0:1790771167.098302:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.098304:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ec00, rc 0) 00000100:00100000:2.0:1790771167.098322:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.098327:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:14512:x1877759534057344:12345-192.168.204.50@tcp:101:rm.0 Request processed in 585us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.098332:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 458 00000100:00100000:0.0:1790771167.098342:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6541 00000100:00100000:3.0:1790771167.098347:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2398:x1877759534062208:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:2.0:1790771167.098351:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ca80 going to sleep for 11 seconds 00002000:00010000:3.0:1790771167.098423:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 38336 -> 38336 00002000:00010000:3.0:1790771167.098427:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00002000:00010000:3.0:1790771167.098430:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:3.0:1790771167.098433:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00000100:00100000:0.0:1790771167.098437:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:3.0:1790771167.098439:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 80 -> 80 00000100:00100000:3.0:1790771167.098460:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2398:x1877759534062208:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 117us (200us total) trans 4294967647 rc 0/0 00000100:00100000:2.0:1790771167.098462:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534062464 00000100:00100000:2.0:1790771167.098468:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534062464 00000100:00100000:3.0:1790771167.098471:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 458 00000100:00100000:3.0:1790771167.098525:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539782272 00000100:00100000:3.0:1790771167.098529:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539782272 00000100:00100000:2.0:1790771167.098545:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6544 00000100:00100000:2.0:1790771167.098554:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14700:x1877759534062464:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771167.098562:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:3.0:1790771167.098570:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782272:12345-0@lo:1000:mdt_io00_003.0 00000100:00100000:0.0:1790771167.098580:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.098695:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782272:12345-0@lo:1000:mdt_io00_003.0 Request processed in 124us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.098699:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14700:x1877759534062464:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 145us (264us total) trans 0 rc -17/-17 00000100:00100000:2.0:1790771167.098712:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6544 00000100:00100000:3.0:1790771167.098712:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1790771167.098736:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534062592 00000100:00100000:2.0:1790771167.098740:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534062592 00000100:00100000:3.0:1790771167.098764:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782272:0@lo:1000:mdt_io00_003.0 00000100:00100000:2.0:1790771167.098777:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6545 00000100:00100000:2.0:1790771167.098788:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+156:14616:x1877759534062592:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:2.0:1790771167.098806:0:13767:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.098809:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa45500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782400:0@lo:1000:mdt_io00_003.0 00010000:00010000:2.0:1790771167.098821:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0eb79 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36388 expref: 156 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098835:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:2.0:1790771167.098838:0:13767:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.098845:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.098850:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098860:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 135 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098867:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 155 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.098872:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a70c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.098875:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 5/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.098890:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539782400 00000100:00100000:3.0:1790771167.098895:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539782400 00010000:00010000:2.0:1790771167.098901:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 155 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098914:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 155 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.098926:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:2.0:1790771167.098930:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539782528:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.098938:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782400:12345-0@lo:1000:mdt_io00_003.0 00010000:00010000:2.0:1790771167.098986:0:13767:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 135 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.098996:0:13767:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 135 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.099008:0:13767:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539782656:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.099022:0:13767:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.099087:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782400:12345-0@lo:1000:mdt_io00_003.0 Request processed in 152us (242us total) trans 0 rc 1/1 00000004:00200000:2.0:1790771167.099117:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb1:0x0]: returning size 5 00010000:00010000:2.0:1790771167.099124:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099131:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099136:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099141:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.099146:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00010000:00010000:2.0:1790771167.099149:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.099154:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099159:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099166:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.099169:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.099172:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 3/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099176:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f344 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.099186:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa45500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782400:0@lo:1000:mdt_io00_003.0 00000004:00010000:2.0:1790771167.099189:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000039b87d12 reply state 00000000db2f8300 transno 4294969475 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099198:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.099204:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xdcc87686 (ffff8bfc0ab7f200) 00010000:00010000:2.0:1790771167.099206:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.099208:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.099249:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+157:14831:x1877759534061184:12345-192.168.204.50@tcp:36:ln.0 Request processed in 3284us (3383us total) trans 4294969475 rc 0/0 00000100:00100000:2.0:1790771167.099256:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6539 00000100:00100000:3.0:1790771167.099306:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa45500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782784:0@lo:1000:mdt_io00_003.0 00000100:00100000:3.0:1790771167.099329:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.099347:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.099364:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539782784 00000100:00100000:0.0:1790771167.099369:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539782784 00000100:00100000:0.0:1790771167.099391:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:0.0:1790771167.099396:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782784:12345-0@lo:1000:mdt_io00_003.0 00000100:00100000:0.0:1790771167.099446:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782784:12345-0@lo:1000:mdt_io00_003.0 Request processed in 50us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.099451:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1790771167.099477:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa45500 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782784:0@lo:1000:mdt_io00_003.0 00000100:00100000:1.0:1790771167.099533:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782912:0@lo:1000:mdt_io00_003.0 00000100:00100000:1.0:1790771167.099556:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.099572:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.099576:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539782912 00000100:00100000:3.0:1790771167.099580:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539782912 00000100:00100000:3.0:1790771167.099605:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1790771167.099609:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782912:12345-0@lo:1000:mdt_io00_003.0 00000100:00100000:3.0:1790771167.099672:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539782912:12345-0@lo:1000:mdt_io00_003.0 Request processed in 61us (114us total) trans 0 rc 1/1 00000100:00100000:3.0:1790771167.099678:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:1.0:1790771167.099691:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539782912:0@lo:1000:mdt_io00_003.0 00010000:00010000:1.0:1790771167.099719:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.099726:0:13785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.099731:0:13785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.099738:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539783040:0@lo:101:mdt_io00_003.0 00000100:00100000:1.0:1790771167.099755:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.099771:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.099785:0:13776:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783040 00000100:00100000:3.0:1790771167.099790:0:13776:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783040 00000100:00100000:3.0:1790771167.099811:0:13776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1790771167.099815:0:13776:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539783040:12345-0@lo:101:mdt_io00_003.0 00010000:00010000:3.0:1790771167.099821:0:13776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.099830:0:13776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f3b4 expref: -99 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.099842:0:13776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 93 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.099848:0:13776:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 4/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 10 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.099866:0:13776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 93 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.099881:0:13776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 93 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.099894:0:13776:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:13776:1877759539783168:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.099937:0:13776:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.101076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.101109:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534062720 00000100:00100000:0.0:1790771167.101114:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534062720 00000100:00100000:0.0:1790771167.101140:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6546 00000100:00100000:0.0:1790771167.101146:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+157:14839:x1877759534062720:12345-192.168.204.50@tcp:36:mcreate.0 00000100:00100000:0.0:1790771167.101220:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+157:14839:x1877759534062720:12345-192.168.204.50@tcp:36:mcreate.0 Request processed in 72us (143us total) trans 0 rc -17/-17 00000100:00100000:0.0:1790771167.101228:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6546 00000100:00100000:1.0:1790771167.101642:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.101695:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534062976 00000100:00100000:3.0:1790771167.101700:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534062976 00000100:00100000:3.0:1790771167.101733:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6547 00000100:00100000:3.0:1790771167.101742:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14710:x1877759534062976:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:3.0:1790771167.101750:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.101758:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f3c2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36621 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.101829:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x24:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.101841:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f3c2 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36621 expref: 137 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.101848:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfb03218800) 00010000:00010000:3.0:1790771167.101850:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.101855:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f3c2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36621 expref: 137 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.101865:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e0200, rc 0) 00000100:00100000:3.0:1790771167.101899:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14710:x1877759534062976:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 158us (256us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.101910:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6547 00000100:00100000:2.0:1790771167.105436:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.105468:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065152 00000100:00100000:3.0:1790771167.105474:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065152 00000100:00100000:3.0:1790771167.105554:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6548 00000100:00100000:3.0:1790771167.105562:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14006:x1877759534065152:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.105571:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.105611:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f3c9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3666e expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105662:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105673:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105680:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105691:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105696:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105705:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.105749:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000100:00100000:1.0:1790771167.105753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.105784:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.105790:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063104 00010000:00010000:2.0:1790771167.105791:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.105795:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063104 00010000:00010000:2.0:1790771167.105802:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.105810:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.105811:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105820:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105825:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.105829:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105831:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063360 00010000:00010000:2.0:1790771167.105835:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105837:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063360 00000100:00100000:3.0:1790771167.105840:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 904 00000100:00100000:1.0:1790771167.105848:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.105856:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:3.0:1790771167.105858:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:2396:x1877759534063104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.105859:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.105865:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105871:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595000/0xfa0c505d97f0f3d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.105873:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.105874:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063232 00000100:00100000:1.0:1790771167.105878:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.105881:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063232 00010000:00010000:2.0:1790771167.105897:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.105897:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04fe2000/0xfa0c505d97f0f2aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365db expref: 95 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105912:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063488 00010000:00010000:2.0:1790771167.105916:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105918:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063488 00000100:00100000:1.0:1790771167.105920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.105925:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x24:0x0].0x0 (ffff8bfc3da48200) 00010000:00010000:2.0:1790771167.105929:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.105930:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.105937:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.105941:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.105946:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105948:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063616 00000100:00100000:0.0:1790771167.105954:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063616 00010000:00010000:2.0:1790771167.105958:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc0ab7fe00) 00010000:00010000:2.0:1790771167.105961:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.105964:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.105965:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:2396:x1877759534063104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (214us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.105971:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595200/0xfa0c505d97f0f3d7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.105977:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063744 00000100:00100000:3.0:1790771167.105981:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 904 00000100:00100000:0.0:1790771167.105983:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063744 00000100:00100000:1.0:1790771167.105984:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.106012:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534063872 00010000:00010000:2.0:1790771167.106016:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f3c9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3666e expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.106017:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534063872 00000100:00100000:3.0:1790771167.106023:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6549 00010000:00010000:2.0:1790771167.106033:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.106038:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:3.0:1790771167.106038:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+161:13265:x1877759534063360:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.106047:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595400/0xfa0c505d97f0f3c9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3666e expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.106048:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6550 00010000:00010000:3.0:1790771167.106050:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.106063:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06595400, rc 0) 00010000:00010000:3.0:1790771167.106064:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f3e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3662f expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.106065:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+93:14924:x1877759534063232:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:1.0:1790771167.106072:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.106082:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.106096:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0f3ec lrc: 2/0,0 mode: --/CR res: [0x240000402:0xae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36628 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.106100:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14006:x1877759534065152:12345-192.168.204.50@tcp:101:ls.0 Request processed in 537us (663us total) trans 4294969476 rc 301/301 00000100:00100000:2.0:1790771167.106116:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6548 00000100:00100000:2.0:1790771167.106132:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064128 00010000:00010000:0.0:1790771167.106137:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0f3ec lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xae:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36628 expref: 94 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.106145:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064128 00010000:00010000:3.0:1790771167.106147:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f3f3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106150:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687400/0xfa0c505d97f0f3ec lrc: 3/0,0 mode: CR/CR res: [0x240000402:0xae:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36628 expref: 94 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.106165:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106170:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfc113f3c00) 00010000:00010000:0.0:1790771167.106173:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790771167.106176:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687400, rc 0) 00000100:00100000:2.0:1790771167.106179:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6551 00000100:00100000:1.0:1790771167.106186:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.106193:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+163:13260:x1877759534063488:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.106202:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.106208:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14924:x1877759534063232:12345-192.168.204.50@tcp:101:cp.0 Request processed in 147us (397us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.106211:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f3fa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36636 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.106224:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.106227:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.106232:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6550 00000100:00100000:0.0:1790771167.106255:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6552 00010000:00010000:2.0:1790771167.106260:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.106264:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000100:00100000:0.0:1790771167.106267:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13266:x1877759534063616:12345-192.168.204.50@tcp:101:ls.0 00000004:00200000:3.0:1790771167.106273:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.106275:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106279:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.106289:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.106290:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106291:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f408 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3663d expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.106299:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6553 00000100:00100000:1.0:1790771167.106314:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13263:x1877759534063744:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.106324:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1790771167.106330:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.106336:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f40f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36644 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.106336:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.106338:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.106355:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106358:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106378:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.106388:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.106392:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f3e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3662f expref: 168 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106398:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594200/0xfa0c505d97f0f3fa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36636 expref: 168 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.106400:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.106407:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.106415:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.106420:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.106436:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.106438:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1c00/0xfa0c505d97f0f3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3662f expref: 167 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106441:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36636 expref: 167 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106444:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f408 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3663d expref: 167 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.106467:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.106471:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000004:00200000:1.0:1790771167.106473:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.106475:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.106475:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1c00, rc 0) 00000004:00200000:1.0:1790771167.106478:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.106506:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.106510:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391200, rc 0) 00010000:00010000:0.0:1790771167.106513:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3663d expref: 166 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.106518:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106521:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771167.106529:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:3.0:1790771167.106533:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+166:13265:x1877759534063360:12345-192.168.204.50@tcp:101:ls.0 Request processed in 497us (747us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.106535:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00000100:00100000:2.0:1790771167.106540:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+167:13260:x1877759534063488:12345-192.168.204.50@tcp:101:ls.0 Request processed in 347us (695us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.106546:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f40f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36644 expref: 167 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.106547:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6549 00000100:00100000:2.0:1790771167.106558:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6551 00010000:00010000:1.0:1790771167.106569:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36644 expref: 165 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.106574:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6554 00000100:00100000:0.0:1790771167.106575:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13266:x1877759534063616:12345-192.168.204.50@tcp:101:ls.0 Request processed in 306us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.106586:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6555 00000100:00100000:3.0:1790771167.106588:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13270:x1877759534063872:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.106602:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6552 00010000:00010000:3.0:1790771167.106603:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.106606:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13261:x1877759534064128:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.106610:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.106614:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0f424 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3664b expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.106615:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.106621:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2800, rc 0) 00010000:00010000:2.0:1790771167.106621:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.106631:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064640 00000100:00100000:0.0:1790771167.106635:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064640 00010000:00010000:2.0:1790771167.106639:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f42b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36652 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.106663:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+165:13263:x1877759534063744:12345-192.168.204.50@tcp:101:ls.0 Request processed in 338us (737us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.106665:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771167.106673:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->38335) req@ffff8bfb056cfb80 x1877759534064640/t0(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771167.106677:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6553 00010000:00010000:3.0:1790771167.106682:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106686:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1790771167.106701:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cfb80 with x1877759534064640 ext(0->38335) 00010000:00010000:3.0:1790771167.106709:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106711:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106714:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 28 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106736:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.106738:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 28 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.106743:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1790771167.106750:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00002000:00010000:0.0:1790771167.106756:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb056cfb80 00000004:00200000:2.0:1790771167.106763:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00010000:3.0:1790771167.106765:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.106766:0:6495:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.106778:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 101 00000004:00010000:2.0:1790771167.106781:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.106783:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064896 00010000:00010000:3.0:1790771167.106789:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031600/0xfa0c505d97f0f424 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3664b expref: 165 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.106791:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+28:2396:x1877759534064640:12345-192.168.204.50@tcp:4:cp.0 00000100:00100000:1.0:1790771167.106791:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064896 00010000:00010000:2.0:1790771167.106813:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f42b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36652 expref: 166 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.106829:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36652 expref: 165 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.106832:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1709 00000100:00100000:1.0:1790771167.106846:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:14001:x1877759534064896:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771167.106851:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771167.106854:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.106857:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00010000:00010000:3.0:1790771167.106863:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3664b expref: 164 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.106873:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.106877:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.106881:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aa200, rc 0) 00000100:00100000:2.0:1790771167.106889:0:13796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:13796:1877759539781632:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.106906:0:13796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [4096->28671] (req 4096->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365fe expref: 29 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.106916:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+164:13270:x1877759534063872:12345-192.168.204.50@tcp:101:ls.0 Request processed in 330us (939us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.106918:0:13796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06594400, rc 0) 00000100:00100000:3.0:1790771167.106926:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6554 00000100:00100000:2.0:1790771167.106948:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:15098:x1877759534057984:12345-192.168.204.50@tcp:101:fallocate.0 Request processed in 13773us (13886us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.106958:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1072 00000100:00100000:1.0:1790771167.106960:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14001:x1877759534064896:12345-192.168.204.50@tcp:35:ls.0 Request processed in 112us (735us total) trans 4294969477 rc 0/0 00000100:00100000:1.0:1790771167.106974:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1709 00000100:00100000:3.0:1790771167.106991:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+163:13261:x1877759534064128:12345-192.168.204.50@tcp:101:ls.0 Request processed in 392us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.106999:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6555 00000100:00100000:1.0:1790771167.107303:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.107320:0:7434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa45180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539781760:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771167.107332:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.107341:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065280 00000100:00100000:2.0:1790771167.107346:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065280 00000100:00100000:3.0:1790771167.107361:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759534057856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 13892us (14388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.107367:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1799 00000100:00100000:2.0:1790771167.107380:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1077 00000100:00100000:2.0:1790771167.107390:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+29:2396:x1877759534065280:12345-192.168.204.50@tcp:2:chown.0 00002000:00010000:2.0:1790771167.107453:0:13782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4196581 -> 4196581 00002000:00010000:2.0:1790771167.107456:0:13782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.107457:0:13782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771166 00002000:00010000:2.0:1790771167.107459:0:13782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.107461:0:13782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:2.0:1790771167.107508:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2396:x1877759534065280:12345-192.168.204.50@tcp:2:chown.0 Request processed in 119us (205us total) trans 4294967648 rc 0/0 00000100:00100000:2.0:1790771167.107515:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1077 00000100:00100000:1.0:1790771167.108796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.108815:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.108833:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.108838:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065536 00000100:00100000:2.0:1790771167.108845:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065536 00000100:00100000:0.0:1790771167.108849:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065792 00000100:00100000:0.0:1790771167.108854:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065792 00000100:00100000:3.0:1790771167.108861:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065920 00000100:00100000:3.0:1790771167.108868:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065920 00010000:00010000:0.0:1790771167.108874:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.108894:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1078 00000100:00100000:2.0:1790771167.108907:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759534065536:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:0.0:1790771167.108915:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1805 00000100:00100000:3.0:1790771167.108915:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6556 00000100:00100000:3.0:1790771167.108930:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+163:15027:x1877759534065920:12345-192.168.204.50@tcp:36:chown.0 00000100:00100000:0.0:1790771167.108935:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+26:2397:x1877759534065792:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.108947:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.108954:0:12030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790771167.108956:0:6481:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1790771167.108960:0:6481:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb mtime from disk: 1790771166 -> 1790771167 00002000:00010000:0.0:1790771167.108962:0:6481:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb ctime from disk: 1790771166 -> 1790771167 00002000:00010000:0.0:1790771167.108964:0:6481:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1790771167.108969:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0ef9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x94:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364ae expref: 163 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.108971:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.108993:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:0.0:1790771167.108995:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.108999:0:12030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.109011:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x94:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.109016:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc7b05c7/0xfa0c505d97f090cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e343c2 expref: 26 pid: 8406 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.109023:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.109042:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.109046:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1790771167.109050:0:6481:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1790771167.109055:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e9 expref: 24 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.109063:0:6481:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e9 expref: 24 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.109088:0:6481:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000000aca3c4/0xfa0c505d97f0f217 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365e9 expref: 24 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.109096:0:6481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1877759539783296:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.109161:0:6481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc3d99aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.109550:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.109611:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534066304 00000100:00100000:0.0:1790771167.109616:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534066304 00000100:00100000:0.0:1790771167.109641:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6557 00000100:00100000:0.0:1790771167.109662:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+94:14494:x1877759534066304:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:0.0:1790771167.109717:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783424:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.109744:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.109764:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f9de40 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.109785:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783424 00000100:00100000:2.0:1790771167.109791:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783424 00000100:00100000:2.0:1790771167.109833:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1790771167.109844:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783424:12345-0@lo:1000:mdt00_008.0 00000001:00080000:1.0:1790771167.109849:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967642 is committed 00000001:00080000:1.0:1790771167.109856:0:8402:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967641 is committed 00000100:00100000:2.0:1790771167.109924:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783424:12345-0@lo:1000:mdt00_008.0 Request processed in 81us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.109931:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.109941:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1790771167.109961:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534066560 00000100:00100000:3.0:1790771167.109966:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534066560 00000100:00100000:3.0:1790771167.110009:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1710 00000100:00100000:1.0:1790771167.110014:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.110023:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+95:12237:x1877759534066560:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.110055:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534065536:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1151us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.110062:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1078 00000100:00100000:0.0:1790771167.110082:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534066048 00000100:00100000:0.0:1790771167.110085:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534066048 00002000:00100000:0.0:1790771167.110104:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (606208->610303) req@ffff8bfb056cd180 x1877759534066048/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.110115:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cd180 with x1877759534066048 ext(606208->610303) 00002000:00010000:0.0:1790771167.110120:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb056cd180 00000100:00100000:0.0:1790771167.110145:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 459 00000100:00100000:0.0:1790771167.110155:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759534066048:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771167.110225:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+96:12237:x1877759534066560:12345-192.168.204.50@tcp:35:ls.0 Request processed in 207us (298us total) trans 4294968893 rc 0/0 00000100:00100000:3.0:1790771167.110232:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1710 00000100:00100000:0.0:1790771167.110264:0:13779:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+30:2397:x1877759534066048:12345-192.168.204.50@tcp:3:cat.0 Request processed in 110us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.110270:0:13779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 459 00002000:00100000:0.0:1790771167.110276:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000400:0xb:0x0] (606208->610303) req@ffff8bfb056cd180 x1877759534066048/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.110282:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cd180 with x1877759534066048 ext(606208->610303) 00002000:00010000:0.0:1790771167.110286:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb056cd180 00000100:00100000:0.0:1790771167.110314:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783424:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.110355:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783552:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.110379:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.110395:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324540 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.110405:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783552 00000100:00100000:1.0:1790771167.110409:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783552 00000100:00100000:1.0:1790771167.110438:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1790771167.110445:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783552:12345-0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.110526:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783552:12345-0@lo:1000:mdt00_008.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.110532:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:0.0:1790771167.110547:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783552:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.110584:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783680:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.110609:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.110626:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324540 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.110659:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783680 00000100:00100000:2.0:1790771167.110665:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783680 00000100:00100000:2.0:1790771167.110698:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1790771167.110707:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783680:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1790771167.110780:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783680:12345-0@lo:1000:mdt00_008.0 Request processed in 73us (169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790771167.110789:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1790771167.110807:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783680:0@lo:1000:mdt00_008.0 00010000:00010000:0.0:1790771167.110842:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.110849:0:13763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.110855:0:13763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.110865:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783808:0@lo:101:mdt00_008.0 00010000:00010000:3.0:1790771167.110866:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.110880:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.110887:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.110893:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.110900:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.110905:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.110910:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.110915:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.110916:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.110921:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324900 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.110927:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.110928:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783808 00010000:00010000:3.0:1790771167.110932:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790771167.110936:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783808 00010000:00010000:1.0:1790771167.110942:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771167.110946:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.110949:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.110955:0:3611:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.110959:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb058af400/0xfa0c505d97f0eda9 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0edb0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.110962:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.110965:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539783936:0@lo:103:jbd2/dm-0-8.0 00000100:00100000:2.0:1790771167.110973:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00010000:00010000:1.0:1790771167.110983:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0ed78 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.110983:0:6473:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.110991:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:13763:x1877759539783808:12345-0@lo:101:mdt00_008.0 00000100:00100000:0.0:1790771167.111002:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1790771167.111009:0:6473:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111016:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111016:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.111024:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.111028:0:6473:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 2/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111030:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111034:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f447 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.111038:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539783936 00000100:00100000:0.0:1790771167.111044:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539783936 00010000:00010000:1.0:1790771167.111052:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06594000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.111059:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.111065:0:6473:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790771167.111070:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111072:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 2/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.111074:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00010000:00010000:3.0:1790771167.111079:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb063e0400/0xfa0c505d97f0ec4b lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0ec6e expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.111087:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+11:3624:x1877759539783936:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1790771167.111093:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:1.0:1790771167.111100:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771167.111103:0:6499:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 4/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111105:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.111105:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771167.111108:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969478 is committed 00010000:00010000:1.0:1790771167.111124:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594000/0xfa0c505d97f0eb48 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771167.111126:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969477 is committed 00010000:00010000:0.0:1790771167.111127:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0edb0 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x6e:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0eda9 expref: 11 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111132:0:6499:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111138:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 53 batchid updated 00010000:00010000:1.0:1790771167.111144:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111157:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111162:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00010000:00010000:1.0:1790771167.111163:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111166:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.111172:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.111175:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111180:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:2.0:1790771167.111181:0:6499:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1790771167.111192:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771167.111195:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.111198:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111202:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0efb6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.111207:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+10:3624:x1877759539783936:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 119us (206us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.111219:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.111220:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000020:00080000:3.0:1790771167.111227:0:6473:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8bfc085b9900 refcount 2 committed 0 result 0 batchid 54 00010000:00010000:1.0:1790771167.111229:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111231:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 3/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111234:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4ca00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8bfc085b9a80 00000020:00080000:3.0:1790771167.111245:0:6473:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].42 00010000:00010000:1.0:1790771167.111246:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111251:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111253:0:6473:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8bfc3da4c200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8bfb073e0200 00010000:00010000:2.0:1790771167.111257:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfb0282aa00) 00000020:00080000:3.0:1790771167.111264:0:6473:0:(update_trans.c:72:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].42 00010000:00010000:1.0:1790771167.111267:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.111267:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.111277:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111278:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111279:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 3/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771167.111287:0:6473:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:1.0:1790771167.111291:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111300:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111309:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592600, rc 0) 00000100:00100000:3.0:1790771167.111316:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784064:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:0.0:1790771167.111318:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05104400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.111324:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111332:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111334:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771167.111339:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111343:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0xd870248a (ffff8bfc34224700) 00010000:00010000:1.0:1790771167.111345:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111349:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111354:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111359:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0f057 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111362:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771167.111363:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13763:x1877759539783808:12345-0@lo:101:mdt00_008.0 Request processed in 373us (470us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.111375:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05104400/0xfa0c505d97f0eeac lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x4:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111384:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00010000:00010000:1.0:1790771167.111390:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111396:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 54 committed batchid 53 00010000:00010000:1.0:1790771167.111397:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111399:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111416:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111417:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111432:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04caee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.111434:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111436:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111447:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.111451:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111452:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771167.111457:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb061a7900 with version 86 00010000:00010000:0.0:1790771167.111470:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111471:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 53 cancel update log [0x240000401:0x3:0x0].41: rc = 0 00010000:00010000:1.0:1790771167.111473:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:1.0:1790771167.111481:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.111505:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111509:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x49:0x0].0x0 (ffff8bfb03146400) 00010000:00010000:1.0:1790771167.111512:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f096 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111513:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111518:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111539:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f049 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111544:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111545:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 53 cancel update log [0x200000400:0x3:0x0].41: rc = 0 00010000:00010000:1.0:1790771167.111557:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.111560:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 53 00010000:00010000:0.0:1790771167.111562:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111563:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784064 00010000:00010000:1.0:1790771167.111564:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111570:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784064 00000004:00080000:3.0:1790771167.111572:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 86 rpc_version 86 00010000:00010000:1.0:1790771167.111582:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.111585:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111586:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:3.0:1790771167.111592:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:0.0:1790771167.111602:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111603:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111605:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb04878000 x1877759539784960/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790771167.111614:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00010000:00010000:0.0:1790771167.111621:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.111628:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111628:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00000100:00100000:2.0:1790771167.111632:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+10:3625:x1877759539784064:12345-0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1790771167.111637:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771167.111637:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb04878000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539784960:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771167.111642:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111666:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111667:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f114 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111670:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.111689:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0xd964d85e (ffff8bfc3607db00) 00010000:00010000:2.0:1790771167.111691:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05105e00/0xfa0c505d97f0ec6e lrc: 0/0,0 mode: --/PW res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0ec4b expref: 10 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111693:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111695:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790771167.111696:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111702:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111715:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111720:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7780 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.111722:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae600/0xfa0c505d97f0eda2 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xa:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111729:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff8bfc34224500) 00010000:00010000:1.0:1790771167.111730:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111739:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.111743:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.111747:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.111748:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111750:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111759:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.111769:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x73:0x0].0x0 (ffff8bfc0786e200) 00010000:00010000:0.0:1790771167.111770:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111775:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.111780:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111781:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111786:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539784064:12345-0@lo:103:jbd2/dm-0-8.0 Request processed in 157us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.111798:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.111800:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f202 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x73:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111802:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.111808:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111810:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00010000:00010000:0.0:1790771167.111822:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111831:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111835:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfb0282ab00) 00010000:00010000:0.0:1790771167.111839:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.111839:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111844:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111846:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784064:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:1.0:1790771167.111859:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111861:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f0ab lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111867:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1790771167.111874:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.111879:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111880:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784448:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790771167.111883:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111892:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111916:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.111916:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.111922:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xd870248a (ffff8bfb0282a400) 00010000:00010000:1.0:1790771167.111928:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111935:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111935:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.111946:0:8406:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784576 00000100:00100000:3.0:1790771167.111952:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784448 00010000:00010000:1.0:1790771167.111953:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f24f lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xc:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111955:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4bc00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.111955:0:8406:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784576 00000100:00100000:3.0:1790771167.111958:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784448 00010000:00010000:0.0:1790771167.111962:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111969:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111975:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111979:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfb0282aa00) 00010000:00010000:1.0:1790771167.111982:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.111983:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.111990:0:3610:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.111993:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112004:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06595a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.112005:0:3610:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112009:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00010000:00010000:1.0:1790771167.112011:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.112021:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00010000:00010000:1.0:1790771167.112028:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112030:0:3610:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112030:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1877759539784576:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790771167.112037:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1877759539784448:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.112041:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:1.0:1790771167.112050:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.112053:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112058:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595a00/0xfa0c505d97f0f28e lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x8e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790771167.112058:0:8406:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:19 count 1 00010000:00010000:0.0:1790771167.112068:0:3610:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112075:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112080:0:3610:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3610:1877759539785088:0@lo:105: 00010000:00010000:1.0:1790771167.112085:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.112088:0:8406:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x6abcffd9, atime: 0x6abcffd9, ctime: 0x6abcffd9, blocks: 0x0 00010000:00010000:1.0:1790771167.112091:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112099:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.112099:0:8406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112104:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112122:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112123:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.112126:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=167s v=(0 0) 00010000:00010000:2.0:1790771167.112137:0:8406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771167.112138:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc19631f00) 00010000:00010000:1.0:1790771167.112142:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.112144:0:8406:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112145:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112161:0:3610:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324540 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.112162:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0f2bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.112176:0:8406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112182:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb057b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784192:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.112183:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112202:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112214:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.112216:0:8406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112230:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.112237:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112238:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.112244:0:8406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112247:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.112258:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4196581 -> 4196581 00000100:00100000:0.0:1790771167.112262:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784704:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.112266:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xf:0x0].0x0 (ffff8bfb0314b500) 00002000:00010000:3.0:1790771167.112268:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00010000:00010000:1.0:1790771167.112272:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00002000:00010000:3.0:1790771167.112275:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771166 00010000:00010000:1.0:1790771167.112276:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.112281:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00010000:00010000:1.0:1790771167.112284:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f21e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xf:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.112284:0:8406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790771167.112286:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8200 -> 8200 00000100:00100000:0.0:1790771167.112294:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.112304:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112312:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112319:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1790771167.112320:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112328:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784320:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.112333:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.112336:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1877759539784448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (421us total) trans 4294967649 rc 0/0 00010000:00010000:1.0:1790771167.112340:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.112345:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00010000:00010000:1.0:1790771167.112356:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112363:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.112364:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784192 00000100:00100000:3.0:1790771167.112370:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784192 00010000:00010000:1.0:1790771167.112379:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xdcc87686 (ffff8bfc0ab7f200) 00010000:00010000:1.0:1790771167.112383:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.112386:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112391:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f34b lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x33:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.112399:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784704 00000100:00100000:3.0:1790771167.112403:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784704 00000100:00100000:0.0:1790771167.112410:0:7433:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785088 00000100:00100000:0.0:1790771167.112416:0:7433:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785088 00010000:00010000:1.0:1790771167.112417:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112418:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3625:x1877759539784576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 390us (616us total) trans 4294967650 rc 0/0 00000100:00100000:3.0:1790771167.112423:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784320 00000100:00100000:3.0:1790771167.112429:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784320 00010000:00010000:1.0:1790771167.112435:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112442:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00010000:00010000:1.0:1790771167.112444:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112449:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00010000:00010000:1.0:1790771167.112456:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.112459:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112463:0:7433:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3610:x1877759539785088:12345-0@lo:105: 00010000:00010000:1.0:1790771167.112468:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.112471:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00010000:00010000:0.0:1790771167.112475:0:7433:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112482:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc36078200) 00010000:00010000:1.0:1790771167.112505:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.112508:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112512:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0ec59 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.112521:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3626:x1877759539784192:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790771167.112523:0:7433:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112531:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1790771167.112533:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:25 count 1 00000100:00100000:2.0:1790771167.112535:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00010000:00010000:0.0:1790771167.112537:0:7433:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112544:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112547:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112554:0:8406:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3626:x1877759539784704:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1790771167.112556:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112565:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112579:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112583:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 5/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112584:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.112590:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112595:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x19:0x0].0x0 since=1s v=(5 2) 00010000:00010000:3.0:1790771167.112605:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(6 2) 00010000:00010000:0.0:1790771167.112610:0:7433:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 5/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112613:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112613:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112638:0:7433:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb05686400) 00010000:00010000:1.0:1790771167.112638:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x84832a57 (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.112643:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.112645:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112666:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0ec60 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112679:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112684:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.112689:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112696:0:7433:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:3610:x1877759539785088:12345-0@lo:105: Request processed in 236us (576us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.112698:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996400 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:2.0:1790771167.112702:0:8406:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 38336 -> 38336 00010000:00010000:1.0:1790771167.112704:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112709:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00002000:00010000:2.0:1790771167.112710:0:8406:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00010000:00010000:1.0:1790771167.112717:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.112718:0:8406:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771167.112726:0:8406:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.112730:0:8406:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 80 -> 80 00010000:00010000:1.0:1790771167.112732:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x69:0x0].0x0 (ffff8bfc4205df00) 00000100:00100000:0.0:1790771167.112734:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00010000:00010000:1.0:1790771167.112736:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771167.112740:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112745:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539784320:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1790771167.112752:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0ec67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x69:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1790771167.112761:0:13781:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:36 count 1 00010000:00010000:0.0:1790771167.112777:0:13781:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112779:0:8406:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539784704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (485us total) trans 4294967651 rc 0/0 00010000:00010000:3.0:1790771167.112779:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x50000000030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.112801:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00010000:00010000:0.0:1790771167.112806:0:13781:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 29 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112808:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x70000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 28 pid: 13788 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112823:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x24:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1790771167.112827:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(1 0) 00000100:00100000:3.0:1790771167.112831:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0305f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539785216:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.112832:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112856:0:13781:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 29 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.112864:0:13781:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 29 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112873:0:13781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539785344:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.112886:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7540 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.112907:0:13781:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d3246c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.112911:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771167.112917:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112924:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:3.0:1790771167.112928:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112935:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.112947:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112948:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539783936:0@lo:103:jbd2/dm-0-8.0 00010000:00010000:3.0:1790771167.112960:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000055fed8e/0xfa0c505d97f0f455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.112976:0:3626:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967604 gen 2 00000004:00080000:0.0:1790771167.112980:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb057b5180, transno 4294967598 00000004:00080000:0.0:1790771167.112989:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa94000, transno 4294967599 00000004:00080000:0.0:1790771167.112992:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa95880, transno 4294967601 00000004:00080000:0.0:1790771167.112994:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa97800, transno 4294967602 00000004:00080000:0.0:1790771167.112997:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa96a00, transno 4294967603 00000004:00080000:0.0:1790771167.113000:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fa96d80, transno 4294967604 00000100:00100000:0.0:1790771167.113007:0:3626:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8bfb06ba2d80 x1877759539784704/t4294967651(4294967651) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790771183 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1790771167.113014:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06ba2d80/2, rc 0, transno 4294967651 00000100:00100000:0.0:1790771167.113018:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784704:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1790771167.113048:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771167.113051:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771167.113052:0:3610:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3610:1877759539785088:0@lo:105: 00010000:00010000:3.0:1790771167.113055:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.113067:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113074:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f0b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113084:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113088:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113093:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113101:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e200 already unused, calling callback (ffffffffc18aa4f0) 00000004:00080000:2.0:1790771167.113103:0:9561:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 5 in progress, 4 in flight, 6 done 00010000:00010000:0.0:1790771167.113105:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113116:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113126:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0xd870248a (ffff8bfc19631b00) 00010000:00010000:0.0:1790771167.113129:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.113133:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113140:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0f2fe lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0xd870248a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113156:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113161:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113165:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113168:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1a600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.113170:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113174:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113182:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771167.113184:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.113187:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113194:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0f3a6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.113220:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539783808:0@lo:101:mdt00_008.0 00010000:00010000:0.0:1790771167.113233:0:13763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771167.113247:0:13763:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0xb6:0x0] 00010000:00010000:0.0:1790771167.113262:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113267:0:13763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113273:0:13763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.113281:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785472:0@lo:101:mdt00_008.0 00000100:00100000:0.0:1790771167.113298:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.113314:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324900 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.113338:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539784960 00000100:00100000:2.0:1790771167.113343:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539784960 00000100:00100000:2.0:1790771167.113361:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785472 00000100:00100000:2.0:1790771167.113364:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785472 00000100:00100000:2.0:1790771167.113379:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:2.0:1790771167.113385:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+9:7768:x1877759539784960:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1790771167.113482:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb04879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:7768:x1877759539784960:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (1793us total) trans 4294968894 rc 0/0 00000100:00100000:2.0:1790771167.113514:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1790771167.113523:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb04878000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539784960:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1790771167.113540:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:2.0:1790771167.113551:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:13763:x1877759539785472:12345-0@lo:101:mdt00_008.0 00010000:00010000:2.0:1790771167.113560:0:6499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.113573:0:6499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f46a expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.113592:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.113604:0:6499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 8 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.113613:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0xa5ec40c9 (ffff8bfc4205de00) 00010000:00010000:2.0:1790771167.113616:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.113619:0:6499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592400, rc 0) 00000100:00100000:2.0:1790771167.113682:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785472:12345-0@lo:101:mdt00_008.0 Request processed in 132us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.113690:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1790771167.113693:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785472:0@lo:101:mdt00_008.0 00010000:00010000:0.0:1790771167.113706:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.113713:0:13763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790771167.113722:0:13763:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0xb6:0x0] 00000100:00100000:0.0:1790771167.113740:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785600:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.113758:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.113772:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324540 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.113784:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785600 00000100:00100000:2.0:1790771167.113790:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785600 00000100:00100000:2.0:1790771167.113815:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:2.0:1790771167.113823:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785600:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1790771167.113886:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785600:12345-0@lo:1000:mdt00_008.0 Request processed in 64us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.113897:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785600:0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1790771167.113897:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1790771167.113944:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785728:0@lo:1000:mdt00_008.0 00000004:00080000:3.0:1790771167.114007:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06ba1180/2, rc 0, transno 4294967649 00000100:00100000:0.0:1790771167.114017:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.114019:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1790771167.114037:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc35f9de40 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.114053:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785728 00000100:00100000:0.0:1790771167.114056:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785728 00000100:00100000:0.0:1790771167.114072:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00000100:00100000:0.0:1790771167.114076:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785728:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.114131:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785728:12345-0@lo:1000:mdt00_008.0 Request processed in 53us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790771167.114140:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00000100:00100000:1.0:1790771167.114159:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0562c380 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785728:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.114207:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785856:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.114228:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.114245:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.114252:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785856 00000100:00100000:0.0:1790771167.114256:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785856 00000100:00100000:0.0:1790771167.114271:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 556 00000100:00100000:0.0:1790771167.114275:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785856:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.114320:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785856:12345-0@lo:1000:mdt00_008.0 Request processed in 44us (90us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790771167.114326:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 556 00000100:00100000:1.0:1790771167.114341:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785856:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.114380:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785984:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.114400:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.114415:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.114418:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539785984 00000100:00100000:0.0:1790771167.114422:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539785984 00000100:00100000:0.0:1790771167.114435:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 557 00000100:00100000:0.0:1790771167.114439:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785984:12345-0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.114479:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539785984:12345-0@lo:1000:mdt00_008.0 Request processed in 39us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.114518:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 557 00000100:00100000:1.0:1790771167.114531:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539785984:0@lo:1000:mdt00_008.0 00000100:00100000:1.0:1790771167.114565:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539786112:0@lo:1000:mdt00_008.0 00000004:00010000:2.0:1790771167.114576:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f858f9f3 reply state 00000000c3d949b4 transno 4294969478 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.114589:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.114590:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.114601:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:2.0:1790771167.114605:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771167.114608:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4780 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.114609:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771167.114613:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786112 00000100:00100000:0.0:1790771167.114618:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786112 00000004:00200000:2.0:1790771167.114618:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x94:0x0]: returning size 4096 00000100:00100000:0.0:1790771167.114663:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:0.0:1790771167.114672:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539786112:12345-0@lo:1000:mdt00_008.0 00010000:00080000:2.0:1790771167.114685:0:12030:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1790771167.114707:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15027:x1877759534065920:12345-192.168.204.50@tcp:36:chown.0 Request processed in 5780us (5871us total) trans 4294969478 rc 0/0 00010000:00010000:1.0:1790771167.114714:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.114719:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6556 00000100:00100000:0.0:1790771167.114725:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539786112:12345-0@lo:1000:mdt00_008.0 Request processed in 53us (135us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.114729:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.114736:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00010000:00010000:1.0:1790771167.114743:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.114748:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aaa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.114751:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.114756:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.114765:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x94:0x0].0x0 (ffff8bfc1ae7f900) 00010000:00010000:1.0:1790771167.114768:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771167.114771:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539786112:0@lo:1000:mdt00_008.0 00010000:00010000:1.0:1790771167.114772:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.114781:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f440 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x94:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771167.114817:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb06ba1c00/2, rc 0, transno 4294967650 00000100:00100000:0.0:1790771167.114821:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539786240:0@lo:1000:mdt00_008.0 00000100:00100000:0.0:1790771167.114856:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.114872:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d324900 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.114882:0:7449:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786240 00000100:00100000:2.0:1790771167.114889:0:7449:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786240 00000100:00100000:2.0:1790771167.114926:0:7449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:2.0:1790771167.114937:0:7449:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539786240:12345-0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1790771167.115006:0:7449:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:13763:x1877759539786240:12345-0@lo:1000:mdt00_008.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.115013:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb056cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_008:lustre-MDT0001-mdtlov_UUID:13763:1877759539786240:0@lo:1000:mdt00_008.0 00000100:00100000:2.0:1790771167.115018:0:7449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1790771167.115070:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539784576:0@lo:6:osp-syn-1-0.0 00000040:00080000:0.0:1790771167.115361:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x2:0x0].20, 968 off48656 00000040:00080000:0.0:1790771167.115396:0:13763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x2:0x0].20, 1120 off51648 00000004:00080000:0.0:1790771167.115401:0:13763:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8bfb07b3ec00 with version 42 00000004:00080000:1.0:1790771167.115434:0:7438:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc34262000 version 42 rpc_version 42 00000020:00100000:1.0:1790771167.115450:0:7438:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1790771167.115455:0:7438:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfc2d1f8000 x1877759539786496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790771167.115466:0:7438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539786496:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1790771167.115521:0:7438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.115534:0:7438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4840 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.115545:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786496 00000100:00100000:0.0:1790771167.115550:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786496 00000100:00100000:0.0:1790771167.115583:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:0.0:1790771167.115591:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7438:x1877759539786496:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1790771167.115814:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7438:x1877759539786496:12345-0@lo:1000:osp_up0-1.0 Request processed in 225us (292us total) trans 4294969479 rc 0/0 00000100:00100000:0.0:1790771167.115820:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00000100:00100000:1.0:1790771167.115849:0:7438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7438:1877759539786496:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1790771167.115879:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0f478 lrc: 3/0,1 mode: --/PW res: [0x240000402:0xb2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115891:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0f478 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115901:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0f478 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.115914:0:13763:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000062c63405 reply state 0000000077ea7ab7 transno 4294968895 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0f478 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115925:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686a00/0xfa0c505d97f0f478 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xb2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115932:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb2:0x0].0x0 (ffff8bfc03c5ec00) 00010000:00010000:0.0:1790771167.115935:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.115938:0:13763:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1790771167.115941:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0xb2:0x0]: returning size 4096 00000004:00080000:0.0:1790771167.115945:0:13763:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0xb6:0x0] 00010000:00010000:0.0:1790771167.115951:0:13763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115957:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115962:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115983:0:13763:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1790771167.115986:0:13763:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000402:0xb6:0x0] 00010000:00010000:0.0:1790771167.115989:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.115995:0:13763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.115997:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771167.116011:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.116021:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686400 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:1.0:1790771167.116025:0:8424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.116032:0:8424:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.116037:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+97:14494:x1877759534066304:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 6387us (6486us total) trans 4294968895 rc 0/0 00000100:00100000:0.0:1790771167.116050:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6557 00010000:00010000:1.0:1790771167.116062:0:8424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.116068:0:8424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790771167.116082:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 1/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.116087:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05686400/0xfa0c505d97f0f447 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f44e expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.116092:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539786624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.116102:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.116106:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.116109:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771167.116126:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771167.116155:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786624 00000100:00100000:2.0:1790771167.116161:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786624 00000100:00100000:2.0:1790771167.116201:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:2.0:1790771167.116211:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3627:x1877759539786624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.116223:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.116237:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f44e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0f447 expref: 9 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.116252:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfb0282aa00) 00010000:00010000:2.0:1790771167.116260:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.116301:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3627:x1877759539786624:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.116312:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1790771167.116314:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3627:1877759539786624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.120283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.120330:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534071424 00000100:00100000:0.0:1790771167.120336:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534071424 00002000:00010000:1.0:1790771167.120337:0:8408:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size: 0 -> 38336 00000100:00100000:1.0:1790771167.120351:0:8408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8408:1877759539782016:192.168.204.50@tcp:106: 00000100:00100000:0.0:1790771167.120373:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6558 00010000:00010000:1.0:1790771167.120373:0:8408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008e75f0b5/0xfa0c505d97f0f360 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3660c expref: 29 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.120386:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14004:x1877759534071424:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.120395:0:8408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e75f0b5/0xfa0c505d97f0f360 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3660c expref: 29 pid: 8408 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120400:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.120408:0:8408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372200, rc 0) 00010000:00010000:0.0:1790771167.120413:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f47f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36701 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.120439:0:8408:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759534059136:12345-192.168.204.50@tcp:101:ln.0 Request processed in 23283us (23761us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771167.120445:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1075 00000100:00100000:2.0:1790771167.120453:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.120460:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120470:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.120476:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534066944 00010000:00010000:0.0:1790771167.120478:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.120481:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534066944 00010000:00010000:0.0:1790771167.120519:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120530:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.120537:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6559 00010000:00010000:0.0:1790771167.120544:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.120548:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:13968:x1877759534066944:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:1.0:1790771167.120576:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1790771167.120597:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0f33d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36613 expref: 111 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120612:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04caf600/0xfa0c505d97f0a2a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a44 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120619:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00000004:00200000:0.0:1790771167.120620:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.120623:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.120635:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120645:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120674:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120686:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120692:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120697:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120739:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.120745:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.120750:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120757:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.120784:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.120814:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.120836:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067328 00000100:00100000:2.0:1790771167.120841:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067328 00000100:00100000:2.0:1790771167.120871:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067456 00000100:00100000:2.0:1790771167.120875:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067456 00000100:00100000:2.0:1790771167.120905:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1711 00010000:00010000:0.0:1790771167.120907:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.120918:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13668:x1877759534067328:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771167.120922:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771167.120926:0:13768:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x200000403:0x10:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1790771167.120936:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120943:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120947:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.120950:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120955:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120967:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.120969:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.120972:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120977:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f486 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120981:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.120986:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.120988:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121002:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121003:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121022:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121022:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.121027:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121030:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.121038:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121038:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.121045:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+99:13668:x1877759534067328:12345-192.168.204.50@tcp:35:ls.0 Request processed in 128us (302us total) trans 4294968896 rc 0/0 00010000:00010000:1.0:1790771167.121055:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00000100:00100000:2.0:1790771167.121059:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1711 00010000:00010000:1.0:1790771167.121060:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771167.121065:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121070:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f4a9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x10:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121085:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121085:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121101:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121108:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc03c5e800) 00000100:00100000:2.0:1790771167.121108:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1712 00010000:00010000:1.0:1790771167.121112:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121116:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.121120:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.121123:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+98:13293:x1877759534067456:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:0.0:1790771167.121124:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121125:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.121130:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121146:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121149:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f48d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121170:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.121175:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.121180:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121188:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f494 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.121198:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771167.121206:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d32f3da1 reply state 00000000e7d3ce89 transno 4294969481 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121217:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121225:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfb03218900) 00010000:00010000:1.0:1790771167.121228:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.121231:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771167.121243:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759534064640:12345-192.168.204.50@tcp:4:cp.0 Request processed in 14455us (15058us total) trans 4294967652 rc 0/0 00000100:00100000:0.0:1790771167.121254:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 101 00002000:00100000:0.0:1790771167.121263:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x1c:0x0] (0->38335) req@ffff8bfb056cfb80 x1877759534064640/t4294967652(0) o4->dd3e9fa3-001c-49c2-ab75-41a75fa63682@192.168.204.50@tcp:268/0 lens 488/448 e 0 to 0 dl 1790771178 ref 1 fl Complete:H/600/0 rc 0/0 job:'cp.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771167.121273:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:13968:x1877759534066944:12345-192.168.204.50@tcp:36:rm.0 Request processed in 725us (822us total) trans 4294969481 rc 0/0 00002000:00100000:0.0:1790771167.121274:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb056cfb80 with x1877759534064640 ext(0->38335) 00010000:00010000:0.0:1790771167.121287:0:13789:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.121288:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6559 00000100:00100000:1.0:1790771167.121304:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067200 00010000:00010000:0.0:1790771167.121306:0:13789:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.121308:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067200 00002000:00010000:0.0:1790771167.121319:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8bfb056cfb80 00000100:00100000:3.0:1790771167.121320:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.121337:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067584 00000100:00100000:1.0:1790771167.121340:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067584 00010000:00010000:0.0:1790771167.121361:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f47f lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36701 expref: 111 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.121364:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067712 00000100:00100000:1.0:1790771167.121369:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067712 00000100:00100000:3.0:1790771167.121375:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.121379:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.121383:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.121387:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f47f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36701 expref: 111 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121399:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687600, rc 0) 00000100:00100000:1.0:1790771167.121402:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068096 00000100:00100000:1.0:1790771167.121405:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068096 00000100:00100000:3.0:1790771167.121409:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6560 00000100:00100000:3.0:1790771167.121421:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:13677:x1877759534067200:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.121426:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14004:x1877759534071424:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1041us (1144us total) trans 4294969480 rc 301/301 00000100:00100000:1.0:1790771167.121433:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6561 00010000:00010000:3.0:1790771167.121433:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.121449:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6558 00000100:00100000:1.0:1790771167.121450:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+42:13887:x1877759534067584:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.121465:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.121470:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6562 00010000:00010000:1.0:1790771167.121474:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36691 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.121482:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+42:14068:x1877759534067712:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.121532:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.121540:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.121544:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 43 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121550:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f4b0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3668a expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121552:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.121554:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36698 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121559:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.121563:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4bc00, rc 0) 00000100:00100000:1.0:1790771167.121586:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+44:13887:x1877759534067584:12345-192.168.204.50@tcp:101:ls.0 Request processed in 144us (393us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.121587:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 44 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.121601:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6561 00010000:00010000:0.0:1790771167.121613:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 43 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.121620:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6563 00010000:00010000:0.0:1790771167.121623:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.121626:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.121631:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14512:x1877759534068096:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771167.121632:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687200, rc 0) 00010000:00010000:3.0:1790771167.121667:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121668:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00000100:00100000:0.0:1790771167.121676:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+43:14068:x1877759534067712:12345-192.168.204.50@tcp:101:ls.0 Request processed in 196us (396us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.121684:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0f391 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365f7 expref: 101 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121684:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.121685:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6562 00010000:00010000:3.0:1790771167.121709:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121713:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f02733 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x47:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e31f09 expref: 100 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121728:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x47:0x0].0x0 (ffff8bfb0321ef00) 00010000:00010000:1.0:1790771167.121736:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1790771167.121741:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:3.0:1790771167.121745:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.121749:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 3/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.121757:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.121758:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.121766:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121774:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121785:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f4b0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3668a expref: 100 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121790:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f4d3 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x35:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.121796:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.121806:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121810:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3668a expref: 99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121824:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.121825:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.121828:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.121832:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031000, rc 0) 00000100:00100000:3.0:1790771167.121863:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+100:13677:x1877759534067200:12345-192.168.204.50@tcp:101:ls.0 Request processed in 445us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.121868:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.121880:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6560 00010000:00010000:1.0:1790771167.121881:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,1 mode: --/EX res: [0x240000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121890:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.121897:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.121900:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539782528:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.121901:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534067840 00000100:00100000:3.0:1790771167.121908:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534067840 00000100:00100000:2.0:1790771167.121922:0:13767:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_012:lustre-MDT0000_UUID:13767:1877759539782656:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.121937:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068224 00000100:00100000:3.0:1790771167.121940:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068224 00010000:00010000:2.0:1790771167.121947:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.121959:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068352 00000100:00100000:3.0:1790771167.121964:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068352 00000100:00100000:0.0:1790771167.121965:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.121982:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068608 00000100:00100000:2.0:1790771167.121989:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068608 00000100:00100000:0.0:1790771167.121993:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000040:00080000:1.0:1790771167.122018:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off10264 00000100:00100000:0.0:1790771167.122026:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.122036:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6564 00000100:00100000:2.0:1790771167.122051:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:13884:x1877759534067840:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.122059:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122060:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.122064:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.122068:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6565 00010000:00010000:1.0:1790771167.122076:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122080:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068864 00010000:00010000:2.0:1790771167.122081:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3669f expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122084:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:13883:x1877759534068224:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.122087:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068864 00010000:00010000:1.0:1790771167.122097:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122105:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122110:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122114:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122117:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 48 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122120:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6566 00000100:00100000:0.0:1790771167.122135:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13889:x1877759534068608:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.122138:0:13768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771167.122142:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 48 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122144:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.122146:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.122150:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122157:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366a6 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122158:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366b4 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122162:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.122169:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122173:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.122179:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592600, rc 0) 00010000:00010000:1.0:1790771167.122190:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122196:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 50 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122203:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aaa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.122209:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.122211:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:13884:x1877759534067840:12345-192.168.204.50@tcp:101:ls.0 Request processed in 164us (456us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.122215:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 50 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122232:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.122233:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6564 00010000:00010000:3.0:1790771167.122247:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 50 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122248:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 50 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122249:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x47:0x0].0x0 (ffff8bfb03218200) 00010000:00010000:1.0:1790771167.122256:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1790771167.122261:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6567 00010000:00010000:1.0:1790771167.122263:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 2/0,0 mode: --/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.122277:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13888:x1877759534068352:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.122278:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.122280:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3aaa00/0xfa0c505d97f0f4da lrc: 0/0,0 mode: --/EX res: [0x240000402:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122285:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.122291:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686400, rc 0) 00010000:00010000:3.0:1790771167.122291:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.122299:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.122303:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.122304:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3a00, rc 0) 00010000:00010000:1.0:1790771167.122305:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122312:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122319:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122320:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366ad expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122328:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13889:x1877759534068608:12345-192.168.204.50@tcp:101:ls.0 Request processed in 194us (363us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.122331:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122336:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13883:x1877759534068224:12345-192.168.204.50@tcp:101:ls.0 Request processed in 254us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.122353:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6566 00010000:00010000:1.0:1790771167.122353:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.122359:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122362:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 50 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122365:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6565 00010000:00010000:1.0:1790771167.122375:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122379:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6568 00010000:00010000:2.0:1790771167.122391:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 48 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122392:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb03218b00) 00000100:00100000:0.0:1790771167.122396:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13886:x1877759534068864:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.122399:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.122404:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 3/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122410:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068736 00010000:00010000:0.0:1790771167.122411:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.122417:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068736 00010000:00010000:2.0:1790771167.122424:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.122425:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366bb expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122425:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f4cc lrc: 0/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122435:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.122435:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 110 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.122441:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592a00, rc 0) 00000004:00010000:1.0:1790771167.122453:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070cbeafc reply state 00000000e6c060d6 transno 4294968897 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f4d3 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122463:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4ac00/0xfa0c505d97f0f4d3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122466:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 49 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122468:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068480 00000100:00100000:2.0:1790771167.122473:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13888:x1877759534068352:12345-192.168.204.50@tcp:101:ls.0 Request processed in 195us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.122474:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068480 00010000:00010000:1.0:1790771167.122477:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x391d5834 (ffff8bfb03218d00) 00010000:00010000:1.0:1790771167.122506:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.122509:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.122510:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.122520:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6567 00000100:00100000:1.0:1790771167.122539:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14512:x1877759534068096:12345-192.168.204.50@tcp:36:rm.0 Request processed in 910us (1167us total) trans 4294968897 rc 0/0 00010000:00010000:0.0:1790771167.122543:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 48 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.122551:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6563 00000100:00100000:3.0:1790771167.122553:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1806 00010000:00010000:0.0:1790771167.122564:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:3.0:1790771167.122568:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2397:x1877759534068736:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.122571:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.122576:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373600, rc 0) 00010000:00010000:3.0:1790771167.122577:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.122583:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 110 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122590:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771167.122594:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 110 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122596:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122601:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13886:x1877759534068864:12345-192.168.204.50@tcp:101:ls.0 Request processed in 208us (542us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.122620:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:0.0:1790771167.122622:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6568 00010000:00010000:1.0:1790771167.122625:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122626:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0ee04 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36476 expref: 110 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122642:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122663:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:1.0:1790771167.122667:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x47:0x0].0x0 (ffff8bfb03218200) 00010000:00010000:3.0:1790771167.122669:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122672:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1807 00010000:00010000:1.0:1790771167.122674:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771167.122680:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122684:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122686:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2397:x1877759534068480:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.122697:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f4e1 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122702:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.122704:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.122712:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122716:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.122720:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.122724:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.122726:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122732:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2397:x1877759534068736:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 165us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.122742:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1806 00010000:00010000:0.0:1790771167.122746:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0ef23 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e363f8 expref: 127 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122757:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:0.0:1790771167.122761:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122767:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122773:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.122787:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.122792:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.122811:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2397:x1877759534068480:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.122816:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1807 00000100:00100000:1.0:1790771167.122832:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534068992 00010000:00010000:2.0:1790771167.122838:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.122839:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534068992 00000100:00100000:3.0:1790771167.122849:0:13776:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f9d8e00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001_UUID:13776:1877759539783168:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.122851:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122869:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.122879:0:13776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 3/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.122884:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6569 00010000:00010000:3.0:1790771167.122895:0:13776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00000100:00100000:1.0:1790771167.122897:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+48:13882:x1877759534068992:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.122902:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069248 00010000:00010000:3.0:1790771167.122902:0:13776:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.122907:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.122909:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069248 00010000:00010000:3.0:1790771167.122910:0:13776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 3/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 9 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122918:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366c2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.122919:0:13776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1a00, rc 0) 00010000:00010000:0.0:1790771167.122934:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 101 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122941:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122953:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 49 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.122959:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.122961:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.122964:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04caee00, rc 0) 00000100:00100000:0.0:1790771167.122965:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1808 00000004:00010000:2.0:1790771167.122968:0:13767:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce76e8ad reply state 00000000b68d0d6d transno 4294969482 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.122978:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:2396:x1877759534069248:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.122987:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:13882:x1877759534068992:12345-192.168.204.50@tcp:101:ls.0 Request processed in 91us (198us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.122987:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.122989:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.122994:0:13776:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539783040:12345-0@lo:101:mdt_io00_003.0 Request processed in 23175us (23234us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.123000:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 101 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123009:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6569 00010000:00010000:2.0:1790771167.123015:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:3.0:1790771167.123016:0:13776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00010000:00010000:2.0:1790771167.123024:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.123028:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 101 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.123030:0:13767:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771167.123045:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97ef5509 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e2d1b5 expref: 101 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123049:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539783040:0@lo:101:mdt_io00_003.0 00010000:00010000:0.0:1790771167.123064:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:1.0:1790771167.123067:0:13785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.123070:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14616:x1877759534062592:12345-192.168.204.50@tcp:36:cp.0 Request processed in 24281us (24492us total) trans 4294969482 rc 0/0 00010000:00010000:0.0:1790771167.123073:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123086:0:13785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.123095:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6545 00010000:00010000:0.0:1790771167.123100:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.123117:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb057b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2396:x1877759534055936:12345-192.168.204.50@tcp:4:dd.0 Request processed in 29310us (30295us total) trans 4294967653 rc 0/0 00010000:00010000:0.0:1790771167.123128:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.123129:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 456 00002000:00100000:3.0:1790771167.123139:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0x3:0x0] (0->4194303) req@ffff8bfb057b1500 x1877759534055936/t4294967653(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/448 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790771167.123146:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb057b1500 with x1877759534055936 ext(0->4194303) 00002000:00010000:3.0:1790771167.123150:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb057b1500 00010000:00010000:0.0:1790771167.123160:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 8 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123172:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001_UUID:13784:1877759539786752:0@lo:105: 00000100:00100000:3.0:1790771167.123184:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.123207:0:13784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.123213:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.123229:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070144 00000100:00100000:3.0:1790771167.123233:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070144 00000100:00100000:2.0:1790771167.123236:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070016 00000100:00100000:2.0:1790771167.123243:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070016 00000100:00100000:1.0:1790771167.123255:0:6478:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786752 00000100:00100000:0.0:1790771167.123258:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e180 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.123260:0:6478:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786752 00000100:00100000:3.0:1790771167.123272:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6570 00000100:00100000:3.0:1790771167.123285:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14700:x1877759534070144:12345-192.168.204.50@tcp:101:mkdir.0 00000100:00100000:2.0:1790771167.123292:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1713 00010000:00010000:3.0:1790771167.123297:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.123298:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790771167.123304:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.123311:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:13666:x1877759534070016:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771167.123312:0:6478:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:13784:x1877759539786752:12345-0@lo:105: 00010000:00010000:3.0:1790771167.123312:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f512 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366f3 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123326:0:6478:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123331:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070400 00010000:00010000:1.0:1790771167.123335:0:6478:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123338:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070400 00010000:00010000:1.0:1790771167.123346:0:6478:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123349:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123357:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 5/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123361:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123364:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 6/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123371:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1714 00010000:00010000:3.0:1790771167.123382:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123383:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13735:x1877759534070400:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771167.123385:0:6478:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 6/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123411:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123413:0:6478:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8bfb06372400) 00010000:00010000:3.0:1790771167.123420:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123427:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123447:0:6478:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:13784:x1877759539786752:12345-0@lo:105: Request processed in 139us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.123454:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00010000:3.0:1790771167.123469:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123475:0:13785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123477:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123482:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13735:x1877759534070400:12345-192.168.204.50@tcp:35:ls.0 Request processed in 98us (181us total) trans 4294968898 rc 0/0 00010000:00010000:3.0:1790771167.123521:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123522:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1714 00010000:00010000:1.0:1790771167.123533:0:13785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.123548:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x8e:0x0]: returning size 9437 00000004:00200000:3.0:1790771167.123552:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.123561:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,1 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.123563:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123567:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001_UUID:13784:1877759539786752:0@lo:105: 00010000:00010000:1.0:1790771167.123584:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123585:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.123588:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.123603:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:2396:x1877759534069248:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 629us (737us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.123605:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123605:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123617:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1808 00010000:00010000:3.0:1790771167.123628:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123633:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123637:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123642:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.123645:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123668:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123669:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.123691:0:13785:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x0 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123697:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.123700:0:13785:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123702:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.123709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.123711:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123723:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539786880:0@lo:101:mdt_io00_003.0 00010000:00010000:3.0:1790771167.123724:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f519 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123728:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065664 00000100:00100000:0.0:1790771167.123734:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065664 00010000:00010000:3.0:1790771167.123742:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123749:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123756:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.123763:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1084 00010000:00010000:3.0:1790771167.123763:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.123771:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.123774:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.123777:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2399:x1877759534065664:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:1.0:1790771167.123780:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb49c0 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.123783:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.123792:0:13786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.123793:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfb02b20400) 00010000:00010000:3.0:1790771167.123797:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.123799:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123800:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539786880 00010000:00010000:0.0:1790771167.123805:0:13786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3667c expref: -99 pid: 13786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123808:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539786880 00010000:00010000:3.0:1790771167.123809:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f520 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.123829:0:13786:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790771167.123841:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=167s v=(0 0) 00010000:00010000:3.0:1790771167.123842:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f512 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 111 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.123847:0:13786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1790771167.123850:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00010000:00010000:0.0:1790771167.123861:0:13786:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 30 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.123866:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+9:13785:x1877759539786880:12345-0@lo:101:mdt_io00_003.0 00010000:00010000:3.0:1790771167.123870:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 110 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.123886:0:13786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 30 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.123890:0:6498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.123891:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:3.0:1790771167.123899:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771167.123904:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00010000:00010000:1.0:1790771167.123905:0:6498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f543 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa0c505d97f0f535 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.123906:0:13786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00010000:00010000:1.0:1790771167.123925:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f543 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xfa0c505d97f0f535 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.123927:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14700:x1877759534070144:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 645us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.123934:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064256 00000100:00100000:0.0:1790771167.123940:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2399:x1877759534065664:12345-192.168.204.50@tcp:101:cp.0 Request processed in 162us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.123942:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064256 00010000:00010000:1.0:1790771167.123948:0:6498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f543 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f535 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.123949:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6570 00000100:00100000:0.0:1790771167.123960:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1084 00010000:00010000:1.0:1790771167.123963:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb03218f00) 00010000:00010000:1.0:1790771167.123966:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790771167.123969:0:6498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82800, rc 0) 00000100:00100000:3.0:1790771167.123977:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6571 00000100:00100000:3.0:1790771167.123987:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13271:x1877759534064256:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.123996:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.124007:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+10:13785:x1877759539786880:12345-0@lo:101:mdt_io00_003.0 Request processed in 143us (252us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.124007:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f54a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36659 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124022:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:0.0:1790771167.124027:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.124047:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.124056:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.124057:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070528 00010000:00010000:3.0:1790771167.124057:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124065:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539786880:0@lo:101:mdt_io00_003.0 00000100:00100000:2.0:1790771167.124065:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070528 00010000:00010000:3.0:1790771167.124070:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.124081:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.124081:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.124090:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.124091:0:13785:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.124094:0:13771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:2.0:1790771167.124107:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070784 00000004:00010000:3.0:1790771167.124109:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771167.124110:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x35:0x0] 00000100:00100000:2.0:1790771167.124113:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070784 00000100:00100000:0.0:1790771167.124125:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.124131:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f54a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36659 expref: 129 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124133:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,1 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124146:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534070912 00010000:00010000:1.0:1790771167.124148:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124151:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534070912 00010000:00010000:3.0:1790771167.124153:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36659 expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124167:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.124173:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6572 00010000:00010000:3.0:1790771167.124180:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.124184:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.124186:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78800, rc 0) 00000100:00100000:0.0:1790771167.124191:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14707:x1877759534070528:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771167.124203:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.124203:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6573 00000100:00100000:3.0:1790771167.124205:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13271:x1877759534064256:12345-192.168.204.50@tcp:101:ls.0 Request processed in 221us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.124214:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6571 00000100:00100000:1.0:1790771167.124219:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539787008:0@lo:1000:mdt_io00_003.0 00010000:00010000:0.0:1790771167.124221:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f55f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366fa expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124221:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14757:x1877759534070784:12345-192.168.204.50@tcp:55:cp.0 00000100:00100000:3.0:1790771167.124236:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6574 00000100:00100000:3.0:1790771167.124251:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15069:x1877759534070912:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:1.0:1790771167.124259:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790771167.124264:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124270:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124275:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4480 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.124281:0:13771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1790771167.124284:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 48 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124286:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124295:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539787008 00010000:00010000:3.0:1790771167.124299:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0bff8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x9a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e353d6 expref: 128 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124301:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539787008 00010000:00010000:2.0:1790771167.124311:0:13772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 2/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 105 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124313:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124318:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfc20109f00) 00000100:00100000:1.0:1790771167.124328:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00010000:00010000:3.0:1790771167.124336:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686800/0xfa0c505d97f0bff1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35438 expref: 127 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.124338:0:13772:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 5/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124340:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13785:x1877759539787008:12345-0@lo:1000:mdt_io00_003.0 00010000:00010000:0.0:1790771167.124345:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124360:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:3.0:1790771167.124366:0:13771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.124368:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124375:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124379:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.124389:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 105 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124391:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 109 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124399:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+10:13785:x1877759539787008:12345-0@lo:1000:mdt_io00_003.0 Request processed in 59us (141us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.124409:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124415:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124419:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00010000:00010000:2.0:1790771167.124423:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 105 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124431:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.124447:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0000-mdtlov_UUID:13785:1877759539787008:0@lo:1000:mdt_io00_003.0 00010000:00010000:3.0:1790771167.124449:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 109 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124450:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124459:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f918380 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539787136:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.124476:0:13771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 109 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.124512:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0305fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539787264:192.168.204.50@tcp:104: 00000004:00200000:0.0:1790771167.124518:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 1310720 00000004:00200000:0.0:1790771167.124523:0:13768:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.124538:0:13768:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.124545:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7b40 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.124549:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124550:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.124562:0:13772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 48 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124573:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124575:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.124584:0:13772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 48 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124593:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124596:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124614:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.124616:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124618:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124622:0:13772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539787392:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.124633:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124638:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124640:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.124661:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124666:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3da48900) 00010000:00010000:0.0:1790771167.124670:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124670:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.124674:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124676:0:13772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.124685:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:1.0:1790771167.124685:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f52e lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124692:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.124697:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124702:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124704:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534071168 00010000:00010000:0.0:1790771167.124709:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f56d lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124711:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534071168 00010000:00010000:1.0:1790771167.124717:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124725:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124728:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124735:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124741:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124741:0:13785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1790771167.124748:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x35:0x0] 00010000:00010000:0.0:1790771167.124749:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.124757:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124757:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1715 00010000:00010000:0.0:1790771167.124758:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124775:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14006:x1877759534071168:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771167.124784:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124784:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124808:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc8b04d25 (ffff8bfc03c5e700) 00010000:00010000:1.0:1790771167.124809:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124813:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.124818:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124828:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06596200/0xfa0c505d97f0f574 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124837:0:13785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1790771167.124848:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:0.0:1790771167.124850:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f55f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366fa expref: 106 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124854:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124880:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.124889:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366fa expref: 105 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124892:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.124892:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14006:x1877759534071168:12345-192.168.204.50@tcp:35:ls.0 Request processed in 116us (761us total) trans 4294969483 rc 0/0 00010000:00010000:0.0:1790771167.124916:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00000100:00100000:2.0:1790771167.124917:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1715 00010000:00010000:0.0:1790771167.124924:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.124926:0:13785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790771167.124928:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597000, rc 0) 00000004:00080000:1.0:1790771167.124930:0:13785:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x240000402:0x1:0x0] 00010000:00010000:1.0:1790771167.124935:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124941:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124946:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124955:0:13785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1790771167.124959:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,1 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124963:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 2/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124968:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124976:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.124977:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790771167.124980:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 3/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.124984:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:14707:x1877759534070528:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 796us (961us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.124987:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.124991:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 4/0,0 mode: EX/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.124997:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1790771167.125002:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6572 00010000:00010000:3.0:1790771167.125006:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125014:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000004:0x1:0x0].0x0 (ffff8bfb03218e00) 00010000:00010000:1.0:1790771167.125021:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.125027:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790771167.125027:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 2/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125030:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372400 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:0.0:1790771167.125035:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125040:0:8424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125041:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f558 lrc: 0/0,0 mode: --/EX res: [0x200000004:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.125050:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82e00 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:0.0:1790771167.125057:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125059:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83c00 already unused, calling callback (ffffffffc18b6ee0) 00000004:00010000:0.0:1790771167.125071:0:6483:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.125071:0:8424:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.125096:0:13785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05c30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14678:x1877759534059648:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 28512us (30492us total) trans 0 rc -39/-39 00000100:00100000:1.0:1790771167.125103:0:13785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 39 00010000:00010000:0.0:1790771167.125113:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125116:0:8424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125117:0:7903:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125125:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790771167.125133:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.125138:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00010000:3.0:1790771167.125146:0:7903:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125147:0:8424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790771167.125154:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:1.0:1790771167.125161:0:6482:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.125164:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 1/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125168:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 1/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.125170:0:6482:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125176:0:7903:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125200:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06372400/0xfa0c505d97f0f3b4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f3bb expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125202:0:7903:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790771167.125210:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c82e00/0xfa0c505d97f0f352 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f359 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125218:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 1/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125241:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb04c83c00/0xfa0c505d97f0f535 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f543 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125242:0:6482:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 2/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125244:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.125247:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.125250:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.125251:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.125258:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.125259:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.125268:0:6482:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790771167.125272:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539787520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.125282:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.125283:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 1/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.125287:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771167.125291:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.125300:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff8bfb06391400/0xfa0c505d97f0f36e lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xfa0c505d97f0f375 expref: -99 pid: 13785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.125310:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.125327:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790771167.125327:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.125333:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.125339:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790771167.125346:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790771167.125354:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534071680 00000100:00100000:0.0:1790771167.125357:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539787648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.125361:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534071680 00000100:00100000:2.0:1790771167.125362:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539787520 00000100:00100000:2.0:1790771167.125370:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539787520 00000100:00100000:3.0:1790771167.125380:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.125397:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6575 00000100:00100000:1.0:1790771167.125408:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:15040:x1877759534071680:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:0.0:1790771167.125411:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0305c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539787776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.125414:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534071808 00000100:00100000:2.0:1790771167.125420:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534071808 00010000:00010000:1.0:1790771167.125432:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.125437:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.125445:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790771167.125450:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0ef00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364bc expref: 111 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.125459:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539787776 00010000:00010000:1.0:1790771167.125462:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc34224300) 00000100:00100000:2.0:1790771167.125464:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539787776 00010000:00010000:1.0:1790771167.125474:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.125502:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790771167.125510:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539787904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.125517:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.125532:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00010000:00010000:1.0:1790771167.125543:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.125546:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+11:3624:x1877759539787520:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.125556:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.125563:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.125570:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125576:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.125579:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125595:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f359 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0f352 expref: 11 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.125601:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539787904 00000100:00100000:0.0:1790771167.125606:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539787904 00010000:00010000:2.0:1790771167.125615:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771167.125622:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1790771167.125635:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000097982d0e reply state 000000001b6bb0a9 transno 4294969484 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.125636:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.125661:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 909 00010000:00010000:1.0:1790771167.125663:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125671:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfb03218400) 00000100:00100000:0.0:1790771167.125674:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:2397:x1877759534071808:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.125676:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.125680:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.125681:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+11:3624:x1877759539787520:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (373us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.125688:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.125693:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00010000:00010000:0.0:1790771167.125702:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f439 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36652 expref: 126 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.125715:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771167.125718:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.125723:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1790771167.125727:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:15040:x1877759534071680:12345-192.168.204.50@tcp:36:cp.0 Request processed in 321us (399us total) trans 4294969484 rc 0/0 00000100:00100000:1.0:1790771167.125735:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6575 00000100:00100000:2.0:1790771167.125742:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539787776:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.125746:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.125749:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:2397:x1877759534071808:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 74us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.125753:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064512 00000100:00100000:1.0:1790771167.125759:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064512 00010000:00010000:2.0:1790771167.125761:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.125762:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 909 00010000:00010000:2.0:1790771167.125783:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f543 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x35:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0f535 expref: 10 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.125787:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072192 00000100:00100000:1.0:1790771167.125790:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534064384 00000100:00100000:0.0:1790771167.125793:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072192 00000100:00100000:1.0:1790771167.125795:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534064384 00010000:00010000:2.0:1790771167.125806:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb03218f00) 00010000:00010000:2.0:1790771167.125819:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.125823:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1790771167.125830:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072064 00000100:00100000:0.0:1790771167.125834:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+9:3626:x1877759539787904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.125837:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072064 00010000:00010000:0.0:1790771167.125843:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.125855:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f375 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0f36e expref: 9 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.125865:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x84832a57 (ffff8bfc0ab7ff00) 00000100:00100000:2.0:1790771167.125874:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:lustre-MDT0000-mdtlov_UUID+8:3626:x1877759539787776:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (427us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.125875:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.125880:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6576 00000100:00100000:2.0:1790771167.125891:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1790771167.125897:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13262:x1877759534064512:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.125907:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.125913:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000-mdtlov_UUID+7:3626:x1877759539787904:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (360us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.125918:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f590 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36667 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.125923:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 912 00000100:00100000:0.0:1790771167.125935:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1790771167.125941:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534072192:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.125953:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125955:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.125971:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534071936 00000100:00100000:0.0:1790771167.125976:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534071936 00010000:00010000:1.0:1790771167.125978:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.125979:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f41d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36644 expref: 128 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.125998:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.126004:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1716 00000100:00100000:0.0:1790771167.126017:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:13265:x1877759534071936:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771167.126024:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000004:00200000:1.0:1790771167.126030:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.126030:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1790771167.126035:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771167.126044:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126059:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f590 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36667 expref: 129 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.126068:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2397:x1877759534072192:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 129us (329us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.126076:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36667 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.126084:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 912 00010000:00010000:1.0:1790771167.126087:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.126091:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.126093:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35ffe400, rc 0) 00000100:00100000:1.0:1790771167.126115:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13262:x1877759534064512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 224us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.126120:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6576 00000100:00100000:1.0:1790771167.126135:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6577 00000100:00100000:1.0:1790771167.126140:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13264:x1877759534064384:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.126147:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.126154:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f59e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36660 expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126174:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126181:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126190:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.126208:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1790771167.126211:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771167.126222:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126241:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f59e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36660 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126253:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36660 expref: 127 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.126259:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.126261:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.126263:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35fff000, rc 0) 00000100:00100000:1.0:1790771167.126280:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13264:x1877759534064384:12345-192.168.204.50@tcp:101:ls.0 Request processed in 141us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.126285:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6577 00000100:00100000:1.0:1790771167.126298:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6578 00000100:00100000:1.0:1790771167.126304:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14636:x1877759534072064:12345-192.168.204.50@tcp:44:fallocate.0 00000100:00100000:1.0:1790771167.126552:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.126588:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539787520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.126776:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539787648 00000100:00100000:0.0:1790771167.126780:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539787648 00000100:00100000:0.0:1790771167.126811:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:0.0:1790771167.126817:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+7:3624:x1877759539787648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.126824:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.126833:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f3bb lrc: 0/0,0 mode: --/EX res: [0x200000403:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xfa0c505d97f0f3b4 expref: 7 pid: 13776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.126846:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xa:0x0].0x0 (ffff8bfc3600df00) 00010000:00010000:0.0:1790771167.126852:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.126875:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0000-mdtlov_UUID+6:3624:x1877759539787648:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.126881:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1790771167.126903:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3624:1877759539787648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.126943:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13293:x1877759534067456:12345-192.168.204.50@tcp:37:ls.0 Request processed in 5823us (6127us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.126951:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1712 00000100:00100000:0.0:1790771167.126961:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d1f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539787904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.126972:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539787776:0@lo:103:ldlm_bl.0 00000001:00080000:2.0:1790771167.127551:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969484 is committed 00000001:00080000:2.0:1790771167.127573:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969482 is committed 00000001:00080000:2.0:1790771167.127584:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969479 is committed 00010000:00010000:1.0:1790771167.127585:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127593:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1790771167.127595:0:6473:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 54 batchid updated 00010000:00010000:0.0:1790771167.127596:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127601:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.127614:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127615:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.127620:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.127626:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.127627:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 54 00010000:00010000:1.0:1790771167.127629:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.127643:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.127662:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127665:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfb03218900) 00010000:00010000:1.0:1790771167.127669:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.127670:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127674:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127681:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f4a2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.127683:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000004:00080000:3.0:1790771167.127683:0:6525:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8bfb061a7cc0 with version 87 00010000:00010000:0.0:1790771167.127690:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790771167.127694:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127700:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.127701:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 54 cancel update log [0x240000401:0x3:0x0].42: rc = 0 00010000:00010000:0.0:1790771167.127705:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f3ad lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.127709:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:14636:x1877759534072064:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 1400us (2069us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.127730:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.127734:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6578 00000004:00080000:0.0:1790771167.127736:0:7768:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8bfc342610c0 version 87 rpc_version 87 00010000:00010000:1.0:1790771167.127743:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.127749:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.127751:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1790771167.127756:0:7768:0:(genops.c:2427:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1790771167.127757:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790771167.127758:0:6525:0:(update_trans.c:1312:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 54 cancel update log [0x200000400:0x3:0x0].42: rc = 0 00000100:00100000:0.0:1790771167.127766:0:7768:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8bfb064aed80 x1877759539788160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00080000:3.0:1790771167.127770:0:6525:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 54 00010000:00010000:1.0:1790771167.127778:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfb03218400) 00010000:00010000:1.0:1790771167.127781:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.127784:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.127786:0:7768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb064aed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539788160:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1790771167.127796:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f589 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.127819:0:7768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.127839:0:7768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.127847:0:6498:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539788160 00000100:00100000:1.0:1790771167.127853:0:6498:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539788160 00000100:00100000:1.0:1790771167.127888:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:1.0:1790771167.127896:0:6498:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7768:x1877759539788160:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1790771167.127970:0:6498:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7768:x1877759539788160:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (151us total) trans 4294968899 rc 0/0 00000100:00100000:1.0:1790771167.127976:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1790771167.128003:0:7768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb064aed80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7768:1877759539788160:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1790771167.135925:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.135960:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534065408 00000100:00100000:3.0:1790771167.135966:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.135968:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534065408 00000100:00100000:3.0:1790771167.135997:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.136005:0:6481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb05a0dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6481:1877759539783296:192.168.204.50@tcp:105: 00000100:00100000:1.0:1790771167.136007:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6579 00000100:00100000:1.0:1790771167.136020:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14621:x1877759534065408:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771167.136028:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.136032:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.136039:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072448 00010000:00010000:1.0:1790771167.136045:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0f5ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36675 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.136046:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072448 00000100:00100000:0.0:1790771167.136063:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534065792:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 27134us (27243us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.136064:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8409:1877759539785216:192.168.204.50@tcp:104: 00002000:00010000:2.0:1790771167.136075:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/20 (7990->18446744073709551615) 00000100:00100000:0.0:1790771167.136078:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1805 00010000:00010000:1.0:1790771167.136083:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771167.136085:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc29014e00 with x1877759534072448 ext(7990->18446744073709551615) 00010000:00010000:3.0:1790771167.136088:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.136101:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc29014e00. 00010000:00010000:1.0:1790771167.136102:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136122:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.136130:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 460 00010000:00010000:1.0:1790771167.136134:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136141:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.136143:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759534072448:12345-192.168.204.50@tcp:10:truncate.0 00010000:00010000:1.0:1790771167.136153:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.136188:0:13781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb069ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:13781:1877759539785344:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.136190:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072832 00000100:00100000:3.0:1790771167.136196:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072832 00010000:00010000:0.0:1790771167.136205:0:13781:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136208:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.136227:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1717 00000100:00100000:3.0:1790771167.136238:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14868:x1877759534072832:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:1.0:1790771167.136242:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136252:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.136279:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790771167.136283:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771167.136296:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136304:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136313:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136320:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136327:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.136334:0:8412:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb size from disk: 5 -> 7990 00010000:00010000:1.0:1790771167.136335:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.136343:0:8412:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00010000:00010000:1.0:1790771167.136349:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:2.0:1790771167.136350:0:8412:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1790771167.136355:0:8412:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00010000:00010000:1.0:1790771167.136356:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.136360:0:8412:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x14:0x0] updating lvb blocks from disk: 8 -> 8 00010000:00010000:1.0:1790771167.136367:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136376:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.136379:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.136382:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136391:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f5b3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136399:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136404:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136412:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.136412:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759534072448:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 270us (442us total) trans 4294967643 rc 0/0 00010000:00010000:1.0:1790771167.136423:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.136428:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.136433:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 460 00010000:00010000:1.0:1790771167.136437:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.136438:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14868:x1877759534072832:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 199us (437us total) trans 4294969485 rc 0/0 00002000:00010000:2.0:1790771167.136441:0:8412:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/20 (7990->18446744073709551615) 00002000:00100000:2.0:1790771167.136450:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc29014e00 with x1877759534072448 ext(7990->18446744073709551615) 00010000:00010000:1.0:1790771167.136458:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd6e9df9d (ffff8bfb03218e00) 00000100:00100000:3.0:1790771167.136458:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1717 00002000:00010000:2.0:1790771167.136459:0:8412:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc29014e00. 00010000:00010000:1.0:1790771167.136465:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.136469:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136474:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f5ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136532:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0f5ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 129 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136546:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.136555:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.136558:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.136561:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996000, rc 0) 00000100:00100000:1.0:1790771167.136593:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14621:x1877759534065408:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 576us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.136599:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6579 00000100:00100000:0.0:1790771167.136619:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.136670:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073216 00000100:00100000:3.0:1790771167.136674:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073216 00000100:00100000:0.0:1790771167.136714:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.136730:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1718 00000100:00100000:1.0:1790771167.136740:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:12239:x1877759534073216:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771167.136746:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069376 00000100:00100000:2.0:1790771167.136753:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069376 00000100:00100000:2.0:1790771167.136795:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6580 00000100:00100000:2.0:1790771167.136807:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14849:x1877759534069376:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771167.136819:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.136833:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f5c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366d0 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.136847:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:12239:x1877759534073216:12345-192.168.204.50@tcp:35:ls.0 Request processed in 106us (226us total) trans 4294968900 rc 0/0 00000100:00100000:1.0:1790771167.136857:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1718 00010000:00010000:2.0:1790771167.136872:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136885:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136895:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136910:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136918:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136925:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136972:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136980:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.136988:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.137010:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x8e:0x0]: returning size 9437 00000004:00200000:2.0:1790771167.137013:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771167.137023:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137031:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137039:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137045:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137051:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137057:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137063:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.137066:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137073:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137082:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.137084:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.137088:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137094:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f5cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137103:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137108:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137114:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137119:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.137122:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137127:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137134:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc310f1b00) 00010000:00010000:2.0:1790771167.137137:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.137139:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137149:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f5d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137169:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f5c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d0 expref: 130 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137179:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d0 expref: 129 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.137187:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:2.0:1790771167.137189:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.137191:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592800, rc 0) 00000100:00100000:2.0:1790771167.137225:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14849:x1877759534069376:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 422us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.137232:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6580 00000100:00100000:0.0:1790771167.148043:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.148088:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148098:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072960 00000100:00100000:2.0:1790771167.148106:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072960 00000100:00100000:0.0:1790771167.148122:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.148139:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073600 00000100:00100000:1.0:1790771167.148144:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073600 00000100:00100000:2.0:1790771167.148161:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073344 00000100:00100000:0.0:1790771167.148167:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148169:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073344 00000100:00100000:1.0:1790771167.148184:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 914 00010000:00010000:2.0:1790771167.148195:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 30 pid: 13788 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148197:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:2396:x1877759534072960:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.148214:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.148238:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1809 00010000:00010000:1.0:1790771167.148243:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f416 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3663d expref: 130 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.148244:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148256:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2396:x1877759534073344:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.148259:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.148264:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.148268:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.148270:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073984 00000100:00100000:0.0:1790771167.148276:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073984 00010000:00010000:2.0:1790771167.148278:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x60000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 30 pid: 13788 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148294:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2396:x1877759534072960:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 100us (252us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.148298:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x50000400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 30 pid: 13788 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148306:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 914 00000100:00100000:0.0:1790771167.148314:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1719 00000100:00100000:0.0:1790771167.148327:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13739:x1877759534073984:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771167.148330:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008730e8f9/0xfa0c505d97f0b5be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 10485760->10551295) gid 0 flags: 0x44801400030020 nid: 192.168.204.50@tcp remote: 0x61116bf958e351d7 expref: 30 pid: 13788 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148337:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 915 00000100:00100000:1.0:1790771167.148353:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2396:x1877759534073600:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.148355:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(6 2) 00010000:00010000:2.0:1790771167.148364:0:6480:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(6 2) 00010000:00010000:1.0:1790771167.148369:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.148371:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.148386:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f432 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3664b expref: 128 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148387:0:6480:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.148408:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.148412:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.148427:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.148433:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2396:x1877759534073600:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 85us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.148439:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 915 00000100:00100000:0.0:1790771167.148446:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:13739:x1877759534073984:12345-192.168.204.50@tcp:35:ls.0 Request processed in 120us (206us total) trans 4294968901 rc 0/0 00000100:00100000:0.0:1790771167.148454:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1719 00000100:00100000:2.0:1790771167.148464:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2396:x1877759534073344:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 211us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.148475:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1809 00000100:00100000:0.0:1790771167.148528:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148546:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077568 00000100:00100000:2.0:1790771167.148552:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077568 00000100:00100000:1.0:1790771167.148557:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148590:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077056 00000100:00100000:2.0:1790771167.148595:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077056 00000100:00100000:1.0:1790771167.148597:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6581 00000100:00100000:0.0:1790771167.148601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.148610:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+106:13293:x1877759534077568:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.148624:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.148631:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148634:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534074368 00010000:00010000:1.0:1790771167.148636:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0f5e4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36732 expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.148639:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534074368 00000100:00100000:0.0:1790771167.148677:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.148702:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6582 00000100:00100000:0.0:1790771167.148709:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6583 00000004:00200000:1.0:1790771167.148711:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5d:0x0]: returning size 4096 00000100:00100000:2.0:1790771167.148716:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:14713:x1877759534077056:12345-192.168.204.50@tcp:101:file_concat.sh.0 00000100:00100000:0.0:1790771167.148723:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14511:x1877759534074368:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.148731:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.148734:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.148747:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f5f2 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3672b expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148748:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f5f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36708 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.148764:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0f5e4 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36732 expref: 109 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.148777:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x3b:0x0].0x0 (ffff8bfc2008de00) 00010000:00010000:1.0:1790771167.148779:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.148783:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996800/0xfa0c505d97f0f5e4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x3b:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36732 expref: 110 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.148796:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3f996800, rc 0) 00010000:00010000:0.0:1790771167.148799:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148810:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148818:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148826:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0562f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13293:x1877759534077568:12345-192.168.204.50@tcp:101:ls.0 Request processed in 217us (659us total) trans 4294969486 rc 301/301 00010000:00010000:0.0:1790771167.148836:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148837:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6581 00010000:00010000:2.0:1790771167.148843:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148848:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148860:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148861:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148877:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148885:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148892:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148897:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148897:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148911:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.148919:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148923:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148926:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.148932:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.148938:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148940:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148954:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.148962:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.148966:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.148970:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148975:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597600/0xfa0c505d97f0f600 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.148976:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534074624 00000100:00100000:1.0:1790771167.148981:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534074624 00010000:00010000:0.0:1790771167.148987:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148993:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.148998:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149002:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0f61c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149004:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06596a00 already unused, calling callback (ffffffffc18aa4f0) 00002000:00100000:1.0:1790771167.149004:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (610304->614399) req@ffff8bfb0305f480 x1877759534074624/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771167.149011:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.149026:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:13666:x1877759534070016:12345-192.168.204.50@tcp:37:ls.0 Request processed in 25718us (25836us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.149030:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0f61c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149031:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771167.149040:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0305f480 with x1877759534074624 ext(610304->614399) 00002000:00010000:1.0:1790771167.149049:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0305f480 00000100:00100000:3.0:1790771167.149051:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1713 00010000:00010000:0.0:1790771167.149057:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x7a94fdef (ffff8bfc03c5e700) 00010000:00010000:0.0:1790771167.149061:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.149061:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0f61c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149064:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.149069:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072576 00000100:00100000:1.0:1790771167.149073:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072576 00000100:00100000:3.0:1790771167.149076:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534074240 00010000:00010000:0.0:1790771167.149082:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596a00/0xfa0c505d97f0f607 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.149083:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534074240 00002000:00010000:1.0:1790771167.149084:0:13795:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/14 (0->18446744073709551615) 00000004:00200000:2.0:1790771167.149084:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x6e:0x0]: returning size 14368 00002000:00100000:1.0:1790771167.149093:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1fb100 with x1877759534072576 ext(0->18446744073709551615) 00002000:00010000:1.0:1790771167.149100:0:13795:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc2d1fb100. 00000100:00100000:3.0:1790771167.149118:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1720 00010000:00010000:0.0:1790771167.149120:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f5f9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36708 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.149124:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 461 00000100:00100000:3.0:1790771167.149133:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14004:x1877759534074240:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.149139:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759534074624:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771167.149139:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149167:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 2/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149168:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:0.0:1790771167.149175:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.149183:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06597200/0xfa0c505d97f0f5f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36708 expref: 109 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149183:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149204:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.149209:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149210:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06597200, rc 0) 00010000:00010000:2.0:1790771167.149221:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.149227:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14004:x1877759534074240:12345-192.168.204.50@tcp:35:ls.0 Request processed in 96us (699us total) trans 4294969487 rc 0/0 00010000:00010000:2.0:1790771167.149238:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:3.0:1790771167.149239:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1720 00000100:00100000:0.0:1790771167.149247:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb056cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14511:x1877759534074368:12345-192.168.204.50@tcp:101:rm.0 Request processed in 526us (649us total) trans 0 rc 301/301 00010000:00010000:2.0:1790771167.149247:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.149255:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.149259:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6583 00010000:00010000:2.0:1790771167.149269:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f60e lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.149279:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2397:x1877759534074624:12345-192.168.204.50@tcp:3:cat.0 Request processed in 141us (598us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.149280:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149284:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.149291:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 461 00002000:00100000:1.0:1790771167.149301:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (610304->614399) req@ffff8bfb0305f480 x1877759534074624/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1790771167.149306:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.149308:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 462 00010000:00010000:2.0:1790771167.149309:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.149327:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2399:x1877759534072576:12345-192.168.204.50@tcp:10:cp.0 00010000:00010000:2.0:1790771167.149337:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.149355:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771167.149369:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0305f480 with x1877759534074624 ext(610304->614399) 00002000:00010000:1.0:1790771167.149377:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0305f480 00010000:00010000:3.0:1790771167.149383:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149385:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.149395:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149404:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.149410:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771167.149414:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771167.149414:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xd964d85e (ffff8bfc310f1b00) 00010000:00010000:1.0:1790771167.149422:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149422:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.149427:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149435:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc00031600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:1.0:1790771167.149440:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.149440:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f615 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149464:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149477:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149499:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000733a0530/0xfa0c505d97f0f45c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149521:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.149525:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.149528:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.149530:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f5f2 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3672b expref: 52 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.149552:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3db7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539784192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37070us (37319us total) trans 4294967654 rc 0/0 00002000:00010000:0.0:1790771167.149553:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 9314 -> 0 00010000:00010000:2.0:1790771167.149554:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593000/0xfa0c505d97f0f61c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x6e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3672b expref: 51 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.149563:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00000100:00100000:1.0:1790771167.149570:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.149572:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00002000:00010000:0.0:1790771167.149573:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:0.0:1790771167.149581:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00010000:00010000:2.0:1790771167.149584:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x6e:0x0].0x0 (ffff8bfc22108900) 00002000:00010000:0.0:1790771167.149585:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 56 -> 0 00010000:00010000:2.0:1790771167.149592:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.149596:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593000, rc 0) 00000100:00100000:0.0:1790771167.149619:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534072576:12345-192.168.204.50@tcp:10:cp.0 Request processed in 297us (668us total) trans 4294967644 rc 0/0 00000100:00100000:0.0:1790771167.149626:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 462 00002000:00010000:0.0:1790771167.149631:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/14 (0->18446744073709551615) 00002000:00100000:0.0:1790771167.149635:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d1fb100 with x1877759534072576 ext(0->18446744073709551615) 00000100:00100000:2.0:1790771167.149639:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:14713:x1877759534077056:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 924us (1081us total) trans 4294968902 rc 0/0 00000100:00100000:1.0:1790771167.149640:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771167.149643:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc2d1fb100. 00000100:00100000:2.0:1790771167.149671:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6582 00000100:00100000:1.0:1790771167.149704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.149717:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534074752 00000004:00080000:0.0:1790771167.149723:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb057b0380/2, rc 0, transno 4294967654 00000100:00100000:2.0:1790771167.149725:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534074752 00000100:00100000:0.0:1790771167.149739:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb057b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784192:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790771167.149749:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.149766:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534074496 00000100:00100000:2.0:1790771167.149767:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534072320 00000100:00100000:0.0:1790771167.149771:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534074496 00000100:00100000:2.0:1790771167.149773:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534072320 00000100:00100000:3.0:1790771167.149773:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1085 00000100:00100000:1.0:1790771167.149775:0:13765:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534066688 00000100:00100000:1.0:1790771167.149781:0:13765:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534066688 00000100:00100000:3.0:1790771167.149789:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:14958:x1877759534074752:12345-192.168.204.50@tcp:101:truncate.0 00010000:00010000:0.0:1790771167.149794:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.149800:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.149812:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3670f expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.149818:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6584 00000100:00100000:0.0:1790771167.149821:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073728 00000100:00100000:2.0:1790771167.149823:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1086 00000100:00100000:0.0:1790771167.149827:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073728 00000100:00100000:1.0:1790771167.149836:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15018:x1877759534066688:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:3.0:1790771167.149842:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 25 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.149844:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534072320:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771167.149853:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534073472 00000100:00100000:0.0:1790771167.149857:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534073472 00010000:00010000:1.0:1790771167.149857:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.149861:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x23:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1790771167.149867:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(2 0) 00010000:00010000:3.0:1790771167.149873:0:8409:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3670f expref: 21 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149878:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f631 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36683 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149879:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 28 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.149914:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1810 00000100:00100000:0.0:1790771167.149923:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2397:x1877759534074496:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.149932:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149933:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.149935:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.149944:0:13784:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 0 -> 80 00002000:00010000:2.0:1790771167.149945:0:13793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790771167.149955:0:13793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1674053537 00010000:00010000:0.0:1790771167.149957:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.149958:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.149961:0:13793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb atime from disk: 0 -> 1752421453 00010000:00010000:3.0:1790771167.149961:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.149972:0:13793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1790771167 00002000:00010000:2.0:1790771167.149981:0:13793:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1790771167.149983:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.149991:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.149998:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29014380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539788288:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.150006:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150013:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.150014:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c84301a0/0xfa0c505d97f0c7df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35779 expref: 29 pid: 13781 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.150022:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534072320:12345-192.168.204.50@tcp:2:cp.0 Request processed in 182us (383us total) trans 4294967645 rc 0/0 00010000:00010000:1.0:1790771167.150033:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.150045:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(7 1) 00000100:00100000:2.0:1790771167.150045:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1086 00010000:00010000:0.0:1790771167.150052:0:13784:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(7 1) 00000100:00100000:3.0:1790771167.150058:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7480 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.150060:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365fe expref: 28 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.150070:0:13784:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365fe expref: 28 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150076:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150084:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150089:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1811 00010000:00010000:0.0:1790771167.150094:0:13784:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000041a7879e/0xfa0c505d97f0f2f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->28671) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365fe expref: 28 pid: 13796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150105:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+28:2399:x1877759534073472:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.150107:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.150108:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 916 00010000:00010000:3.0:1790771167.150122:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.150127:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:2399:x1877759534073728:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.150131:0:13784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0305c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539788416:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771167.150132:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 28 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.150137:0:13765:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x8c:0x0]: returning size 0 00000004:00200000:1.0:1790771167.150144:0:13765:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.150145:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.150155:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 28 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.150158:0:13765:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.150166:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f401 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36636 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150169:0:13784:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e600 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.150177:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150179:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b2c6f9c/0xfa0c505d97f0aaa4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d0e expref: 28 pid: 13786 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.150195:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.150203:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.150205:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.150207:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790771167.150215:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790771167.150222:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150223:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.150239:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2399:x1877759534073728:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 113us (671us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.150245:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150246:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.150250:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150263:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3f996e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.150266:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 916 00010000:00010000:1.0:1790771167.150269:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150278:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.150292:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150297:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.150303:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfb03218e00) 00000100:00100000:2.0:1790771167.150304:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075008 00010000:00010000:0.0:1790771167.150308:0:13781:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150311:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.150311:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075008 00010000:00010000:1.0:1790771167.150321:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150321:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+27:2399:x1877759534073472:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 216us (613us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.150331:0:13781:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150338:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1811 00000100:00100000:2.0:1790771167.150345:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075136 00000100:00100000:2.0:1790771167.150353:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075136 00010000:00010000:0.0:1790771167.150359:0:13781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150361:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996e00/0xfa0c505d97f0f638 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.150381:0:13781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150387:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.150394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6585 00010000:00010000:0.0:1790771167.150395:0:13781:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790771167.150397:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150406:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6586 00010000:00010000:1.0:1790771167.150409:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.150412:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14524:x1877759534075008:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771167.150417:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.150423:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150424:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14538:x1877759534075136:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:1.0:1790771167.150436:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150440:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.150445:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xf7a5b27a (ffff8bfb03218400) 00010000:00010000:1.0:1790771167.150449:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.150454:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150454:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36716 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.150469:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f63f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150481:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb069e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3626:x1877759539784320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 37738us (38122us total) trans 4294967655 rc 0/0 00010000:00010000:3.0:1790771167.150507:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 130 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150523:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00010000:00010000:1.0:1790771167.150525:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996400/0xfa0c505d97f0f631 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36683 expref: 130 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150525:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 130 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.150549:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771167.150557:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.150559:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14524:x1877759534075008:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 148us (315us total) trans 0 rc -17/-17 00010000:00010000:3.0:1790771167.150561:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80200, rc 0) 00000004:00080000:0.0:1790771167.150566:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8bfb0566df80/2, rc 0, transno 4294967655 00000100:00100000:2.0:1790771167.150574:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6585 00010000:00010000:1.0:1790771167.150579:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36683 expref: 129 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150581:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3626:1877759539784320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790771167.150587:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14538:x1877759534075136:12345-192.168.204.50@tcp:101:cat.0 Request processed in 165us (305us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.150601:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc20109a00) 00000100:00100000:3.0:1790771167.150605:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6586 00010000:00010000:1.0:1790771167.150606:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.150611:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06391e00, rc 0) 00010000:00010000:2.0:1790771167.150617:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771167.150625:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.150635:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc0c80ac0) 00000100:00100000:1.0:1790771167.150636:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15018:x1877759534066688:12345-192.168.204.50@tcp:101:rm.0 Request processed in 805us (887us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.150643:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.150660:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.150667:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6584 00010000:00010000:2.0:1790771167.150679:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150691:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075264 00010000:00010000:2.0:1790771167.150696:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.150698:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075264 00000100:00100000:0.0:1790771167.150707:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.150716:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ece23234/0xfa0c505d97f0f463 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.150720:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:3.0:1790771167.150726:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb61500 with x1877759534075264 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771167.150735:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb61500. 00010000:00010000:2.0:1790771167.150739:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.150744:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771167.150745:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075520 00010000:00010000:2.0:1790771167.150749:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790771167.150751:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075520 00000100:00100000:3.0:1790771167.150767:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 463 00000100:00100000:3.0:1790771167.150775:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+29:2398:x1877759534075264:12345-192.168.204.50@tcp:10:dd.0 00000100:00100000:1.0:1790771167.150785:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6587 00000100:00100000:1.0:1790771167.150794:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:15165:x1877759534075520:12345-192.168.204.50@tcp:36:ln.0 00000100:00100000:2.0:1790771167.150812:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.150875:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.150882:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:15165:x1877759534075520:12345-192.168.204.50@tcp:36:ln.0 Request processed in 85us (175us total) trans 0 rc -17/-17 00000100:00100000:1.0:1790771167.150893:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6587 00000100:00100000:2.0:1790771167.150904:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075776 00000100:00100000:2.0:1790771167.150910:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075776 00000100:00100000:1.0:1790771167.150913:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534075648 00000100:00100000:1.0:1790771167.150918:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534075648 00000100:00100000:2.0:1790771167.150949:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 917 00000100:00100000:1.0:1790771167.150951:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6588 00000100:00100000:1.0:1790771167.150969:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14512:x1877759534075648:12345-192.168.204.50@tcp:101:rm.0 00000100:00100000:2.0:1790771167.150970:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2397:x1877759534075776:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.150978:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.150984:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.150991:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f654 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3671d expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.151001:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f4c5 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3668a expref: 105 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.151019:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.151021:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 3/1,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.151024:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.151032:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151039:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.151047:0:8413:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb size from disk: 131072 -> 0 00000100:00100000:2.0:1790771167.151049:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:2397:x1877759534075776:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 88us (172us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.151051:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.151055:0:8413:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb mtime from disk: 1790771165 -> 1790771167 00002000:00010000:3.0:1790771167.151064:0:8413:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:1.0:1790771167.151071:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.151072:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 917 00002000:00010000:3.0:1790771167.151072:0:8413:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb ctime from disk: 1790771166 -> 1790771167 00002000:00010000:3.0:1790771167.151080:0:8413:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000400:0x2:0x0] updating lvb blocks from disk: 256 -> 0 00010000:00010000:1.0:1790771167.151085:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151104:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2398:x1877759534075264:12345-192.168.204.50@tcp:10:dd.0 Request processed in 330us (465us total) trans 4294967656 rc 0/0 00000100:00100000:3.0:1790771167.151111:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 463 00002000:00010000:3.0:1790771167.151114:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161088/2 (0->18446744073709551615) 00002000:00100000:3.0:1790771167.151117:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fb61500 with x1877759534075264 ext(0->18446744073709551615) 00002000:00010000:3.0:1790771167.151122:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fb61500. 00010000:00010000:1.0:1790771167.151125:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151132:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151138:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.151155:0:13773:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x22:0x0]: returning size 19639 00000100:00100000:2.0:1790771167.151157:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771167.151158:0:13773:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790771167.151169:0:13773:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151177:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151181:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076160 00000100:00100000:3.0:1790771167.151187:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076160 00010000:00010000:1.0:1790771167.151194:0:13773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151203:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151211:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151214:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1721 00010000:00010000:1.0:1790771167.151226:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151229:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14616:x1877759534076160:12345-192.168.204.50@tcp:35:cp.0 00000100:00100000:2.0:1790771167.151230:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.151244:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.151247:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151253:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151262:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb03218900) 00010000:00010000:1.0:1790771167.151264:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.151267:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 3/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151272:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f65b lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151283:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151287:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151293:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151298:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.151301:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151307:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151317:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0xd6e9df9d (ffff8bfb03218200) 00010000:00010000:1.0:1790771167.151320:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.151324:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151331:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f662 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13773 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151361:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14616:x1877759534076160:12345-192.168.204.50@tcp:35:cp.0 Request processed in 137us (206us total) trans 4294969488 rc 0/0 00010000:00010000:1.0:1790771167.151368:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f654 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3671d expref: 104 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151373:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1721 00000100:00100000:2.0:1790771167.151374:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539787392:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.151398:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076032 00010000:00010000:1.0:1790771167.151400:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3671d expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.151401:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076032 00010000:00010000:1.0:1790771167.151410:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x22:0x0].0x0 (ffff8bfb03188300) 00010000:00010000:1.0:1790771167.151413:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.151416:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82c00, rc 0) 00000100:00100000:3.0:1790771167.151429:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1722 00000100:00100000:0.0:1790771167.151437:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13265:x1877759534071936:12345-192.168.204.50@tcp:37:ls.0 Request processed in 25421us (25949us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.151442:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14512:x1877759534075648:12345-192.168.204.50@tcp:101:rm.0 Request processed in 479us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.151443:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+51:13887:x1877759534076032:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:0.0:1790771167.151456:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1716 00000100:00100000:2.0:1790771167.151458:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.151469:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6588 00000100:00100000:1.0:1790771167.151518:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069120 00000100:00100000:1.0:1790771167.151523:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069120 00000100:00100000:1.0:1790771167.151569:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6589 00000100:00100000:2.0:1790771167.151570:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.151580:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:13885:x1877759534069120:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.151589:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.151599:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366c9 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151615:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 53 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151623:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 53 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151628:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.151630:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.151634:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83c00, rc 0) 00000100:00100000:2.0:1790771167.151639:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.151676:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:13885:x1877759534069120:12345-192.168.204.50@tcp:101:ls.0 Request processed in 99us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.151683:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6589 00000100:00100000:0.0:1790771167.151698:0:6508:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076672 00000100:00100000:1.0:1790771167.151698:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069504 00000100:00100000:1.0:1790771167.151703:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069504 00000100:00100000:0.0:1790771167.151705:0:6508:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076672 00000100:00100000:1.0:1790771167.151732:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6590 00000100:00100000:1.0:1790771167.151741:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14064:x1877759534069504:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.151748:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.151749:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1790771167.151751:0:13772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f918380 pname:cluuid:pid:xid:nid:opc:job mdt00_017:lustre-MDT0001_UUID:13772:1877759539787136:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.151756:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366d7 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.151765:0:6508:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14707:x1877759534076672:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:1.0:1790771167.151779:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.151779:0:13772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151787:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771167.151803:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06a02800/0xfa0c505d97f0adde lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34dcb expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.151807:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151820:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:1.0:1790771167.151822:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.151827:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.151831:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82e00, rc 0) 00010000:00010000:0.0:1790771167.151833:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597000/0xfa0c505d97f0f582 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366fa expref: 102 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151842:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771167.151845:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.151859:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.151861:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14064:x1877759534069504:12345-192.168.204.50@tcp:101:ls.0 Request processed in 120us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.151864:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.151882:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.151882:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6590 00000100:00100000:2.0:1790771167.151886:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076800 00000100:00100000:2.0:1790771167.151893:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076800 00010000:00010000:0.0:1790771167.151895:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151911:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686800/0xfa0c505d97f0f685 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151916:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686800/0xfa0c505d97f0f685 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151923:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686800/0xfa0c505d97f0f685 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151934:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f68c lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.151939:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6591 00010000:00010000:0.0:1790771167.151945:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f68c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.151954:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f68c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.151955:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:15040:x1877759534076800:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:1.0:1790771167.151965:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.151977:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.151996:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0f693 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36724 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152006:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.152015:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f69a lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152022:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f69a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152028:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f69a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152038:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.152042:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0f693 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36724 expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152054:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6508 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152060:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593800/0xfa0c505d97f0f693 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36724 expref: 109 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152066:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 53 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152074:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.152087:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 54 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152093:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc310f1800) 00010000:00010000:0.0:1790771167.152094:0:6508:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 5/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152102:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790771167.152108:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593800, rc 0) 00000100:00100000:1.0:1790771167.152125:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.152129:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069632 00010000:00010000:0.0:1790771167.152131:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 54 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.152134:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069632 00000100:00100000:2.0:1790771167.152145:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:15040:x1877759534076800:12345-192.168.204.50@tcp:101:cp.0 Request processed in 193us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.152160:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069760 00000100:00100000:2.0:1790771167.152162:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6591 00000100:00100000:3.0:1790771167.152165:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069760 00010000:00010000:0.0:1790771167.152167:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 55 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152168:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.152183:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb62a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6508:1877759539788544:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.152191:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534069888 00000100:00100000:2.0:1790771167.152197:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534069888 00000100:00100000:3.0:1790771167.152202:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6592 00000100:00100000:3.0:1790771167.152211:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:14066:x1877759534069632:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.152220:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.152231:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366de expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152247:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 58 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152248:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6593 00010000:00010000:3.0:1790771167.152256:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 58 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152261:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6594 00010000:00010000:0.0:1790771167.152263:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 58 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152268:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:13891:x1877759534069760:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771167.152277:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:13890:x1877759534069888:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.152289:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.152292:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.152295:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6508:1877759539788672:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.152303:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366ec expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152303:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 2/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e366e5 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152327:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e900 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.152329:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 58 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152343:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 59 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152348:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077312 00000100:00100000:0.0:1790771167.152354:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077312 00010000:00010000:3.0:1790771167.152363:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.152367:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.152369:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c81000, rc 0) 00010000:00010000:1.0:1790771167.152374:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 60 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152379:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077184 00000100:00100000:0.0:1790771167.152383:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077184 00010000:00010000:1.0:1790771167.152393:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 60 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152395:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 60 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.152395:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:14066:x1877759534069632:12345-192.168.204.50@tcp:101:ls.0 Request processed in 182us (432us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.152397:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 102 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152420:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.152427:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.152430:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83200, rc 0) 00000100:00100000:0.0:1790771167.152431:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077824 00010000:00010000:2.0:1790771167.152431:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:0.0:1790771167.152435:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077824 00010000:00010000:2.0:1790771167.152437:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.152442:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3800, rc 0) 00000100:00100000:1.0:1790771167.152455:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06192300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+60:13890:x1877759534069888:12345-192.168.204.50@tcp:101:ls.0 Request processed in 181us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.152460:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1812 00000100:00100000:3.0:1790771167.152464:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6592 00000100:00100000:1.0:1790771167.152473:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6594 00000100:00100000:0.0:1790771167.152474:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:2397:x1877759534077184:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.152479:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+59:13891:x1877759534069760:12345-192.168.204.50@tcp:101:ls.0 Request processed in 214us (471us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.152509:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.152517:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 102 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152522:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6593 00010000:00010000:0.0:1790771167.152540:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 102 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.152541:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539787264:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.152553:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.152564:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152566:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 918 00010000:00010000:0.0:1790771167.152573:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0e2ea lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36166 expref: 102 pid: 6494 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152582:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534078080 00000100:00100000:2.0:1790771167.152585:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534077312:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.152586:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:1.0:1790771167.152587:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534078080 00010000:00010000:0.0:1790771167.152595:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152601:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.152602:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.152618:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.152618:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.152620:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6595 00010000:00010000:2.0:1790771167.152625:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f597 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36667 expref: 128 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.152634:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14738:x1877759534078080:12345-192.168.204.50@tcp:101:mrename.0 00000100:00100000:3.0:1790771167.152643:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534078208 00000100:00100000:0.0:1790771167.152644:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:2397:x1877759534077184:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 173us (517us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.152663:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.152663:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00000100:00100000:3.0:1790771167.152666:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534078208 00010000:00010000:2.0:1790771167.152673:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.152675:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f6bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36739 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152678:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1812 00000100:00100000:2.0:1790771167.152701:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534077312:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 119us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.152704:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6596 00000100:00100000:0.0:1790771167.152705:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 919 00010000:00010000:1.0:1790771167.152707:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152727:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534077824:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.152727:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 918 00010000:00010000:1.0:1790771167.152728:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.152728:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14621:x1877759534078208:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:0.0:1790771167.152744:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.152752:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152752:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.152760:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f5a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36660 expref: 127 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152765:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f6cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36740 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152770:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.152771:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:0.0:1790771167.152779:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.152784:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152791:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152796:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.152800:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2397:x1877759534077824:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 81us (638us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.152802:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152818:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 919 00010000:00010000:3.0:1790771167.152820:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152829:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152840:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152840:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.152847:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152857:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152860:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152877:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152879:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.152904:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.152914:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.152915:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152923:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152928:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.152935:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f6ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152939:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152956:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.152960:0:13792:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534078720 00010000:00010000:3.0:1790771167.152960:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152961:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152966:0:13792:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534078720 00000100:00100000:2.0:1790771167.152979:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.152981:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.152982:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.152996:0:13792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 41 00000100:00100000:2.0:1790771167.153003:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076416 00010000:00010000:1.0:1790771167.153005:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00000100:00100000:0.0:1790771167.153009:0:13792:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:14849:x1877759534078720:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:1.0:1790771167.153010:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.153011:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076416 00000004:00200000:3.0:1790771167.153012:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x63:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.153015:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.153020:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.153027:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f6c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153033:0:13792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 14 locks, starting at 0 00010000:00010000:1.0:1790771167.153037:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153042:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 58 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.153042:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f6ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153044:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153049:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0f367 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x8e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365bf expref: 127 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153069:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153073:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153085:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f5dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d0 expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153087:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc05d60200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.153091:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077952 00010000:00010000:3.0:1790771167.153092:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153093:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.153099:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077952 00010000:00010000:3.0:1790771167.153116:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153130:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.153133:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1813 00010000:00010000:3.0:1790771167.153134:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153143:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f003 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e364d1 expref: 126 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153146:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.153147:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xf7a5b27a (ffff8bfb03218b00) 00000100:00100000:2.0:1790771167.153153:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+58:2398:x1877759534076416:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.153153:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153154:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.153159:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153171:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:2.0:1790771167.153173:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.153176:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153182:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f6d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153186:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 4/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 58 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153189:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771167.153195:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05ef4600/0xfa0c505d97f0e91f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3630a expref: 125 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153197:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.153203:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153218:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 58 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153221:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f6bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36739 expref: 111 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153222:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f6d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153227:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:0.0:1790771167.153249:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594800/0xfa0c505d97f0f199 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3656b expref: 124 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153253:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0b2ca lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35048 expref: 58 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153256:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153258:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36739 expref: 110 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153269:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594600/0xfa0c505d97f0f0a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36541 expref: 123 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153283:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.153286:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:2.0:1790771167.153291:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771167.153294:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.153299:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3ab200, rc 0) 00010000:00010000:2.0:1790771167.153306:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153306:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153307:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f1a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36572 expref: 122 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153325:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.153328:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14738:x1877759534078080:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 694us (778us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.153331:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153336:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153346:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0f0c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36548 expref: 121 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.153352:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6595 00010000:00010000:3.0:1790771167.153352:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153363:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153379:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1d91fb2c (ffff8bfb02b20400) 00010000:00010000:0.0:1790771167.153384:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06594a00/0xfa0c505d97f0f1a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36579 expref: 120 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153384:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.153390:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153393:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.153397:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f6e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153403:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f0ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3654f expref: 119 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153428:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f10d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36556 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.153428:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.153431:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:2398:x1877759534076416:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 278us (590us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.153431:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f6cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36740 expref: 119 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.153456:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1813 00010000:00010000:0.0:1790771167.153465:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36564 expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153472:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78000/0xfa0c505d97f0f6ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36740 expref: 117 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153480:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfb02b20100) 00000100:00100000:2.0:1790771167.153481:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534076288 00010000:00010000:3.0:1790771167.153505:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.153508:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78000, rc 0) 00010000:00010000:0.0:1790771167.153511:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06595e00/0xfa0c505d97f0f16f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3655d expref: 116 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.153517:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.153521:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534076288 00000100:00100000:3.0:1790771167.153537:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:14621:x1877759534078208:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 818us (921us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.153544:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596000/0xfa0c505d97f0f1d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36580 expref: 115 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153546:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 110 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.153553:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6596 00010000:00010000:0.0:1790771167.153574:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.153579:0:13792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.153594:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.153596:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1814 00010000:00010000:0.0:1790771167.153606:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.153611:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 920 00000100:00100000:3.0:1790771167.153615:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:2398:x1877759534076288:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.153623:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153630:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.153631:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:2398:x1877759534077952:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.153643:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153643:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 110 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153660:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.153666:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534077696 00000100:00100000:1.0:1790771167.153672:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534077696 00010000:00010000:0.0:1790771167.153676:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153679:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f551 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36659 expref: 113 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153690:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 110 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.153701:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1087 00010000:00010000:0.0:1790771167.153705:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.153712:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+30:2398:x1877759534077696:12345-192.168.204.50@tcp:16:fallocate.0 00010000:00010000:2.0:1790771167.153713:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771167.153720:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.153721:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153729:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153734:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153758:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06596c00/0xfa0c505d97f0cccb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3590f expref: 110 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.153764:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:2398:x1877759534077952:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 136us (788us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.153772:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00000100:00100000:2.0:1790771167.153777:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 920 00010000:00010000:3.0:1790771167.153779:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153781:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153800:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153802:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153810:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153811:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153822:0:13772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153828:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153835:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153840:0:13792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 109 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153851:0:13792:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153867:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153876:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 2/0,0 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.153881:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.153882:0:13792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 109 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153890:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.153896:0:13792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 109 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.153905:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.153911:0:13792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539788800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.153912:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 3/0,0 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.153919:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:2398:x1877759534076288:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 308us (494us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.153931:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 4/0,0 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.153931:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1814 00010000:00010000:2.0:1790771167.153946:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771167.153950:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1790771167.153953:0:13792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3ecc0 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.153955:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 2/0,0 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.153956:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534078592 00000100:00100000:3.0:1790771167.153961:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534078592 00010000:00010000:2.0:1790771167.153968:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f566 lrc: 0/0,0 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.154002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1723 00000100:00100000:0.0:1790771167.154012:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:12252:x1877759534078592:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771167.154020:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14757:x1877759534070784:12345-192.168.204.50@tcp:55:cp.0 Request processed in 29799us (29960us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790771167.154030:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6573 00010000:00010000:3.0:1790771167.154097:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.154100:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:12252:x1877759534078592:12345-192.168.204.50@tcp:35:ls.0 Request processed in 90us (1308us total) trans 4294968903 rc 0/0 00010000:00010000:3.0:1790771167.154107:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.154116:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1723 00010000:00010000:3.0:1790771167.154126:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.154133:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.154140:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.154176:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.154242:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.154252:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771167.154423:0:13771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].41, 64 off11392 00010000:00010000:2.0:1790771167.154534:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154546:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154554:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154566:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154572:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154579:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154595:0:13771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771167.154610:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154615:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771167.154619:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154621:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154640:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf3400 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771167.154641:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154644:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154679:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.154680:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154688:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154692:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfb02b20200) 00010000:00010000:0.0:1790771167.154698:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790771167.154703:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154704:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154708:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f726 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x9a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.154723:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.154724:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x9a:0x0].0x0 (ffff8bfb02b20200) 00010000:00010000:0.0:1790771167.154725:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.154728:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.154731:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771167.154736:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 2/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154747:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f71f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x9a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154767:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154776:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154782:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154790:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154795:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.154799:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154805:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154814:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:2.0:1790771167.154816:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.154820:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 3/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154826:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f57b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x7d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.154835:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000093df2294 reply state 00000000c35fa71b transno 4294969489 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154846:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.154852:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0xbc0ca3a9 (ffff8bfb02b20e00) 00010000:00010000:2.0:1790771167.154855:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.154857:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.154899:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:15069:x1877759534070912:12345-192.168.204.50@tcp:36:rm.0 Request processed in 30650us (30816us total) trans 4294969489 rc 0/0 00000100:00100000:2.0:1790771167.154908:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6574 00000001:00080000:0.0:1790771167.154933:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967656 is committed 00000001:00080000:0.0:1790771167.154941:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967655 is committed 00000001:00080000:0.0:1790771167.154949:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967653 is committed 00000100:00100000:1.0:1790771167.155017:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759534077696:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 1307us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.155023:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1087 00000100:00100000:3.0:1790771167.155129:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.155160:0:8676:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534078848 00000100:00100000:1.0:1790771167.155165:0:8676:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534078848 00000100:00100000:1.0:1790771167.155198:0:8676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1088 00000100:00100000:1.0:1790771167.155207:0:8676:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:14803:x1877759534078848:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771167.155217:0:8676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.155228:0:8676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36747 expref: -99 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.155249:0:8676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.155256:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771167.155259:0:8676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790771167.155262:0:8676:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36747 expref: 24 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.155277:0:8676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.155286:0:8676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.155301:0:8676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539788928:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.155348:0:8676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.155800:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:13887:x1877759534076032:12345-192.168.204.50@tcp:37:ls.0 Request processed in 4363us (4579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.155805:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1722 00000100:00100000:3.0:1790771167.156155:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.156186:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079104 00000100:00100000:0.0:1790771167.156192:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079104 00000100:00100000:0.0:1790771167.156225:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1724 00000100:00100000:0.0:1790771167.156233:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:13667:x1877759534079104:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.156325:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:13667:x1877759534079104:12345-192.168.204.50@tcp:35:ls.0 Request processed in 91us (167us total) trans 4294968904 rc 0/0 00000100:00100000:2.0:1790771167.156334:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.156340:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1724 00000100:00100000:0.0:1790771167.156364:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079360 00000100:00100000:0.0:1790771167.156367:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079360 00000100:00100000:0.0:1790771167.156393:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1725 00000100:00100000:0.0:1790771167.156399:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:13293:x1877759534079360:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.156474:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:13293:x1877759534079360:12345-192.168.204.50@tcp:35:ls.0 Request processed in 74us (146us total) trans 4294969490 rc 0/0 00000100:00100000:0.0:1790771167.156480:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1725 00000100:00100000:3.0:1790771167.156715:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.156757:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079488 00000100:00100000:2.0:1790771167.156763:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079488 00000100:00100000:2.0:1790771167.156798:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6597 00000100:00100000:2.0:1790771167.156806:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+110:14511:x1877759534079488:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.156817:0:13761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.156827:0:13761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f734 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3674e expref: -99 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156858:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156868:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156876:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156889:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156896:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156904:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156945:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f749 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156954:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f749 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.156961:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f749 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.156980:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.156984:0:13761:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771167.156994:0:13761:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f749 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157002:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157009:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157016:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157022:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157032:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.157035:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157042:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157051:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.157053:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.157056:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 3/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157062:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f73b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157072:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157079:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157085:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157091:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.157094:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157100:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157113:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc310f1b00) 00010000:00010000:2.0:1790771167.157115:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.157118:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157124:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f742 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157148:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f734 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3674e expref: 112 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157159:0:13761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06390800/0xfa0c505d97f0f749 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3674e expref: 111 pid: 13761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.157167:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:2.0:1790771167.157170:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.157173:0:13761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06390800, rc 0) 00000100:00100000:2.0:1790771167.157207:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14511:x1877759534079488:12345-192.168.204.50@tcp:101:rm.0 Request processed in 401us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.157214:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6597 00000100:00100000:3.0:1790771167.159771:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.159785:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29014380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8409:1877759539788288:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.159799:0:13784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_007:lustre-OST0001_UUID:13784:1877759539788416:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771167.159799:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.159808:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3670f expref: 21 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.159817:0:8412:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079616 00010000:00010000:0.0:1790771167.159823:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c80c00, rc 0) 00010000:00010000:1.0:1790771167.159823:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.159825:0:8412:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079616 00000100:00100000:3.0:1790771167.159831:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:2.0:1790771167.159858:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (614400->618495) req@ffff8bfc29016a00 x1877759534079616/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771167.159864:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb05a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759534074496:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 9939us (11232us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.159865:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:14958:x1877759534074752:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 10078us (10955us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.159876:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.159888:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1085 00000100:00100000:1.0:1790771167.159889:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1810 00002000:00100000:2.0:1790771167.159892:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc29016a00 with x1877759534079616 ext(614400->618495) 00002000:00010000:2.0:1790771167.159899:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc29016a00 00000100:00100000:0.0:1790771167.159925:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079744 00000100:00100000:0.0:1790771167.159930:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079744 00000100:00100000:2.0:1790771167.159935:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 464 00000100:00100000:1.0:1790771167.159953:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534079872 00000100:00100000:3.0:1790771167.159954:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.159956:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.159956:0:8412:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2397:x1877759534079616:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771167.159959:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534079872 00000100:00100000:0.0:1790771167.159989:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1815 00000100:00100000:1.0:1790771167.159991:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534080256 00000100:00100000:1.0:1790771167.159995:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534080256 00000100:00100000:0.0:1790771167.159999:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2397:x1877759534079744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.160008:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.160012:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534080384 00000100:00100000:1.0:1790771167.160016:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534080384 00010000:00010000:0.0:1790771167.160021:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160031:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160047:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9d6bb9e/0xfa0c505d97f0d4ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35b85 expref: 26 pid: 13782 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.160050:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6598 00010000:00010000:0.0:1790771167.160063:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(2 0) 00000100:00100000:1.0:1790771167.160064:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:15037:x1877759534079872:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:0.0:1790771167.160071:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1790771167.160077:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.160078:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3670f expref: 20 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.160088:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f750 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36755 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160091:0:6479:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3670f expref: 20 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.160091:0:8412:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2397:x1877759534079616:12345-192.168.204.50@tcp:3:cat.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.160114:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 464 00002000:00100000:2.0:1790771167.160123:0:8412:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000400:0xb:0x0] (614400->618495) req@ffff8bfc29016a00 x1877759534079616/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1790771167.160129:0:6479:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f7ab6876/0xfa0c505d97f0f62a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3670f expref: 20 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.160134:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771167.160153:0:8412:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc29016a00 with x1877759534079616 ext(614400->618495) 00010000:00010000:1.0:1790771167.160157:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.160158:0:6479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1877759539789056:192.168.204.50@tcp:105: 00002000:00010000:2.0:1790771167.160161:0:8412:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc29016a00 00000100:00100000:3.0:1790771167.160174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.160178:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.160202:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790771167.160205:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.160212:0:6479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e780 going to sleep for 11 seconds 00000004:00010000:1.0:1790771167.160215:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.160224:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.160237:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f750 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36755 expref: 113 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.160249:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36755 expref: 112 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.160255:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534080640 00010000:00010000:1.0:1790771167.160256:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.160261:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771167.160261:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534080640 00010000:00010000:1.0:1790771167.160264:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc05d60200, rc 0) 00000100:00100000:0.0:1790771167.160269:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6599 00000100:00100000:0.0:1790771167.160280:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14924:x1877759534080256:12345-192.168.204.50@tcp:55:cp.0 00000100:00100000:1.0:1790771167.160299:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:15037:x1877759534079872:12345-192.168.204.50@tcp:101:cp.0 Request processed in 239us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.160306:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6598 00000100:00100000:2.0:1790771167.160316:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6600 00010000:00010000:0.0:1790771167.160317:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,1 mode: --/PW res: [0x240000402:0xae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.160329:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6601 00000100:00100000:2.0:1790771167.160332:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:15018:x1877759534080384:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771167.160334:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.160343:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14512:x1877759534080640:12345-192.168.204.50@tcp:36:rm.0 00010000:00010000:0.0:1790771167.160350:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160363:0:13762:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771167.160369:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,1 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160369:0:13768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1790771167.160378:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 2/0,0 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160384:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f646 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36683 expref: 113 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160385:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f669 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3671d expref: 103 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160387:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160409:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.160413:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 3/0,0 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160419:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 4/0,0 mode: PW/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160423:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc00030a00/0xfa0c505d97efb3e4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x22:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2f587 expref: 102 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160430:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfc113f3c00) 00010000:00010000:2.0:1790771167.160432:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0a293 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x8c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e34a28 expref: 112 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160434:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790771167.160439:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 2/0,0 mode: --/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160450:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f75e lrc: 0/0,0 mode: --/PW res: [0x240000402:0xae:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160455:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc20109a00) 00010000:00010000:3.0:1790771167.160468:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x22:0x0].0x0 (ffff8bfb03188300) 00010000:00010000:2.0:1790771167.160469:0:13762:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.160474:0:13768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.160516:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,1 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160516:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 3/0,1 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.160525:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+101:14924:x1877759534080256:12345-192.168.204.50@tcp:55:cp.0 Request processed in 244us (651us total) trans 0 rc -22/-22 00010000:00010000:3.0:1790771167.160538:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160545:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.160547:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6599 00010000:00010000:3.0:1790771167.160549:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160573:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160574:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f773 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160595:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: --/PW res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160604:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160613:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160672:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160679:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160681:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160696:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160704:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160734:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160745:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160751:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790771167.160841:0:13762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].42, 64 off11456 00010000:00010000:2.0:1790771167.160876:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160887:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160895:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160903:0:13762:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160910:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160918:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771167.160926:0:13768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9864 00010000:00010000:2.0:1790771167.160939:0:13762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771167.160953:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160955:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x22:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160966:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160969:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.160984:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.160985:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.160990:0:7903:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771167.160998:0:7903:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161004:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161005:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.161011:0:7903:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06592000 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771167.161015:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161018:0:7903:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161020:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161036:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161039:0:7903:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161040:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161059:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc310f1f00) 00010000:00010000:2.0:1790771167.161064:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1790771167.161068:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161072:0:7903:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8c:0x0].0x0 (ffff8bfc310f1f00) 00010000:00010000:3.0:1790771167.161073:0:13768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771167.161079:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f781 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161080:0:7903:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790771167.161085:0:7903:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 1/0,0 mode: --/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161089:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161093:0:6482:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771167.161107:0:7903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f78f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x8c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161107:0:6482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161108:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161108:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161132:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161135:0:6482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c81600 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:0.0:1790771167.161139:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.161142:0:6482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161144:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.161148:0:7903:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771167.161150:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c80400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.161151:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161156:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161159:0:6482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161176:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161178:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161182:0:6482:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x22:0x0].0x0 (ffff8bfb03188300) 00010000:00010000:1.0:1790771167.161190:0:6482:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790771167.161195:0:6482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 1/0,0 mode: --/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161198:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.161203:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x22:0x0].0x0 (ffff8bfb03188300) 00010000:00010000:1.0:1790771167.161204:0:6482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81600/0xfa0c505d97f0f796 lrc: 0/0,0 mode: --/PW res: [0x240000402:0x22:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161206:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161207:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:0.0:1790771167.161212:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb62a00 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6508:1877759539788544:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.161213:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161232:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161234:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c80400/0xfa0c505d97f0f788 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x22:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161235:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.161240:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790771167.161245:0:6482:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.161257:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0x0 (ffff8bfc310f1e00) 00010000:00010000:3.0:1790771167.161261:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161263:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.161270:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 2/0,0 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161272:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.161289:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60000 pname:cluuid:pid:xid:nid:opc:job mdt_io00_002:lustre-MDT0001_UUID:6508:1877759539788672:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.161290:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.161291:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161293:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f765 lrc: 0/0,0 mode: --/CW res: [0x200000403:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161310:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161316:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e1a00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.161318:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534080768 00010000:00010000:3.0:1790771167.161320:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.161325:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.161326:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534080768 00000004:00010000:2.0:1790771167.161326:0:13762:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd54f856 reply state 00000000ee2995bd transno 4294969491 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161327:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161350:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0x0 (ffff8bfb02b20400) 00010000:00010000:0.0:1790771167.161351:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 55 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161354:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161355:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.161360:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 3/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.161377:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0f76c lrc: 0/0,0 mode: --/CW res: [0x240000402:0x35:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.161380:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xf7a5b27a (ffff8bfc310f1300) 00010000:00010000:2.0:1790771167.161385:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.161388:0:13762:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:3.0:1790771167.161396:0:13768:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000aaa36ec7 reply state 0000000098d7a168 transno 4294968905 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f773 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.161400:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1816 00010000:00010000:3.0:1790771167.161410:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81800/0xfa0c505d97f0f773 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x35:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.161413:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2397:x1877759534080768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.161422:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x35:0x0].0xd6e9df9d (ffff8bfb02b20600) 00010000:00010000:3.0:1790771167.161425:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.161427:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.161427:0:13768:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771167.161434:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 55 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.161438:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:15018:x1877759534080384:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1109us (1485us total) trans 4294969491 rc 0/0 00010000:00010000:0.0:1790771167.161450:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 55 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.161454:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6600 00000100:00100000:3.0:1790771167.161461:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14512:x1877759534080640:12345-192.168.204.50@tcp:36:rm.0 Request processed in 1121us (1290us total) trans 4294968905 rc 0/0 00000100:00100000:3.0:1790771167.161469:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6601 00010000:00010000:0.0:1790771167.161473:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0acd4 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e34d85 expref: 55 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161515:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:0.0:1790771167.161520:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161528:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.161535:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.161571:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2397:x1877759534080768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 160us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.161579:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1816 00000100:00100000:1.0:1790771167.162920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.162942:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.162963:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.162964:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534080896 00000100:00100000:2.0:1790771167.162971:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534080896 00000100:00100000:3.0:1790771167.162977:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081024 00000100:00100000:3.0:1790771167.162983:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081024 00000100:00100000:1.0:1790771167.162993:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.162996:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 54 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163000:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081152 00000100:00100000:0.0:1790771167.163006:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081152 00000100:00100000:3.0:1790771167.163019:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081408 00000100:00100000:1.0:1790771167.163024:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.163026:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081408 00000100:00100000:2.0:1790771167.163036:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1817 00000100:00100000:0.0:1790771167.163051:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 921 00000100:00100000:2.0:1790771167.163054:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2397:x1877759534080896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.163060:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.163063:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081792 00000100:00100000:0.0:1790771167.163067:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:2397:x1877759534081152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.163070:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081792 00010000:00010000:2.0:1790771167.163072:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.163078:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.163081:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 55 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.163092:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081920 00010000:00010000:0.0:1790771167.163093:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f6e0 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36739 expref: 113 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.163099:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081920 00010000:00010000:2.0:1790771167.163100:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 55 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.163103:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6602 00010000:00010000:0.0:1790771167.163112:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfb02b20500) 00010000:00010000:0.0:1790771167.163117:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.163120:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+102:14738:x1877759534081024:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771167.163127:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03a02c00/0xfa0c505d97f000dd lrc: 0/0,0 mode: --/PR res: [0x240000402:0x2e:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e30ff1 expref: 55 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163129:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.163136:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6603 00010000:00010000:3.0:1790771167.163141:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f79d lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3675c expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163146:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2397:x1877759534081152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 83us (181us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.163151:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00000100:00100000:1.0:1790771167.163153:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14524:x1877759534081408:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:2.0:1790771167.163163:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163165:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 921 00010000:00010000:1.0:1790771167.163168:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.163174:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f7a4 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163178:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163180:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f7ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36763 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163184:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163200:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163205:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f7a4 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163225:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.163242:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163251:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.163252:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.163258:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1790771167.163259:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.163261:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081536 00010000:00010000:1.0:1790771167.163263:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163267:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081536 00010000:00010000:3.0:1790771167.163282:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0f79d lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3675c expref: 104 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163283:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.163293:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2397:x1877759534080896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 242us (368us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.163304:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163305:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f7a4 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3675c expref: 103 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163313:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 465 00000100:00100000:2.0:1790771167.163314:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1817 00010000:00010000:1.0:1790771167.163327:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163327:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771167.163332:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1790771167.163334:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2398:x1877759534081536:12345-192.168.204.50@tcp:22:fallocate.0 00010000:00010000:3.0:1790771167.163336:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1800, rc 0) 00000100:00100000:2.0:1790771167.163353:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6604 00000100:00100000:2.0:1790771167.163368:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14711:x1877759534081792:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:3.0:1790771167.163369:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+103:14738:x1877759534081024:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 251us (420us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.163374:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.163384:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6602 00010000:00010000:1.0:1790771167.163391:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163399:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.163406:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6605 00000100:00100000:3.0:1790771167.163415:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14704:x1877759534081920:12345-192.168.204.50@tcp:101:mrename.0 00000004:00200000:1.0:1790771167.163421:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00010000:00010000:3.0:1790771167.163422:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:1.0:1790771167.163426:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.163433:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f7c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3676a expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.163437:0:13769:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163449:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163455:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163463:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163464:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.163469:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14711:x1877759534081792:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 104us (444us total) trans 0 rc -17/-17 00010000:00010000:1.0:1790771167.163506:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.163515:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6604 00010000:00010000:1.0:1790771167.163516:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163518:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163537:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.163537:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163542:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163550:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163555:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163558:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.163565:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.163568:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163569:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163585:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163587:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f7b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163609:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163617:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb size from disk: 38336 -> 38336 00010000:00010000:1.0:1790771167.163619:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163623:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb mtime from disk: 1674053537 -> 1790771166 00002000:00010000:0.0:1790771167.163628:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00010000:00010000:3.0:1790771167.163630:0:6508:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163634:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb ctime from disk: 1790771166 -> 1790771166 00010000:00010000:1.0:1790771167.163638:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163641:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1c:0x0] updating lvb blocks from disk: 80 -> 48 00010000:00010000:3.0:1790771167.163660:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163667:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163673:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.163679:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163684:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759534081536:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 355us (462us total) trans 4294967657 rc 0/0 00010000:00010000:2.0:1790771167.163688:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163691:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163701:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 465 00010000:00010000:2.0:1790771167.163715:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163716:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.163723:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.163727:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163734:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f7b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.163745:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.163750:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.163756:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f7ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 113 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.163764:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163771:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 112 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163781:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:2.0:1790771167.163782:0:13763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.163783:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.163788:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc00031000, rc 0) 00000100:00100000:0.0:1790771167.163795:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.163799:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163810:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.163817:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14524:x1877759534081408:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 669us (824us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.163820:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163823:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534081280 00000100:00100000:1.0:1790771167.163826:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6603 00000100:00100000:0.0:1790771167.163829:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534081280 00000004:00200000:3.0:1790771167.163833:0:6508:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x2e:0x0]: returning size 5 00010000:00010000:2.0:1790771167.163837:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.163843:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163850:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163851:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163860:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1089 00010000:00010000:2.0:1790771167.163868:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771167.163870:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.163875:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759534081280:12345-192.168.204.50@tcp:2:cp.0 00010000:00010000:2.0:1790771167.163875:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.163884:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163890:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163893:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f7ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163905:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.163910:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163915:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163917:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.163936:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163942:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x2e:0x0].0x0 (ffff8bfb0282a800) 00010000:00010000:2.0:1790771167.163945:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.163946:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1790771167.163951:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163952:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1790771167.163956:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00002000:00010000:0.0:1790771167.163959:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb mtime from disk: 0 -> 1674053537 00010000:00010000:2.0:1790771167.163965:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163966:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb atime from disk: 0 -> 1752421453 00010000:00010000:3.0:1790771167.163968:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f6a1 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.163973:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb ctime from disk: 0 -> 1790771167 00002000:00010000:0.0:1790771167.163979:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771167.163985:0:13792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb63b80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_004:lustre-MDT0000_UUID:13792:1877759539788800:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.163991:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.164002:0:13792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164004:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfb02b20900) 00010000:00010000:2.0:1790771167.164012:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.164014:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2398:x1877759534081280:12345-192.168.204.50@tcp:2:cp.0 Request processed in 143us (222us total) trans 4294967658 rc 0/0 00010000:00010000:2.0:1790771167.164019:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.164024:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1089 00010000:00010000:2.0:1790771167.164033:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f7d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.164047:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000679514cd reply state 00000000bb4450e8 transno 4294968906 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f69a lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164061:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687e00/0xfa0c505d97f0f69a lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164064:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f7c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 115 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164076:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771167.164080:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:3.0:1790771167.164082:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.164087:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164095:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:2.0:1790771167.164097:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.164100:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06592200, rc 0) 00010000:00010000:3.0:1790771167.164121:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164128:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164133:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.164135:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14704:x1877759534081920:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 721us (1080us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.164142:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06597e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.164149:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.164154:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6605 00010000:00010000:3.0:1790771167.164158:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164168:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:3.0:1790771167.164170:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.164172:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164177:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06597e00/0xfa0c505d97f0f67e lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.164186:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000679514cd reply state 00000000bb4450e8 transno 4294968906 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686800/0xfa0c505d97f0f685 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164192:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686800/0xfa0c505d97f0f685 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164196:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc03c5e800) 00010000:00010000:3.0:1790771167.164198:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.164199:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000004:00010000:3.0:1790771167.164201:0:6508:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000679514cd reply state 00000000bb4450e8 transno 4294968906 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f68c lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164307:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687600/0xfa0c505d97f0f68c lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6508 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.164312:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xc8b04d25 (ffff8bfc03c5e500) 00010000:00010000:3.0:1790771167.164314:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.164316:0:6508:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1790771167.164355:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.164355:0:6508:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14707:x1877759534076672:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 12595us (12789us total) trans 4294968906 rc 0/0 00000100:00100000:3.0:1790771167.164364:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 40 00000100:00100000:2.0:1790771167.164401:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534082304 00000100:00100000:2.0:1790771167.164408:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534082304 00000100:00100000:0.0:1790771167.164452:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.164468:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6606 00000100:00100000:0.0:1790771167.164475:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534082560 00000100:00100000:0.0:1790771167.164480:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534082560 00000100:00100000:2.0:1790771167.164514:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+104:14757:x1877759534082304:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:1.0:1790771167.164539:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.164544:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1726 00000100:00100000:0.0:1790771167.164557:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+105:12240:x1877759534082560:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771167.164559:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f7e3 lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.164570:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.164580:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.164586:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534082688 00010000:00010000:2.0:1790771167.164590:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.164591:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534082688 00000100:00100000:1.0:1790771167.164605:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.164634:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534083200 00000100:00100000:3.0:1790771167.164638:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534083200 00000100:00100000:3.0:1790771167.164676:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1727 00000100:00100000:0.0:1790771167.164681:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:12240:x1877759534082560:12345-192.168.204.50@tcp:35:ls.0 Request processed in 127us (228us total) trans 4294968907 rc 0/0 00000100:00100000:3.0:1790771167.164689:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+107:13738:x1877759534083200:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.164692:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1726 00000100:00100000:1.0:1790771167.164697:0:8676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8676:1877759539788928:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.164719:0:8676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->40959] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36747 expref: 24 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.164722:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fb257287 reply state 00000000a90fc595 transno 4294968908 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f7e3 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.164736:0:8676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc2d3aaa00, rc 0) 00010000:00010000:2.0:1790771167.164741:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06593a00/0xfa0c505d97f0f7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164750:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771167.164753:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1790771167.164756:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.164759:0:8676:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:14803:x1877759534078848:12345-192.168.204.50@tcp:101:cp.0 Request processed in 9552us (9631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.164767:0:8676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1088 00000100:00100000:2.0:1790771167.164801:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14757:x1877759534082304:12345-192.168.204.50@tcp:36:cp.0 Request processed in 322us (448us total) trans 4294968908 rc 0/0 00000100:00100000:2.0:1790771167.164810:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6606 00000100:00100000:2.0:1790771167.164826:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534082944 00000100:00100000:2.0:1790771167.164830:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534082944 00000100:00100000:0.0:1790771167.164867:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.164868:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6607 00000100:00100000:3.0:1790771167.164869:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:13738:x1877759534083200:12345-192.168.204.50@tcp:35:ls.0 Request processed in 178us (257us total) trans 4294968909 rc 0/0 00000100:00100000:3.0:1790771167.164885:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1727 00000100:00100000:2.0:1790771167.164887:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14511:x1877759534082688:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.164898:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.164904:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534083328 00000100:00100000:0.0:1790771167.164908:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534083328 00010000:00010000:2.0:1790771167.164910:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36771 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.164924:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164933:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 114 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.164949:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 114 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.164953:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1818 00010000:00010000:2.0:1790771167.164965:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000100:00100000:0.0:1790771167.164967:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2397:x1877759534083328:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.164971:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.164975:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6608 00010000:00010000:2.0:1790771167.164979:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06593400, rc 0) 00010000:00010000:0.0:1790771167.164981:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.164986:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14991:x1877759534082944:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:0.0:1790771167.164993:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165003:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.165014:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165018:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b68747c/0xfa0c505d97f0f53c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x28:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3667c expref: 24 pid: 13786 timeout: 267 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.165020:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14511:x1877759534082688:12345-192.168.204.50@tcp:101:rm.0 Request processed in 136us (479us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.165043:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1790771167.165043:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6607 00010000:00010000:3.0:1790771167.165044:0:13773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 114 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165052:0:7434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790771167.165064:0:13773:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165065:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36747 expref: 23 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165086:0:7434:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40080000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36747 expref: 23 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.165104:0:7434:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000012aaf184/0xfa0c505d97f0f72d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->40959) gid 0 flags: 0x40000000020000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36747 expref: 23 pid: 8676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.165111:0:7434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539789184:192.168.204.50@tcp:105: 00000100:00100000:0.0:1790771167.165148:0:7434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e240 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.165171:0:13773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 113 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.165183:0:13773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 113 pid: 13772 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.165196:0:13773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566f480 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539789312:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.165236:0:13773:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.170333:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.170418:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534085888 00000100:00100000:1.0:1790771167.170424:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534085888 00000100:00100000:1.0:1790771167.170454:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6609 00000100:00100000:1.0:1790771167.170461:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13262:x1877759534085888:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.170472:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.170481:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f7f8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3678d expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170550:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170558:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170565:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170573:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170578:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170583:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.170629:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.170680:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170686:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170690:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170694:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170697:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.170701:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170705:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170711:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.170713:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.170716:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 3/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170720:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f7ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170727:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170731:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170735:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170738:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35fff000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.170740:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170744:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170747:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.170749:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.170751:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170756:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f806 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170775:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f7f8 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3678d expref: 116 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170781:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.170783:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.170785:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f7f8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3678d expref: 116 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.170790:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05687000, rc 0) 00000100:00100000:1.0:1790771167.170819:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:13262:x1877759534085888:12345-192.168.204.50@tcp:101:ls.0 Request processed in 359us (490us total) trans 4294969492 rc 301/301 00000100:00100000:1.0:1790771167.170825:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6609 00000100:00100000:1.0:1790771167.177944:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.177971:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.177991:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534082176 00000100:00100000:0.0:1790771167.177998:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534082176 00000100:00100000:1.0:1790771167.178016:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.178017:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534083584 00010000:00010000:0.0:1790771167.178022:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 114 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178026:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534083584 00000100:00100000:1.0:1790771167.178043:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.178061:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1819 00000100:00100000:2.0:1790771167.178070:0:6479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6479:1877759539789056:192.168.204.50@tcp:105: 00000100:00100000:3.0:1790771167.178072:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534083840 00000100:00100000:1.0:1790771167.178076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.178079:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534083840 00000100:00100000:0.0:1790771167.178084:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:2397:x1877759534082176:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.178095:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.178101:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.178103:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 114 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.178112:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.178114:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1728 00000100:00100000:3.0:1790771167.178128:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11372850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:15018:x1877759534083584:12345-192.168.204.50@tcp:35:rm.0 00010000:00010000:0.0:1790771167.178134:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 114 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.178145:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2397:x1877759534079744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 18145us (18310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.178152:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.178170:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1815 00010000:00010000:0.0:1790771167.178176:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0f527 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x8e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366f3 expref: 114 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.178179:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084352 00000100:00100000:1.0:1790771167.178185:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084352 00010000:00010000:0.0:1790771167.178192:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:0.0:1790771167.178197:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.178205:0:8425:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.178211:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.178219:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6610 00000100:00100000:1.0:1790771167.178229:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+114:14738:x1877759534084352:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771167.178239:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.178240:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.178243:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11372850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:15018:x1877759534083584:12345-192.168.204.50@tcp:35:rm.0 Request processed in 116us (267us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1790771167.178251:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1728 00010000:00010000:1.0:1790771167.178252:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f814 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36778 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.178255:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534083968 00000100:00100000:2.0:1790771167.178263:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534083968 00000100:00100000:0.0:1790771167.178270:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:2397:x1877759534082176:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 199us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.178277:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1819 00000100:00100000:3.0:1790771167.178289:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084224 00010000:00010000:1.0:1790771167.178291:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178296:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084224 00002000:00100000:2.0:1790771167.178301:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (618496->622591) req@ffff8bfc2d355180 x1877759534083968/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1790771167.178306:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.178313:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1729 00010000:00010000:1.0:1790771167.178327:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771167.178328:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d355180 with x1877759534083968 ext(618496->622591) 00000100:00100000:0.0:1790771167.178332:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+108:14512:x1877759534083840:12345-192.168.204.50@tcp:35:rm.0 00002000:00010000:2.0:1790771167.178339:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d355180 00000100:00100000:3.0:1790771167.178343:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1730 00010000:00010000:1.0:1790771167.178351:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178356:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14947:x1877759534084224:12345-192.168.204.50@tcp:49:setfattr.0 00010000:00010000:1.0:1790771167.178364:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 2/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.178368:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084096 00010000:00010000:1.0:1790771167.178372:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.178375:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084096 00010000:00010000:1.0:1790771167.178383:0:12128:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178392:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.178399:0:8413:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/35 (9437->18446744073709551615) 00002000:00100000:2.0:1790771167.178405:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d355c00 with x1877759534084096 ext(9437->18446744073709551615) 00010000:00010000:1.0:1790771167.178409:0:13792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.178413:0:8413:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc2d355c00. 00000100:00100000:3.0:1790771167.178413:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14947:x1877759534084224:12345-192.168.204.50@tcp:49:setfattr.0 Request processed in 60us (305us total) trans 0 rc -61/-61 00010000:00010000:1.0:1790771167.178423:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178428:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1730 00000100:00100000:2.0:1790771167.178445:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 466 00000100:00100000:0.0:1790771167.178446:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:14512:x1877759534083840:12345-192.168.204.50@tcp:35:rm.0 Request processed in 118us (427us total) trans 4294968910 rc 0/0 00000100:00100000:0.0:1790771167.178455:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1729 00000100:00100000:2.0:1790771167.178460:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534083968:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:3.0:1790771167.178468:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 467 00000100:00100000:3.0:1790771167.178478:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534084096:12345-192.168.204.50@tcp:10:truncate.0 00000100:00100000:0.0:1790771167.178551:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.178618:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534083968:12345-192.168.204.50@tcp:3:cat.0 Request processed in 161us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.178627:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 466 00002000:00100000:2.0:1790771167.178636:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (618496->622591) req@ffff8bfc2d355180 x1877759534083968/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790771167.178661:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d355180 with x1877759534083968 ext(618496->622591) 00002000:00010000:2.0:1790771167.178666:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc2d355180 00000100:00100000:2.0:1790771167.178701:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084480 00000100:00100000:2.0:1790771167.178706:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084480 00000040:00080000:1.0:1790771167.178717:0:13792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].45, 64 off11696 00000100:00100000:2.0:1790771167.178749:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6611 00000100:00100000:2.0:1790771167.178764:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:15069:x1877759534084480:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:2.0:1790771167.178776:0:13762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.178778:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178785:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178792:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.178792:0:13762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f829 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3677f expref: -99 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178807:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.178814:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.178817:0:13794:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb size from disk: 28314 -> 9437 00002000:00010000:3.0:1790771167.178823:0:13794:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb mtime from disk: 1790771166 -> 1790771167 00002000:00010000:3.0:1790771167.178829:0:13794:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb atime from disk: 1790771165 -> 0 00002000:00010000:3.0:1790771167.178832:0:13794:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb ctime from disk: 1790771166 -> 1790771167 00010000:00010000:1.0:1790771167.178834:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.178835:0:13794:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x23:0x0] updating lvb blocks from disk: 8 -> 0 00010000:00010000:1.0:1790771167.178851:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:2.0:1790771167.178853:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178855:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790771167.178860:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178871:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f711 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x8e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.178874:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178879:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2397:x1877759534084096:12345-192.168.204.50@tcp:10:truncate.0 Request processed in 399us (804us total) trans 4294967646 rc 0/0 00000004:00010000:1.0:1790771167.178887:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000071f069a3 reply state 00000000878e78a1 transno 4294969494 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.178897:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 4/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.178899:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 467 00010000:00010000:1.0:1790771167.178900:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790771167.178908:0:13794:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/35 (9437->18446744073709551615) 00002000:00100000:3.0:1790771167.178915:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc2d355c00 with x1877759534084096 ext(9437->18446744073709551615) 00002000:00010000:3.0:1790771167.178924:0:13794:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8bfc2d355c00. 00010000:00010000:1.0:1790771167.178927:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00010000:00010000:2.0:1790771167.178928:0:13762:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178931:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:1.0:1790771167.178935:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1790771167.178941:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000071f069a3 reply state 00000000878e78a1 transno 4294969494 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.178945:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178949:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178962:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc03c5e600) 00010000:00010000:1.0:1790771167.178964:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.178965:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1790771167.178968:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178972:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178976:0:13792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178979:0:13792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.178982:0:13792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178986:0:13792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178990:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.178992:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.178994:0:13792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.178999:0:13792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f6f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.179007:0:13792:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000071f069a3 reply state 00000000878e78a1 transno 4294969494 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179012:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179016:0:13792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc03c5ef00) 00010000:00010000:1.0:1790771167.179018:0:13792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.179020:0:13792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179025:0:13792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179028:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.179045:0:13792:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00010000:00010000:1.0:1790771167.179053:0:13792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179059:0:13792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179065:0:13792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179070:0:13792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179074:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179075:0:13792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179091:0:13792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179097:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.179107:0:13792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790771167.179123:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179127:0:10373:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790771167.179135:0:10373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179137:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.179146:0:13792:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14849:x1877759534078720:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 26138us (26234us total) trans 4294969494 rc 0/0 00010000:00010000:3.0:1790771167.179148:0:10373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3aa200 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:3.0:1790771167.179155:0:10373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.179163:0:13792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 41 00010000:00010000:2.0:1790771167.179165:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179172:0:10373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179177:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc35ffe400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.179185:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179185:0:10373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x8e:0x0].0x0 (ffff8bfc1ae7f400) 00010000:00010000:3.0:1790771167.179192:0:10373:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790771167.179197:0:10373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 1/0,0 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179200:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179203:0:10373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3aa200/0xfa0c505d97f0f837 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x8e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179225:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.179228:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.179233:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.179238:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179244:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f81b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179256:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179262:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179269:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.179274:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.179275:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc2d3ab200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.179278:0:10373:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.179282:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179290:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179299:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc03c5ef00) 00010000:00010000:2.0:1790771167.179302:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.179305:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179312:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f822 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179333:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f814 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36778 expref: 114 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179342:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.179344:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.179348:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f814 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36778 expref: 114 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.179358:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35fff600, rc 0) 00000100:00100000:2.0:1790771167.179393:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14738:x1877759534084352:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 1167us (1245us total) trans 0 rc 301/301 00000100:00100000:2.0:1790771167.179401:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6610 00000100:00100000:0.0:1790771167.181035:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.181080:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534086272 00000100:00100000:2.0:1790771167.181086:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534086272 00000100:00100000:2.0:1790771167.181127:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6612 00000100:00100000:2.0:1790771167.181136:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+113:14647:x1877759534086272:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:2.0:1790771167.181146:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.181157:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f83e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3679b expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.181191:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.181219:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534086784 00010000:00010000:2.0:1790771167.181222:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.181224:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534086784 00010000:00010000:2.0:1790771167.181244:0:13774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 114 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.181253:0:13774:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.181266:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6613 00000100:00100000:3.0:1790771167.181277:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+119:14756:x1877759534086784:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:2.0:1790771167.181282:0:13774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 114 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.181290:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.181298:0:13774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 114 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.181301:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f84c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367b0 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.181323:0:13774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566c700 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539789440:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.181354:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.181366:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.181371:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.181387:0:13774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c900 going to sleep for 11 seconds 00010000:00010000:3.0:1790771167.181391:0:13766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 120 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.181400:0:13766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 120 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.181409:0:13766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc29015c00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539789568:192.168.204.50@tcp:104: 00000100:00100000:3.0:1790771167.181432:0:13766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.186587:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb029c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539789696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790771167.186598:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539789824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790771167.186610:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96765445-cf96-4b52-a83b-2e35c9cf038c:3626:1877759539789952:0@lo:400:kworker.0 00000100:00100000:3.0:1790771167.186629:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.186676:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3627:1877759539790080:0@lo:400:kworker.0 00000100:00100000:1.0:1790771167.186696:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.186721:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790771167.186725:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0566fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3624:1877759539790208:0@lo:400:kworker.0 00000100:00100000:2.0:1790771167.186729:0:8667:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539789696 00000100:00100000:2.0:1790771167.186736:0:8667:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539789696 00000100:00100000:1.0:1790771167.186741:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3626:1877759539790464:0@lo:400:kworker.0 00000100:00100000:0.0:1790771167.186757:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3627:1877759539790592:0@lo:400:kworker.0 00000100:00100000:3.0:1790771167.186768:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771167.186787:0:8667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790771167.186791:0:6486:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539789952 00000100:00100000:1.0:1790771167.186796:0:6486:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539789952 00000100:00100000:0.0:1790771167.186802:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790771167.186803:0:8667:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1877759539789696:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790771167.186803:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3624:1877759539790720:0@lo:400:kworker.0 00002000:00000024:2.0:1790771167.186828:0:8667:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 8433664 granted 343758784 pending 0 free 3920179200 avail 3669561344 00000100:00100000:3.0:1790771167.186842:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.186849:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1790771167.186862:0:6486:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96765445-cf96-4b52-a83b-2e35c9cf038c+24:3626:x1877759539789952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790771167.186864:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790080 00000100:00100000:0.0:1790771167.186872:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790080 00000100:00100000:3.0:1790771167.186894:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967638 gen 2 00000100:00100000:2.0:1790771167.186896:0:8667:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1877759539789696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (265us total) trans 0 rc 0/0 00000004:00080000:3.0:1790771167.186903:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06790000, transno 4294967634 00000100:00100000:2.0:1790771167.186911:0:8667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790771167.186912:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790208 00000100:00100000:1.0:1790771167.186914:0:6486:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96765445-cf96-4b52-a83b-2e35c9cf038c+24:3626:x1877759539789952:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000004:00080000:3.0:1790771167.186916:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06792a00, transno 4294967635 00000100:00100000:0.0:1790771167.186919:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790208 00000004:00080000:3.0:1790771167.186923:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06792680, transno 4294967636 00000004:00080000:3.0:1790771167.186929:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06791f80, transno 4294967637 00000100:00100000:1.0:1790771167.186930:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000004:00080000:3.0:1790771167.186937:0:3624:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfc3fb4dc00, transno 4294967638 00000100:00100000:3.0:1790771167.186949:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb029c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3624:1877759539789696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790771167.186958:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790592 00000100:00100000:0.0:1790771167.186959:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790720 00000100:00100000:3.0:1790771167.186966:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790771167.186967:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790720 00000100:00100000:2.0:1790771167.186967:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790592 00000100:00100000:3.0:1790771167.186978:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3624:1877759539790336:0@lo:400:kworker.0 00000100:00100000:1.0:1790771167.186985:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790771167.186995:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1877759539790080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790771167.187016:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.187017:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1790771167.187028:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790771167.187032:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1877759539790208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790771167.187038:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1877759539790080:12345-0@lo:400:kworker.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.187045:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1877759539790720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790771167.187046:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790771167.187067:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790336 00000100:00100000:1.0:1790771167.187072:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790336 00000100:00100000:0.0:1790771167.187087:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29017100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1877759539790208:12345-0@lo:400:kworker.0 Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.187096:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790771167.187113:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790771167.187113:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29014380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1877759539790720:12345-0@lo:400:kworker.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.187122:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790771167.187126:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1877759539790592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790771167.187133:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790771167.187136:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1877759539790336:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1790771167.187140:0:9554:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0001: 2 changes, 0 in progress, 0 in flight, 5 done 00000100:00080000:3.0:1790771167.187158:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790771167.187163:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790771167.187169:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1877759539790592:12345-0@lo:400:kworker.0 Request processed in 46us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.187176:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790771167.187183:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29016300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1877759539790336:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.187187:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.187197:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790771167.187219:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790771167.187220:0:8410:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539789824 00000100:00100000:1.0:1790771167.187224:0:8410:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539789824 00000100:00100000:0.0:1790771167.187249:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3627:1877759539790592:0@lo:400:kworker.0 00000100:00100000:1.0:1790771167.187256:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790771167.187266:0:8410:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1877759539789824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790771167.187266:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06193b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3624:1877759539790336:0@lo:400:kworker.0 00000100:00100000:2.0:1790771167.187272:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96765445-cf96-4b52-a83b-2e35c9cf038c:3626:1877759539789952:0@lo:400:kworker.0 00000100:00100000:0.0:1790771167.187273:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3627:1877759539790080:0@lo:400:kworker.0 00002000:00000024:1.0:1790771167.187285:0:8410:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 8433664 granted 343758784 pending 0 free 3920179200 avail 3669561344 00000100:00100000:3.0:1790771167.187298:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3624:1877759539790208:0@lo:400:kworker.0 00000100:00100000:3.0:1790771167.187315:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3624:1877759539790720:0@lo:400:kworker.0 00000100:00100000:0.0:1790771167.187331:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539790464 00000100:00100000:1.0:1790771167.187334:0:8410:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1877759539789824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.187336:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539790464 00000100:00100000:1.0:1790771167.187344:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1790771167.187367:0:6490:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790771167.187369:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967655 gen 2 00000004:00080000:2.0:1790771167.187376:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06ba1180, transno 4294967649 00000100:00100000:0.0:1790771167.187381:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1790771167.187387:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1877759539790464:12345-0@lo:400:kworker.0 00000004:00080000:2.0:1790771167.187395:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06ba1c00, transno 4294967650 00000004:00080000:2.0:1790771167.187400:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb06ba2d80, transno 4294967651 00000004:00080000:2.0:1790771167.187404:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb057b0380, transno 4294967654 00000004:00080000:2.0:1790771167.187409:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8bfb0566df80, transno 4294967655 00000100:00100000:2.0:1790771167.187423:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3625:1877759539789824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790771167.187432:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1877759539790464:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.187440:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1790771167.187461:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06191180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3626:1877759539790464:0@lo:400:kworker.0 00000004:00080000:1.0:1790771167.187526:0:9561:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 4 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:0.0:1790771167.228005:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.228043:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.228082:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087936 00000100:00100000:2.0:1790771167.228094:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087936 00000100:00100000:1.0:1790771167.228096:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534089344 00000100:00100000:1.0:1790771167.228103:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534089344 00000100:00100000:3.0:1790771167.228122:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.228157:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084736 00000100:00100000:1.0:1790771167.228161:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084736 00000100:00100000:2.0:1790771167.228178:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6614 00000100:00100000:3.0:1790771167.228187:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.228189:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6615 00000100:00100000:2.0:1790771167.228196:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:13264:x1877759534089344:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.228206:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+109:12240:x1877759534087936:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.228231:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.228237:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534085120 00000100:00100000:1.0:1790771167.228241:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534085120 00010000:00010000:0.0:1790771167.228250:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0f85a lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367c5 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.228254:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6616 00000100:00100000:2.0:1790771167.228271:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:15037:x1877759534084736:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:3.0:1790771167.228276:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.228282:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6617 00000100:00100000:1.0:1790771167.228293:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14924:x1877759534085120:12345-192.168.204.50@tcp:36:cp.0 00000100:00100000:3.0:1790771167.228304:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534085248 00010000:00010000:2.0:1790771167.228309:0:13765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.228310:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534085248 00010000:00010000:2.0:1790771167.228336:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc05d60200/0xfa0c505d97f0f757 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36755 expref: 115 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.228337:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f861 lrc: 3/0,1 mode: --/EX res: [0x240000402:0xae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.228346:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6618 00000004:00200000:0.0:1790771167.228347:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00000100:00100000:3.0:1790771167.228360:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+53:14711:x1877759534085248:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771167.228364:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f861 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228370:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.228373:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.228376:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f861 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228382:0:13765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.228383:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f86f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36786 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228426:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228431:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228434:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0f85a lrc: 1/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367c5 expref: 112 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228436:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228460:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228462:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:2.0:1790771167.228465:0:13765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 121 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228470:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.228477:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0f85a lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367c5 expref: 113 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228518:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfd800, rc 0) 00010000:00010000:3.0:1790771167.228522:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.228526:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003b28ed15 reply state 000000008e515a23 transno 4294968912 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f861 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0xae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228537:0:13765:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228537:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.228540:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc2d3ab200/0xfa0c505d97f0f861 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0xae:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228560:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.228564:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xae:0x0].0x0 (ffff8bfc113f3c00) 00010000:00010000:1.0:1790771167.228571:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790771167.228574:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790771167.228579:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:12240:x1877759534087936:12345-192.168.204.50@tcp:101:ls.0 Request processed in 376us (579us total) trans 4294968911 rc 301/301 00000100:00100000:0.0:1790771167.228592:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6615 00010000:00010000:2.0:1790771167.228594:0:13765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 121 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228612:0:13765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 121 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228626:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14924:x1877759534085120:12345-192.168.204.50@tcp:36:cp.0 Request processed in 334us (439us total) trans 4294968912 rc 0/0 00010000:00010000:3.0:1790771167.228629:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.228631:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539790848:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.228662:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6617 00000100:00100000:0.0:1790771167.228666:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.228667:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228681:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.228707:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 1310720 00000100:00100000:0.0:1790771167.228708:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534084864 00000004:00200000:3.0:1790771167.228711:0:12030:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.228720:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534084864 00000100:00100000:2.0:1790771167.228721:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668c780 going to sleep for 11 seconds 00000004:00010000:3.0:1790771167.228727:0:12030:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228742:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228753:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.228758:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 922 00010000:00010000:2.0:1790771167.228764:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.228768:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228769:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.228773:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:2399:x1877759534084864:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.228780:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f892 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367cc expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228789:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.228803:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228804:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f7a4 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3675c expref: 112 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228812:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.228825:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.228829:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00010000:00010000:3.0:1790771167.228831:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.228834:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.228837:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228840:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228844:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.228856:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:2399:x1877759534084864:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 87us (213us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.228862:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228864:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00000100:00100000:0.0:1790771167.228867:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 922 00010000:00010000:3.0:1790771167.228871:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.228877:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228883:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f876 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228885:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228897:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.228913:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.228917:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534085632 00000100:00100000:0.0:1790771167.228922:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534085632 00010000:00010000:2.0:1790771167.228926:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228927:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534086016 00000100:00100000:1.0:1790771167.228933:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534086016 00010000:00010000:3.0:1790771167.228935:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.228945:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.228945:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.228953:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6619 00010000:00010000:3.0:1790771167.228960:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.228968:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:15098:x1877759534085632:12345-192.168.204.50@tcp:44:fallocate.0 00010000:00010000:3.0:1790771167.228969:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.228976:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228980:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6620 00010000:00010000:3.0:1790771167.228988:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.228995:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14635:x1877759534086016:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:3.0:1790771167.228997:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc03c5e800) 00010000:00010000:3.0:1790771167.229002:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.229005:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229007:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.229012:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f884 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.229021:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.229022:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f8a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36794 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.229031:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+123:15098:x1877759534085632:12345-192.168.204.50@tcp:44:fallocate.0 Request processed in 65us (222us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.229037:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f86f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 55 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.229050:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6619 00010000:00010000:3.0:1790771167.229056:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229062:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:3.0:1790771167.229064:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790771167.229067:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686e00, rc 0) 00010000:00010000:2.0:1790771167.229069:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229080:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229082:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.229094:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.229103:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14711:x1877759534085248:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 742us (830us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.229106:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.229111:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534086400 00000100:00100000:0.0:1790771167.229117:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534086400 00010000:00010000:1.0:1790771167.229123:0:13770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229125:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6618 00010000:00010000:2.0:1790771167.229128:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229138:0:13770:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229141:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.229147:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6621 00010000:00010000:2.0:1790771167.229147:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229151:0:13770:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.229160:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+111:14709:x1877759534086400:12345-192.168.204.50@tcp:101:mrename.0 00000100:00100000:3.0:1790771167.229164:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534085504 00010000:00010000:2.0:1790771167.229169:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229171:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534085504 00010000:00010000:1.0:1790771167.229174:0:13770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229176:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.229188:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0f8bc lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367a2 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229192:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:2.0:1790771167.229199:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.229201:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1731 00010000:00010000:2.0:1790771167.229205:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229212:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:14636:x1877759534085504:12345-192.168.204.50@tcp:35:fallocate.0 00010000:00010000:0.0:1790771167.229220:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229235:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391400/0xfa0c505d97f0f899 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.229239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.229242:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229261:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229263:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.229279:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.229280:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229281:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.229301:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534086528 00010000:00010000:2.0:1790771167.229302:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229305:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.229307:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534086528 00010000:00010000:2.0:1790771167.229320:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.229328:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229329:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.229340:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087040 00000100:00100000:1.0:1790771167.229346:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087040 00010000:00010000:2.0:1790771167.229349:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229360:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfc310f1e00) 00000100:00100000:3.0:1790771167.229365:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14636:x1877759534085504:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 153us (596us total) trans 4294969496 rc 0/0 00010000:00010000:2.0:1790771167.229366:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.229373:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6622 00010000:00010000:2.0:1790771167.229374:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229380:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1731 00000100:00100000:1.0:1790771167.229388:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14739:x1877759534086528:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:2.0:1790771167.229391:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391e00/0xfa0c505d97f0f8a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229397:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.229402:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229409:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f8d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367a9 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229415:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229421:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6623 00010000:00010000:2.0:1790771167.229430:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f892 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367cc expref: 123 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229436:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15040:x1877759534087040:12345-192.168.204.50@tcp:55:cp.0 00010000:00010000:0.0:1790771167.229438:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229438:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229466:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229469:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.229472:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229476:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000004:00200000:0.0:1790771167.229481:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x4:0x0]: returning size 1310720 00010000:00010000:2.0:1790771167.229508:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2e00/0xfa0c505d97f0f892 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367cc expref: 123 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229521:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.229523:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.229526:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.229531:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf2e00, rc 0) 00000004:00010000:0.0:1790771167.229545:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229546:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229552:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229566:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:13264:x1877759534089344:12345-192.168.204.50@tcp:101:ls.0 Request processed in 1376us (1518us total) trans 4294969495 rc 301/301 00010000:00010000:1.0:1790771167.229575:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229580:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229592:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229593:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6614 00010000:00010000:3.0:1790771167.229601:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229604:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229610:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229623:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229634:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229636:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.229661:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229662:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229663:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229685:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229690:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229691:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229711:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.229715:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfde00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.229719:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229720:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229725:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc310f1800) 00010000:00010000:3.0:1790771167.229733:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:2.0:1790771167.229738:0:13793:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087168 00010000:00010000:3.0:1790771167.229740:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229742:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4aa00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.229743:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229745:0:13793:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087168 00010000:00010000:1.0:1790771167.229750:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.229764:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f8e6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229769:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229770:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.229775:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.229780:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229788:0:13793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1090 00010000:00010000:1.0:1790771167.229789:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771167.229791:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0f8c3 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229798:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.229804:0:13793:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2398:x1877759534087168:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1790771167.229804:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15040:x1877759534087040:12345-192.168.204.50@tcp:55:cp.0 Request processed in 371us (526us total) trans 0 rc -22/-22 00010000:00010000:0.0:1790771167.229806:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229806:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229823:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229823:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6623 00010000:00010000:2.0:1790771167.229824:0:13793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.229840:0:13793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e6cc64/0xfa0c505d97f0f8f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367b7 expref: -99 pid: 13793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229842:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229846:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229859:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.229864:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229872:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f8df lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229874:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.229882:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229896:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087296 00010000:00010000:0.0:1790771167.229897:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc03c5e800) 00010000:00010000:1.0:1790771167.229899:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229901:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087296 00010000:00010000:0.0:1790771167.229902:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.229907:0:13793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539790976:192.168.204.50@tcp:106: 00010000:00010000:0.0:1790771167.229908:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229911:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229930:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0f8ca lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229930:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1732 00010000:00010000:1.0:1790771167.229932:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.229943:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14538:x1877759534087296:12345-192.168.204.50@tcp:37:cat.0 00010000:00010000:1.0:1790771167.229951:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.229955:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229960:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.229962:0:13793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668ccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.229969:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0f8bc lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367a2 expref: 113 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229970:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.229977:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.229981:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.229987:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367a2 expref: 112 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.229989:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0f8ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.230006:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771167.230009:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.230012:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc800, rc 0) 00000100:00100000:2.0:1790771167.230020:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.230028:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f8d8 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367a9 expref: 119 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.230038:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14709:x1877759534086400:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 881us (948us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.230039:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771167.230045:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087424 00010000:00010000:1.0:1790771167.230046:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.230051:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6621 00010000:00010000:1.0:1790771167.230052:0:12128:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.230054:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087424 00010000:00010000:1.0:1790771167.230065:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0f8d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367a9 expref: 119 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.230075:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4b800, rc 0) 00000100:00100000:2.0:1790771167.230096:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6624 00000100:00100000:1.0:1790771167.230102:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14739:x1877759534086528:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 718us (864us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771167.230112:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6622 00000100:00100000:2.0:1790771167.230113:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+112:14757:x1877759534087424:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:0.0:1790771167.230123:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.230130:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.230144:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f8fb lrc: 2/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367be expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.230148:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534087680 00000100:00100000:1.0:1790771167.230153:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534087680 00000100:00100000:0.0:1790771167.230163:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.230171:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f902 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.230184:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f902 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.230185:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534088192 00000100:00100000:1.0:1790771167.230190:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1733 00000100:00100000:0.0:1790771167.230192:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534088192 00000100:00100000:1.0:1790771167.230203:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:13675:x1877759534087680:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:2.0:1790771167.230204:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f902 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.230222:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1734 00000100:00100000:0.0:1790771167.230230:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:12255:x1877759534088192:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.230289:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+117:13675:x1877759534087680:12345-192.168.204.50@tcp:35:ls.0 Request processed in 88us (171us total) trans 4294968913 rc 0/0 00000100:00100000:1.0:1790771167.230296:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1733 00010000:00010000:2.0:1790771167.230312:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f8fb lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367be expref: 117 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.230327:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:12255:x1877759534088192:12345-192.168.204.50@tcp:35:ls.0 Request processed in 97us (163us total) trans 4294968914 rc 0/0 00010000:00010000:2.0:1790771167.230334:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f902 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367be expref: 116 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.230339:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1734 00010000:00010000:2.0:1790771167.230350:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00000100:00100000:1.0:1790771167.230354:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.230358:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790771167.230362:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79e00, rc 0) 00000100:00100000:1.0:1790771167.230372:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534088320 00000100:00100000:1.0:1790771167.230375:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534088320 00000100:00100000:0.0:1790771167.230395:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1735 00000100:00100000:2.0:1790771167.230405:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+115:14757:x1877759534087424:12345-192.168.204.50@tcp:101:cp.0 Request processed in 296us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.230406:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14511:x1877759534088320:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:2.0:1790771167.230420:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6624 00000100:00100000:1.0:1790771167.230533:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.230541:0:13773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566f480 pname:cluuid:pid:xid:nid:opc:job mdt00_018:lustre-MDT0000_UUID:13773:1877759539789312:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.230550:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534088576 00000100:00100000:1.0:1790771167.230554:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534088576 00010000:00010000:2.0:1790771167.230565:0:13773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.230574:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1736 00000100:00100000:1.0:1790771167.230587:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:13262:x1877759534088576:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771167.230627:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.230630:0:7434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fb61f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7434:1877759539789184:192.168.204.50@tcp:105: 00010000:00010000:3.0:1790771167.230658:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.230682:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2397:x1877759534083328:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 65720us (65824us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.230696:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:13262:x1877759534088576:12345-192.168.204.50@tcp:35:ls.0 Request processed in 111us (161us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1790771167.230702:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1736 00000100:00100000:2.0:1790771167.230768:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.230803:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1818 00000100:00100000:3.0:1790771167.230832:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534088832 00000100:00100000:3.0:1790771167.230836:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534088832 00000100:00100000:2.0:1790771167.230850:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534089088 00000100:00100000:2.0:1790771167.230857:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534089088 00000100:00100000:3.0:1790771167.230866:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6625 00000100:00100000:1.0:1790771167.230873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.230904:0:13795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534089472 00000100:00100000:2.0:1790771167.230910:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6626 00000100:00100000:1.0:1790771167.230912:0:13795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534089472 00000100:00100000:2.0:1790771167.230926:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14803:x1877759534089088:12345-192.168.204.50@tcp:36:cp.0 00002000:00100000:1.0:1790771167.230941:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (622592->626687) req@ffff8bfb029c1880 x1877759534089472/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790771167.230950:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb029c1880 with x1877759534089472 ext(622592->626687) 00010000:00010000:2.0:1790771167.230952:0:13761:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.230953:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:14947:x1877759534088832:12345-192.168.204.50@tcp:36:setfattr.0 00002000:00010000:1.0:1790771167.230955:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb029c1880 00000100:00100000:0.0:1790771167.230964:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.230972:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0f313 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36595 expref: 120 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.230982:0:13795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 468 00010000:00010000:2.0:1790771167.230988:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb8:0x0].0x0 (ffff8bfc19631900) 00000100:00100000:1.0:1790771167.230994:0:13795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534089472:12345-192.168.204.50@tcp:3:cat.0 00010000:00010000:2.0:1790771167.231002:0:13761:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.231038:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231042:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231054:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231064:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231067:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.231086:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534089856 00010000:00010000:3.0:1790771167.231087:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 114 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231091:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534089856 00010000:00010000:3.0:1790771167.231104:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 54 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.231114:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 120 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231116:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 54 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.231126:0:13795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534089472:12345-192.168.204.50@tcp:3:cat.0 Request processed in 133us (258us total) trans 0 rc 0/0 00000004:00010000:2.0:1790771167.231135:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b168ef14 reply state 0000000062b4fe75 transno 4294969498 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.231144:0:13795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 468 00010000:00010000:3.0:1790771167.231146:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231155:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1820 00002000:00100000:1.0:1790771167.231156:0:13795:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000400:0xb:0x0] (622592->626687) req@ffff8bfb029c1880 x1877759534089472/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1790771167.231167:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231171:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759534089856:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.231176:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 54 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.231187:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:1.0:1790771167.231195:0:13795:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb029c1880 with x1877759534089472 ext(622592->626687) 00010000:00010000:2.0:1790771167.231195:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb8:0x0].0x0 (ffff8bfc310f1200) 00010000:00010000:0.0:1790771167.231197:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 121 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790771167.231204:0:13795:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb029c1880 00010000:00010000:2.0:1790771167.231205:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790771167.231211:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771167.231217:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 121 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.231230:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:1.0:1790771167.231233:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534089728 00010000:00010000:0.0:1790771167.231234:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.231238:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534089728 00010000:00010000:0.0:1790771167.231244:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.231252:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231255:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.231266:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.231266:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14803:x1877759534089088:12345-192.168.204.50@tcp:36:cp.0 Request processed in 343us (499us total) trans 4294969498 rc 0/0 00000100:00100000:1.0:1790771167.231271:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6627 00010000:00010000:3.0:1790771167.231274:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.231285:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14872:x1877759534089728:12345-192.168.204.50@tcp:36:mkdir.0 00000100:00100000:2.0:1790771167.231289:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6626 00000100:00100000:0.0:1790771167.231292:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759534089856:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 122us (224us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.231304:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231312:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1820 00010000:00010000:3.0:1790771167.231317:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231327:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231334:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231339:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 54 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231345:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc00031000/0xfa0c505d97f0f7c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36763 expref: 120 pid: 13769 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231351:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231351:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.231375:0:13774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0566c700 pname:cluuid:pid:xid:nid:opc:job mdt00_019:lustre-MDT0000_UUID:13774:1877759539789440:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.231376:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231378:0:12030:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231400:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231401:0:13774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231402:0:12030:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 17/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 17 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231426:0:13774:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231428:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231442:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231445:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231447:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231460:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 54 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231471:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.231473:0:13766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc29015c00 pname:cluuid:pid:xid:nid:opc:job mdt00_011:lustre-MDT0000_UUID:13766:1877759539789568:192.168.204.50@tcp:104: 00000004:00200000:2.0:1790771167.231477:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00010000:00010000:0.0:1790771167.231519:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.231539:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791104:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.231584:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592000/0xfa0c505d97f0f83e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 121 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231594:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231606:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 120 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231606:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 54 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.231630:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00000100:00100000:3.0:1790771167.231630:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06739f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791232:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.231639:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.231643:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cf3400, rc 0) 00010000:00010000:3.0:1790771167.231685:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 54 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.231696:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14647:x1877759534086272:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 50559us (50658us total) trans 4294969499 rc 0/0 00010000:00010000:3.0:1790771167.231696:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 54 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.231718:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6612 00000100:00100000:3.0:1790771167.231720:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791360:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.231772:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231782:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 54 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.231791:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791488:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.231828:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 54 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231835:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 54 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.231847:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791616:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.231938:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.231947:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 54 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.231955:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06739c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791744:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.231966:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231974:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231980:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.231990:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000079e961c reply state 00000000fad34234 transno 4294969500 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.231997:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232006:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb4:0x0].0x0 (ffff8bfc36078600) 00010000:00010000:1.0:1790771167.232008:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.232010:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790771167.232013:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb4:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.232018:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232024:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232026:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232034:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232042:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 54 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232043:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232059:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4be00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.232064:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232066:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791872:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.232076:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232085:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.232087:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.232089:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 3/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232094:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0f917 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.232103:0:13771:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000079e961c reply state 00000000fad34234 transno 4294969500 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232110:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232116:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232118:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc36078200) 00010000:00010000:1.0:1790771167.232124:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.232126:0:13771:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1790771167.232137:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 54 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.232167:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14872:x1877759534089728:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 886us (1210us total) trans 4294969500 rc 0/0 00000100:00100000:1.0:1790771167.232174:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6627 00000100:00100000:0.0:1790771167.232184:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14538:x1877759534087296:12345-192.168.204.50@tcp:37:cat.0 Request processed in 2241us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.232191:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1732 00000100:00100000:3.0:1790771167.232213:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792000:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.232564:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.232593:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534090240 00010000:00010000:3.0:1790771167.232596:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 54 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.232600:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534090240 00000100:00100000:0.0:1790771167.232607:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.232619:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 54 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232628:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06738000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792128:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.232642:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534090368 00000100:00100000:1.0:1790771167.232664:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6628 00000100:00100000:2.0:1790771167.232665:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534090368 00000100:00100000:1.0:1790771167.232679:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14757:x1877759534090240:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:3.0:1790771167.232699:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 54 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.232708:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6629 00010000:00010000:3.0:1790771167.232720:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 54 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.232724:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+116:14709:x1877759534090368:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771167.232729:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 3/0,1 mode: --/PW res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232743:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.232745:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232747:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792256:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.232757:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f93a lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367da expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.232761:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 3/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232795:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 54 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232809:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 54 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232810:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232835:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232835:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792384:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.232850:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232870:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232878:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 54 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232881:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.232892:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 54 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232896:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232923:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb06739500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792512:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.232949:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 54 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790771167.232957:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 88 off10352 00010000:00010000:3.0:1790771167.232957:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 54 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232960:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.232981:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792640:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.232984:0:13767:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 2/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790771167.232994:0:6494:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cd4fe17 reply state 00000000bda256f0 transno 4294968915 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 4/0,1 mode: PW/PW res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 8 type: IBT flags: 0x40210000000020 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.232994:0:13767:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 4/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.233007:0:12030:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 118 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.233021:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4a200/0xfa0c505d97f0f933 lrc: 4/0,1 mode: TXN/TXN res: [0x240000403:0xf:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.233021:0:12030:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 118 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.233040:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771167.233044:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771167.233045:0:12030:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0673b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792768:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.233049:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.233055:0:6494:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.233060:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.233062:0:12030:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7480 going to sleep for 11 seconds 00010000:00010000:2.0:1790771167.233070:0:13767:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 4/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.233075:0:6494:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.233082:0:13767:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233090:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.233116:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xf:0x0]: returning size 0 00000100:00100000:1.0:1790771167.233117:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14757:x1877759534090240:12345-192.168.204.50@tcp:36:cp.0 Request processed in 443us (555us total) trans 4294968915 rc 0/0 00000004:00200000:2.0:1790771167.233124:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1790771167.233129:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6628 00000004:00010000:2.0:1790771167.233140:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233153:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233162:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233171:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233179:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233191:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233197:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.233201:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233208:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233219:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771167.233223:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.233227:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233234:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373400/0xfa0c505d97f0f941 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233246:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.233248:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+118:14511:x1877759534088320:12345-192.168.204.50@tcp:37:rm.0 Request processed in 2844us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.233261:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1735 00010000:00010000:2.0:1790771167.233264:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233271:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233277:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.233280:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233291:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233300:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc310f1600) 00010000:00010000:2.0:1790771167.233303:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.233306:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233312:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06372000/0xfa0c505d97f0f948 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233343:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0f93a lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367da expref: 119 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.233352:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.233367:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367da expref: 118 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.233377:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771167.233381:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.233384:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00000100:00100000:0.0:1790771167.233389:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534090624 00000100:00100000:0.0:1790771167.233395:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534090624 00000100:00100000:2.0:1790771167.233423:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14709:x1877759534090368:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 704us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.233431:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6630 00000100:00100000:2.0:1790771167.233439:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6629 00000100:00100000:0.0:1790771167.233441:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:12240:x1877759534090624:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.233450:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.233461:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0f956 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367e1 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233509:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0f95d lrc: 3/1,0 mode: --/PR res: [0x240000402:0x56:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233517:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0f95d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233526:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0f95d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.233548:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x56:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.233551:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.233563:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0f95d lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233581:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0f956 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367e1 expref: 120 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233592:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfca00/0xfa0c505d97f0f95d lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x56:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367e1 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.233602:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x56:0x0].0x0 (ffff8bfc113f3100) 00010000:00010000:0.0:1790771167.233604:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771167.233606:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfca00, rc 0) 00000100:00100000:0.0:1790771167.233630:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:12240:x1877759534090624:12345-192.168.204.50@tcp:101:ls.0 Request processed in 193us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.233634:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6630 00000100:00100000:3.0:1790771167.236840:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.236878:0:6496:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534090880 00000100:00100000:0.0:1790771167.236885:0:6496:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534090880 00000100:00100000:3.0:1790771167.236918:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791104:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.236926:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1737 00000100:00100000:2.0:1790771167.236933:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91b480 pname:cluuid:pid:xid:nid:opc:job mdt00_010:lustre-MDT0000_UUID:13765:1877759539790848:192.168.204.50@tcp:104: 00002000:00010000:1.0:1790771167.236940:0:13793:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0x16:0x0] updating lvb atime: 0 -> 1790771165 00000100:00100000:0.0:1790771167.236942:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:14924:x1877759534090880:12345-192.168.204.50@tcp:35:cp.0 00010000:00010000:2.0:1790771167.236954:0:13765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.236957:0:13793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f91aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13793:1877759539790976:192.168.204.50@tcp:106: 00000100:00100000:3.0:1790771167.236963:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.236991:0:13793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b5e6cc64/0xfa0c505d97f0f8f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367b7 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.236995:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091008 00000100:00100000:3.0:1790771167.237000:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.237004:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091008 00010000:00010000:1.0:1790771167.237017:0:13793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e6cc64/0xfa0c505d97f0f8f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367b7 expref: 23 pid: 13793 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237029:0:13793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00000100:00100000:3.0:1790771167.237032:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.237044:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091136 00000100:00100000:2.0:1790771167.237049:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091136 00000100:00100000:1.0:1790771167.237062:0:13793:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2398:x1877759534087168:12345-192.168.204.50@tcp:101:cat.0 Request processed in 7264us (7357us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771167.237069:0:13793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1090 00000100:00100000:2.0:1790771167.237079:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091264 00000100:00100000:0.0:1790771167.237086:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:14924:x1877759534090880:12345-192.168.204.50@tcp:35:cp.0 Request processed in 149us (244us total) trans 4294968916 rc 0/0 00000100:00100000:2.0:1790771167.237086:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091264 00000100:00100000:0.0:1790771167.237097:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1737 00000100:00100000:1.0:1790771167.237125:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6631 00000100:00100000:1.0:1790771167.237135:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15032:x1877759534091008:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:2.0:1790771167.237142:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6632 00000100:00100000:3.0:1790771167.237147:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.237148:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.237154:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6633 00010000:00010000:1.0:1790771167.237161:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0f964 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367e8 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.237162:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15082:x1877759534091136:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:0.0:1790771167.237169:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:15044:x1877759534091264:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771167.237183:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.237187:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.237198:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0f96b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367ef expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237202:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0f972 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367f6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237208:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237231:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237241:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237258:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237258:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237263:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237263:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.237280:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237289:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237293:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237312:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237315:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237335:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.237338:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237342:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237346:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237350:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091392 00000100:00100000:3.0:1790771167.237356:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091392 00010000:00010000:1.0:1790771167.237366:0:13764:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 124 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237367:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237368:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237380:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091520 00000100:00100000:3.0:1790771167.237385:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091520 00010000:00010000:1.0:1790771167.237390:0:13764:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237396:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237397:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237404:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6634 00010000:00010000:1.0:1790771167.237414:0:13764:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 125 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237419:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15088:x1877759534091392:12345-192.168.204.50@tcp:101:getfattr.0 00010000:00010000:0.0:1790771167.237423:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237435:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.237447:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f9aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367fd expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237452:0:13764:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 125 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237458:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237475:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.237507:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb029c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539792896:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.237517:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237524:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237528:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091648 00010000:00010000:0.0:1790771167.237530:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.237534:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091648 00010000:00010000:2.0:1790771167.237540:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.237555:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4f00 going to sleep for 11 seconds 00000004:00200000:0.0:1790771167.237564:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00000100:00100000:3.0:1790771167.237567:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6635 00000004:00200000:0.0:1790771167.237571:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:2.0:1790771167.237573:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xab:0x0]: returning size 30132 00000100:00100000:3.0:1790771167.237579:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13288:x1877759534091520:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771167.237581:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6636 00000004:00200000:2.0:1790771167.237581:0:6493:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.237587:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237592:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.237597:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.237599:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:15040:x1877759534091648:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:3.0:1790771167.237601:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f9c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36804 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.237605:0:6493:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237611:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237620:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.237631:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237634:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0f9cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3680b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237636:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237671:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237672:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237678:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237684:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0f9db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237689:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.237695:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237701:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237709:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0f9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237724:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237728:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237729:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0f9db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237730:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237741:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237758:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237759:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237779:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237780:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237784:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771167.237792:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.237796:0:13772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237804:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.237805:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237806:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aee00/0xfa0c505d97f0f9cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3680b expref: 130 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237809:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237813:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237827:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4000/0xfa0c505d97f0f98e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237834:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237840:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af600/0xfa0c505d97f0f9db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3680b expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237842:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237852:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237856:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237879:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.237888:0:6495:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237891:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.237898:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc310f1800) 00010000:00010000:2.0:1790771167.237901:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.237904:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237907:0:6493:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237908:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771167.237912:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.237913:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058af600, rc 0) 00010000:00010000:0.0:1790771167.237923:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.237931:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237938:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237938:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.237939:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15040:x1877759534091648:12345-192.168.204.50@tcp:101:cp.0 Request processed in 343us (604us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.237955:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.237960:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6636 00010000:00010000:3.0:1790771167.237963:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.237966:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0f980 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237982:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 19 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.237984:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc03c5e700) 00010000:00010000:0.0:1790771167.237992:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.237993:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.237994:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.238000:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238001:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238009:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.238015:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238023:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238024:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0f9a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238033:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238042:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771167.238049:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.238054:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.238054:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238062:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238064:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238073:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0f972 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367f6 expref: 129 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238080:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.238091:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238091:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0f9d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238099:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367f6 expref: 128 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238118:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:0.0:1790771167.238120:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.238122:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc310f1e00) 00010000:00010000:0.0:1790771167.238123:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5a00, rc 0) 00010000:00010000:2.0:1790771167.238130:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.238135:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.238137:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238151:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15044:x1877759534091264:12345-192.168.204.50@tcp:101:chown.0 Request processed in 988us (1121us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.238154:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0f99c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238161:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6633 00010000:00010000:3.0:1790771167.238175:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238183:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238185:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534091904 00010000:00010000:3.0:1790771167.238192:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238193:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534091904 00010000:00010000:2.0:1790771167.238200:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0f96b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238200:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.238206:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238211:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092416 00000100:00100000:1.0:1790771167.238216:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092416 00010000:00010000:2.0:1790771167.238221:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 128 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238231:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00000100:00100000:0.0:1790771167.238233:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6637 00010000:00010000:2.0:1790771167.238236:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.238242:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78600, rc 0) 00000100:00100000:1.0:1790771167.238244:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092672 00010000:00010000:3.0:1790771167.238248:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238249:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092672 00000100:00100000:0.0:1790771167.238250:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:12255:x1877759534091904:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.238268:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.238270:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x84832a57 (ffff8bfb02b20400) 00000100:00100000:1.0:1790771167.238275:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1738 00010000:00010000:3.0:1790771167.238278:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.238286:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0f9f0 lrc: 2/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36819 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238287:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238288:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14113:x1877759534092416:12345-192.168.204.50@tcp:35:cat.0 00000100:00100000:2.0:1790771167.238290:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15082:x1877759534091136:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 1132us (1291us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.238311:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0f9e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x84832a57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.238316:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6632 00010000:00010000:0.0:1790771167.238349:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0f9f7 lrc: 3/1,0 mode: --/PR res: [0x240000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.238355:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1739 00010000:00010000:0.0:1790771167.238362:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0f9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.238372:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14098:x1877759534092672:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:0.0:1790771167.238379:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0f9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771167.238395:0:13780:0:(mdd_object.c:4189:mdd_close()) Object [0x200000403:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1790771167.238401:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0f9c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36804 expref: 129 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.238404:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.238411:0:13772:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.238415:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36804 expref: 128 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238422:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:3.0:1790771167.238424:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000004:00010000:0.0:1790771167.238426:0:13772:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0f9f7 lrc: 3/1,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238427:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1800, rc 0) 00000004:00200000:2.0:1790771167.238429:0:13790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000040:00080000:1.0:1790771167.238433:0:13780:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].43, 64 off11520 00000004:00200000:2.0:1790771167.238437:0:13790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.238452:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13288:x1877759534091520:12345-192.168.204.50@tcp:101:ls.0 Request processed in 876us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.238461:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6635 00010000:00010000:0.0:1790771167.238464:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0f9f0 lrc: 0/0,0 mode: --/CR res: [0x240000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36819 expref: 122 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.238474:0:13780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 3/0,1 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238482:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05669400/0xfa0c505d97f0f9f7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36819 expref: 121 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238506:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.238511:0:13780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238515:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.238523:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14098:x1877759534092672:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 153us (385us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.238525:0:13780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238539:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238548:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xb:0x0].0x0 (ffff8bfc0786e300) 00000100:00100000:2.0:1790771167.238549:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1739 00010000:00010000:1.0:1790771167.238550:0:13780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238559:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.238562:0:13780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.238564:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05669400, rc 0) 00010000:00010000:3.0:1790771167.238565:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.238570:0:13780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238594:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:12255:x1877759534091904:12345-192.168.204.50@tcp:101:ls.0 Request processed in 349us (588us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.238594:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.238607:0:13780:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790771167.238610:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.238611:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6637 00010000:00010000:2.0:1790771167.238621:0:8424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790771167.238629:0:8424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238642:0:8424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4aa00 already unused, calling callback (ffffffffc0c80ac0) 00010000:00010000:2.0:1790771167.238663:0:8424:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238670:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14113:x1877759534092416:12345-192.168.204.50@tcp:35:cat.0 Request processed in 385us (592us total) trans 4294969501 rc 0/0 00010000:00010000:3.0:1790771167.238674:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0fa0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238676:0:8424:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238681:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1738 00010000:00010000:3.0:1790771167.238695:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238702:0:8424:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x10:0x0].0x0 (ffff8bfc19631e00) 00010000:00010000:3.0:1790771167.238705:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238707:0:8424:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790771167.238714:0:8424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 1/0,0 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.238719:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5:0x0]: returning size 1 00010000:00010000:2.0:1790771167.238724:0:8424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4aa00/0xfa0c505d97f0f9fe lrc: 0/0,0 mode: --/PW res: [0x200000403:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 13780 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.238733:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0fa0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238739:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771167.238741:0:13763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.238744:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790771167.238751:0:8424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790771167.238751:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238758:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238762:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238766:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.238770:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238812:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.238816:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791488:192.168.204.50@tcp:104: 00010000:00010000:3.0:1790771167.238823:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771167.238826:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.238828:0:13763:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238834:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238839:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0f9bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238847:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238851:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238855:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238858:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.238860:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238864:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238871:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xc8b04d25 (ffff8bfb02b20c00) 00010000:00010000:3.0:1790771167.238873:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.238875:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238878:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238894:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0f9aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367fd expref: 127 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238902:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1a00/0xfa0c505d97f0fa0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367fd expref: 126 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.238906:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x5:0x0].0x0 (ffff8bfc3607dd00) 00010000:00010000:3.0:1790771167.238907:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790771167.238909:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1a00, rc 0) 00000100:00100000:3.0:1790771167.238935:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15088:x1877759534091392:12345-192.168.204.50@tcp:101:getfattr.0 Request processed in 1522us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.238940:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6634 00000100:00100000:0.0:1790771167.239572:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.239608:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534093696 00000100:00100000:1.0:1790771167.239614:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534093696 00000100:00100000:1.0:1790771167.239655:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6638 00000100:00100000:1.0:1790771167.239663:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+125:14872:x1877759534093696:12345-192.168.204.50@tcp:101:mkdir.0 00010000:00010000:1.0:1790771167.239670:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.239677:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0fa13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3683c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239707:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239714:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239719:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239728:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239733:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239737:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.239772:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb4:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.239797:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239802:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239806:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239810:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239813:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4b800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.239815:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239819:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239825:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.239827:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.239829:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239834:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4b800/0xfa0c505d97f0fa1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239840:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239844:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239849:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239856:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.239859:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239866:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239875:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc36078200) 00010000:00010000:1.0:1790771167.239878:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.239881:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239888:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a800/0xfa0c505d97f0fa21 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239912:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0fa13 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3683c expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239923:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.239925:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.239928:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4be00/0xfa0c505d97f0fa13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3683c expref: 127 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.239934:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05c4be00, rc 0) 00000100:00100000:1.0:1790771167.239958:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb064adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:14872:x1877759534093696:12345-192.168.204.50@tcp:101:mkdir.0 Request processed in 297us (389us total) trans 4294969502 rc 301/301 00000100:00100000:1.0:1790771167.239964:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6638 00000100:00100000:0.0:1790771167.243226:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.243263:0:13771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094720 00000100:00100000:1.0:1790771167.243269:0:13771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094720 00000100:00100000:1.0:1790771167.243298:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6639 00000100:00100000:1.0:1790771167.243303:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+126:13265:x1877759534094720:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.243311:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.243320:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fa2f lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36858 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243350:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243358:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243364:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243372:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243377:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243382:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.243418:0:13771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.243444:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243449:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243453:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243457:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243461:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.243463:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243467:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243472:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.243474:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.243476:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243499:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fa36 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243509:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243514:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243518:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243522:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.243524:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243528:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243533:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfc36078d00) 00010000:00010000:1.0:1790771167.243535:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.243537:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243541:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fa3d lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243566:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fa2f lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36858 expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243577:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:1.0:1790771167.243579:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.243583:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fa2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36858 expref: 128 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.243594:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00000100:00100000:1.0:1790771167.243629:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d1f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13265:x1877759534094720:12345-192.168.204.50@tcp:101:ls.0 Request processed in 324us (402us total) trans 4294969503 rc 301/301 00000100:00100000:1.0:1790771167.243637:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6639 00000100:00100000:2.0:1790771167.248115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.248153:0:13774:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092032 00000100:00100000:1.0:1790771167.248158:0:13774:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092032 00000100:00100000:1.0:1790771167.248187:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6640 00000100:00100000:1.0:1790771167.248193:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13293:x1877759534092032:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.248202:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.248210:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fa4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36812 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248242:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248251:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248258:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248267:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248273:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248277:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248291:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248295:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248300:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248305:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.248307:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248312:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248318:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.248321:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.248324:0:13774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248330:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248335:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fa52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.248344:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.248352:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248358:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248362:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248366:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.248368:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248372:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248378:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x391d5834 (ffff8bfc36078500) 00010000:00010000:1.0:1790771167.248380:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.248382:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248386:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fa59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x391d5834 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.248403:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534093056 00000100:00100000:0.0:1790771167.248405:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.248412:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fa4b lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36812 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.248412:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534093056 00010000:00010000:1.0:1790771167.248423:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.248425:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.248429:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fa4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36812 expref: 127 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.248438:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56a00, rc 0) 00000100:00100000:0.0:1790771167.248463:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1740 00000100:00100000:1.0:1790771167.248470:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:13293:x1877759534092032:12345-192.168.204.50@tcp:101:ls.0 Request processed in 276us (356us total) trans 0 rc 301/301 00000100:00100000:0.0:1790771167.248477:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:13264:x1877759534093056:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.248517:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6640 00000100:00100000:3.0:1790771167.248525:0:13788:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534090496 00000100:00100000:3.0:1790771167.248531:0:13788:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534090496 00000100:00100000:1.0:1790771167.248563:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791616:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248605:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc29015c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13264:x1877759534093056:12345-192.168.204.50@tcp:35:ls.0 Request processed in 134us (267us total) trans 4294969504 rc 0/0 00000100:00100000:0.0:1790771167.248612:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1740 00000100:00100000:1.0:1790771167.248626:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.248669:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534093440 00000100:00100000:2.0:1790771167.248676:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534093440 00000100:00100000:0.0:1790771167.248716:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1741 00000100:00100000:0.0:1790771167.248727:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:11864:x1877759534093440:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.248748:0:13788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1091 00000100:00100000:3.0:1790771167.248794:0:13788:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759534090496:12345-192.168.204.50@tcp:16:fallocate.0 00000100:00100000:0.0:1790771167.248828:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:11864:x1877759534093440:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (205us total) trans 4294968917 rc 0/0 00000100:00100000:0.0:1790771167.248836:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1741 00000100:00100000:0.0:1790771167.248874:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06739f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791232:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248889:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791360:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248899:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06739c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791744:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248912:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539791872:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248920:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792000:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248932:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06738000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792128:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248943:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792256:192.168.204.50@tcp:104: 00000100:00100000:2.0:1790771167.248951:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.248953:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792384:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248963:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb06739500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792512:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248968:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792640:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.248977:0:12030:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0673b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:12030:1877759539792768:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.248991:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094208 00000100:00100000:1.0:1790771167.248996:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094208 00000100:00100000:2.0:1790771167.249002:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.249038:0:12030:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.249039:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6641 00000100:00100000:2.0:1790771167.249051:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.249058:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:14395:x1877759534094208:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771167.249069:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.249079:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096256 00000100:00100000:0.0:1790771167.249082:0:13785:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094848 00010000:00010000:1.0:1790771167.249083:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fa60 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36851 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.249086:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096256 00000100:00100000:0.0:1790771167.249087:0:13785:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094848 00000100:00100000:2.0:1790771167.249098:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.249131:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.249135:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092160 00010000:00010000:1.0:1790771167.249142:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.249142:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092160 00000100:00100000:0.0:1790771167.249143:0:13785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:3.0:1790771167.249148:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6642 00000100:00100000:0.0:1790771167.249159:0:13785:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:14709:x1877759534094848:12345-192.168.204.50@tcp:36:mrename.0 00010000:00010000:1.0:1790771167.249159:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.249166:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:15044:x1877759534096256:12345-192.168.204.50@tcp:36:chown.0 00010000:00010000:1.0:1790771167.249186:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.249186:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6643 00010000:00010000:0.0:1790771167.249188:0:13785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1790771167.249196:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.249208:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249209:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373200/0xfa0c505d97f0f94f lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367da expref: 122 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.249209:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:15132:x1877759534092160:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:3.0:1790771167.249214:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5a00/0xfa0c505d97f0f9b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367f6 expref: 127 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249232:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.249233:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249246:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fa75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36820 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249248:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0f902 lrc: 0/0,0 mode: --/PR res: [0x240000403:0xf:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367be expref: 121 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249271:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 3/1,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249282:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.249282:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:3.0:1790771167.249288:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.249290:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97ef825f lrc: 0/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e2e48c expref: 120 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249299:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.249302:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249304:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249318:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:2.0:1790771167.249331:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.249334:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 127 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249341:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0f8d1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367a2 expref: 119 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.249348:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.249354:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.249355:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.249364:0:6495:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249371:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00000004:00010000:1.0:1790771167.249371:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249380:0:13785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.249385:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249392:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249397:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249399:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249400:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.249412:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 127 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249422:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249425:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249449:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.249450:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 127 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249451:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249460:0:13768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249481:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249515:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0fa9f lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249517:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249519:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.249527:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0fa9f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249527:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249534:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.249537:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3fa6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539793024:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.249548:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249551:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0fa9f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249573:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:2.0:1790771167.249576:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249578:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.249580:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0faa6 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249586:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249593:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.249599:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0faa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249602:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249605:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fa67 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.249608:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb061a7300 going to sleep for 11 seconds 00010000:00010000:0.0:1790771167.249611:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0faa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249629:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249636:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249643:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249660:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.249666:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249668:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.249676:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.249677:0:13768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249680:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249690:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249698:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249703:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249708:0:13785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 56 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249729:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc36078000) 00010000:00010000:2.0:1790771167.249730:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fa83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249737:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.249744:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249745:0:13785:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 4/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249752:0:13768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249763:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fa6e lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249777:0:13768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249781:0:13785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 56 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249795:0:13768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249796:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fa60 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36851 expref: 57 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.249799:0:13785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 57 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249822:0:13768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.249829:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb0305fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0001_UUID:13785:1877759539793152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.249830:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36851 expref: 56 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249830:0:13768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.249856:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:2.0:1790771167.249857:0:13768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.249863:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb07b3e9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790771167.249864:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.249872:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fa00, rc 0) 00010000:00010000:2.0:1790771167.249878:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc310f1e00) 00010000:00010000:2.0:1790771167.249884:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.249888:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.249890:0:13768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249898:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fa91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.249907:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:14395:x1877759534094208:12345-192.168.204.50@tcp:101:rm.0 Request processed in 851us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.249908:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097408 00000100:00100000:0.0:1790771167.249916:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097408 00000100:00100000:1.0:1790771167.249917:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6641 00010000:00010000:2.0:1790771167.249933:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fa75 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36820 expref: 127 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249944:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771167.249947:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.249950:0:13768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.249960:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fa75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36820 expref: 127 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.249966:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6644 00010000:00010000:2.0:1790771167.249982:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372200, rc 0) 00000100:00100000:0.0:1790771167.249984:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+119:13288:x1877759534097408:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.249997:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.250011:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fab4 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36866 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.250020:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15132:x1877759534092160:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 817us (926us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.250035:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.250036:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6643 00010000:00010000:0.0:1790771167.250043:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0fabb lrc: 3/1,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250052:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0fabb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250059:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0fabb lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.250068:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094976 00000100:00100000:2.0:1790771167.250075:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094976 00000004:00200000:0.0:1790771167.250082:0:13769:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x26:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.250086:0:13769:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.250098:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 128 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250107:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fab4 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36866 expref: 121 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250116:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.250128:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0fabb lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36866 expref: 120 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250135:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00000100:00100000:2.0:1790771167.250137:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095232 00010000:00010000:0.0:1790771167.250138:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1790771167.250142:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b5600, rc 0) 00000100:00100000:2.0:1790771167.250144:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095232 00000100:00100000:1.0:1790771167.250165:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.250169:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 56 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250177:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+120:13288:x1877759534097408:12345-192.168.204.50@tcp:101:ls.0 Request processed in 198us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.250185:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095744 00000100:00100000:3.0:1790771167.250193:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095744 00000100:00100000:0.0:1790771167.250194:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6644 00010000:00010000:3.0:1790771167.250213:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 57 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.250216:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1821 00000100:00100000:0.0:1790771167.250228:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1822 00000100:00100000:2.0:1790771167.250235:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2399:x1877759534094976:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.250242:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:2399:x1877759534095232:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.250250:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.250254:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.250260:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1823 00000100:00100000:1.0:1790771167.250261:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.250262:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 128 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250266:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 57 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250292:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 57 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250293:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.250295:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 128 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250312:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+57:2399:x1877759534095744:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.250320:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0f677 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366d7 expref: 57 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.250329:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.250335:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3f996000/0xfa0c505d97f0f5c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36675 expref: 128 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250339:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 57 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250344:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771167.250350:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.250354:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 19 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250370:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 18 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250371:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.250374:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:0.0:1790771167.250384:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.250385:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250389:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092544 00010000:00010000:3.0:1790771167.250391:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 56 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250396:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092544 00010000:00010000:2.0:1790771167.250405:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250411:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+56:2399:x1877759534095232:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 173us (298us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.250415:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06373600/0xfa0c505d97f0f504 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366bb expref: 56 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250424:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.250425:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6645 00000100:00100000:0.0:1790771167.250432:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1822 00000100:00100000:1.0:1790771167.250439:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15023:x1877759534092544:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:3.0:1790771167.250445:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.250447:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250451:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.250452:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250453:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095104 00000100:00100000:0.0:1790771167.250459:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095104 00010000:00010000:1.0:1790771167.250461:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fac2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36827 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250468:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250473:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 17 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250476:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 55 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250507:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.250515:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250530:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2399:x1877759534095744:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 259us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.250536:0:8425:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095488 00010000:00010000:1.0:1790771167.250537:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250538:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1823 00000100:00100000:0.0:1790771167.250542:0:8425:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095488 00010000:00010000:2.0:1790771167.250546:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.250552:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250558:0:8425:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 55 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250560:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1824 00010000:00010000:1.0:1790771167.250562:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250575:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2399:x1877759534095104:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.250582:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2399:x1877759534094976:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 349us (547us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.250590:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.250593:0:8425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1825 00010000:00010000:1.0:1790771167.250596:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250599:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 55 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250608:0:8425:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2399:x1877759534095488:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1790771167.250610:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1821 00010000:00010000:1.0:1790771167.250621:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250624:0:8425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790771167.250626:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 55 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250635:0:8425:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 55 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250659:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250671:0:13765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250675:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0f6b6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ec expref: 55 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250695:0:8425:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 55 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250704:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250705:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.250710:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250715:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250729:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 16 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250732:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.250737:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.250745:0:8425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0f670 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c9 expref: 54 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250747:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250759:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+54:2399:x1877759534095104:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 187us (441us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.250767:0:8425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:3.0:1790771167.250770:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1824 00010000:00010000:0.0:1790771167.250774:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.250776:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x45:0x0]: returning size 14473 00000004:00200000:1.0:1790771167.250782:0:6494:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.250785:0:8425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250791:0:8425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:1.0:1790771167.250794:0:6494:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x59/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.250800:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000037156d9e reply state 00000000f9a2bb6e transno 4294969505 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250803:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250815:0:8425:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:2399:x1877759534095488:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 213us (469us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.250826:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790771167.250826:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967658 is committed 00010000:00010000:2.0:1790771167.250830:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250832:0:8425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1825 00000001:00080000:3.0:1790771167.250834:0:9490:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967657 is committed 00010000:00010000:1.0:1790771167.250847:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250851:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.250856:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.250856:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.250862:0:13765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250868:0:13781:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097792 00010000:00010000:1.0:1790771167.250870:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250872:0:13781:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097792 00010000:00010000:2.0:1790771167.250877:0:13765:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250882:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.250890:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250891:0:13788:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2398:x1877759534090496:12345-192.168.204.50@tcp:16:fallocate.0 Request processed in 2133us (2484us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.250892:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.250901:0:13781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1092 00010000:00010000:1.0:1790771167.250913:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.250914:0:13788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1091 00000100:00100000:0.0:1790771167.250915:0:13781:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2399:x1877759534097792:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:0.0:1790771167.250931:0:13781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.250934:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771167.250938:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.250939:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.250944:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250945:0:13781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005adfc7f8/0xfa0c505d97f0fade lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36874 expref: -99 pid: 13781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250961:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250968:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.250970:0:13781:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790771167.250980:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.250987:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.250988:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=167s v=(0 0) 00010000:00010000:0.0:1790771167.250998:0:13781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1790771167.250999:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15037:x1877759534084736:12345-192.168.204.50@tcp:36:cp.0 Request processed in 22729us (22875us total) trans 4294969505 rc 0/0 00010000:00010000:1.0:1790771167.251000:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251010:0:13781:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005adfc7f8/0xfa0c505d97f0fade lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36874 expref: 23 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251017:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:3.0:1790771167.251019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.251024:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.251026:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6616 00010000:00010000:1.0:1790771167.251039:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251044:0:13781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005adfc7f8/0xfa0c505d97f0fade lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36874 expref: 23 pid: 13781 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251050:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x61bf1dfb (ffff8bfc36078300) 00010000:00010000:1.0:1790771167.251054:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.251057:0:13781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb064b4000, rc 0) 00010000:00010000:1.0:1790771167.251058:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251070:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fad0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x61bf1dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251070:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.251071:0:13770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251083:0:13781:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+23:2399:x1877759534097792:12345-192.168.204.50@tcp:101:cat.0 Request processed in 169us (827us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.251096:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251103:0:13781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1092 00000100:00100000:3.0:1790771167.251119:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.251124:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fac2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36827 expref: 129 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251129:0:8414:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094336 00000004:00200000:2.0:1790771167.251129:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00100000:0.0:1790771167.251135:0:8414:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094336 00000004:00200000:2.0:1790771167.251136:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.251142:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x45:0x0].0x0 bits 0x19/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36827 expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251149:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00010000:00010000:1.0:1790771167.251152:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00000004:00010000:2.0:1790771167.251153:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251155:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fc00, rc 0) 00010000:00010000:2.0:1790771167.251169:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251173:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 469 00000100:00100000:3.0:1790771167.251174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.251183:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15023:x1877759534092544:12345-192.168.204.50@tcp:101:dd.0 Request processed in 745us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.251188:0:8414:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+19:2399:x1877759534094336:12345-192.168.204.50@tcp:22:fallocate.0 00000100:00100000:1.0:1790771167.251195:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6645 00010000:00010000:2.0:1790771167.251206:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff600/0xfa0c505d97f0f8a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36794 expref: 129 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.251212:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534092800 00000100:00100000:1.0:1790771167.251217:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534092800 00010000:00010000:2.0:1790771167.251228:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35ffe400/0xfa0c505d97f0f8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36794 expref: 128 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251238:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771167.251242:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.251246:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35ffe400, rc 0) 00000100:00100000:1.0:1790771167.251252:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6646 00000100:00100000:3.0:1790771167.251252:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.251264:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15112:x1877759534092800:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:1.0:1790771167.251272:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.251281:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fae5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3682e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.251288:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb size from disk: 4196581 -> 4196581 00002000:00010000:0.0:1790771167.251293:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb mtime from disk: 1790771167 -> 1790771167 00000100:00100000:2.0:1790771167.251294:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:14635:x1877759534086016:12345-192.168.204.50@tcp:101:cat.0 Request processed in 22293us (22393us total) trans 0 rc 0/0 00002000:00010000:0.0:1790771167.251299:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb atime from disk: 1790771166 -> 1790771166 00000100:00100000:3.0:1790771167.251301:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:0.0:1790771167.251305:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00010000:00010000:1.0:1790771167.251307:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790771167.251311:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x1e:0x0] updating lvb blocks from disk: 8200 -> 8200 00010000:00010000:1.0:1790771167.251323:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.251330:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6620 00000100:00100000:3.0:1790771167.251337:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.251341:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251343:0:8414:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2399:x1877759534094336:12345-192.168.204.50@tcp:22:fallocate.0 Request processed in 157us (1051us total) trans 4294967659 rc 0/0 00000100:00100000:0.0:1790771167.251358:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 469 00010000:00010000:1.0:1790771167.251364:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251371:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.251376:0:6479:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096000 00010000:00010000:1.0:1790771167.251378:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251381:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.251383:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095872 00000100:00100000:2.0:1790771167.251384:0:6479:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096000 00000100:00100000:0.0:1790771167.251390:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095872 00010000:00010000:1.0:1790771167.251399:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251401:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096512 00000100:00100000:3.0:1790771167.251407:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096512 00010000:00010000:1.0:1790771167.251409:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251415:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 54 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251416:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 54 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251418:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.251425:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 54 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251442:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251452:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096768 00010000:00010000:1.0:1790771167.251453:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.251457:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096768 00010000:00010000:1.0:1790771167.251458:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251466:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251476:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251476:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771167.251508:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1826 00010000:00010000:1.0:1790771167.251515:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.251519:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1827 00010000:00010000:1.0:1790771167.251520:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.251526:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2397:x1877759534095872:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.251531:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251534:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2399:x1877759534096000:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.251538:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1828 00010000:00010000:2.0:1790771167.251543:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.251551:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0faec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.251553:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.251556:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251557:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+55:2397:x1877759534096512:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.251563:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251575:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251576:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.251586:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 55 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251594:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251602:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251622:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.251627:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251638:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.251655:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251660:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 55 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251666:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251677:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfc36078400) 00010000:00010000:1.0:1790771167.251679:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.251684:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251684:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592a00/0xfa0c505d97f0f4fd lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366ad expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.251690:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3800/0xfa0c505d97f0f6af lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 17 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366e5 expref: 55 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251695:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cf3a00/0xfa0c505d97f0f4ef lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 18 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366a6 expref: 55 pid: 13771 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251704:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ee00/0xfa0c505d97f0faf3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251726:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:2.0:1790771167.251732:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251740:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251747:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fae5 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3682e expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251749:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.251749:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.251757:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.251770:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251771:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:2.0:1790771167.251780:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:2397:x1877759534095872:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 258us (480us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.251782:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.251782:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.251783:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:1.0:1790771167.251789:0:6494:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.251790:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.251797:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1826 00000100:00100000:3.0:1790771167.251808:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+52:2399:x1877759534096000:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 277us (792us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.251815:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.251818:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fae5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3682e expref: 128 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251822:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1827 00000100:00100000:2.0:1790771167.251835:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1829 00010000:00010000:0.0:1790771167.251837:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.251843:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fe00, rc 0) 00000100:00100000:2.0:1790771167.251853:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:2397:x1877759534096768:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.251865:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+50:2397:x1877759534096512:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 313us (533us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.251866:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.251877:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 50 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251879:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1828 00000100:00100000:1.0:1790771167.251882:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:15112:x1877759534092800:12345-192.168.204.50@tcp:101:chown.0 Request processed in 615us (812us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.251898:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.251904:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6646 00010000:00010000:2.0:1790771167.251910:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 49 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.251918:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097152 00000100:00100000:0.0:1790771167.251923:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097152 00010000:00010000:2.0:1790771167.251928:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb06592600/0xfa0c505d97f0f4e8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3669f expref: 50 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251944:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.251946:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 49 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.251946:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb029c0380 pname:cluuid:pid:xid:nid:opc:job mdt00_009:lustre-MDT0000_UUID:13764:1877759539792896:192.168.204.50@tcp:104: 00010000:00010000:2.0:1790771167.251953:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.251954:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.251970:0:13764:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251975:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.251985:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.251992:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098048 00000100:00100000:3.0:1790771167.251996:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.251997:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098048 00000100:00100000:0.0:1790771167.252002:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1830 00000100:00100000:3.0:1790771167.252017:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098688 00000100:00100000:2.0:1790771167.252018:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:2397:x1877759534096768:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 168us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.252020:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+49:2397:x1877759534097152:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.252022:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098688 00000100:00100000:1.0:1790771167.252025:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098304 00000100:00100000:1.0:1790771167.252031:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098304 00010000:00010000:0.0:1790771167.252039:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.252039:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1829 00010000:00010000:0.0:1790771167.252048:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 49 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.252058:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098816 00010000:00010000:0.0:1790771167.252060:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 48 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.252063:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098816 00000100:00100000:3.0:1790771167.252065:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 923 00010000:00010000:0.0:1790771167.252084:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05c4bc00/0xfa0c505d97f0f4b7 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36691 expref: 48 pid: 13768 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.252086:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2397:x1877759534098688:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.252089:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1742 00000100:00100000:2.0:1790771167.252091:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098432 00000100:00100000:2.0:1790771167.252099:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098432 00000100:00100000:1.0:1790771167.252104:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14098:x1877759534098048:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:3.0:1790771167.252107:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.252110:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.252114:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252120:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252126:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.252126:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0f9e9 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36804 expref: 128 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.252132:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00002000:00100000:2.0:1790771167.252134:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (626688->630783) req@ffff8bfc3fa6df80 x1877759534098432/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000004:00200000:1.0:1790771167.252139:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.252149:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+47:2397:x1877759534097152:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 135us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.252149:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00000100:00100000:0.0:1790771167.252165:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1830 00002000:00100000:2.0:1790771167.252165:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa6df80 with x1877759534098432 ext(626688->630783) 00000100:00100000:1.0:1790771167.252173:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14098:x1877759534098048:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 72us (1056us total) trans 0 rc 0/0 00002000:00010000:2.0:1790771167.252175:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa6df80 00000100:00100000:1.0:1790771167.252181:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1742 00000100:00100000:0.0:1790771167.252206:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 470 00000100:00100000:1.0:1790771167.252207:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1743 00010000:00010000:3.0:1790771167.252220:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.252229:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534098432:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771167.252230:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3fa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13743:x1877759534098304:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:2.0:1790771167.252241:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1744 00000100:00100000:3.0:1790771167.252246:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:2397:x1877759534098688:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.252253:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 923 00000100:00100000:2.0:1790771167.252259:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11370450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:12255:x1877759534098816:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:1.0:1790771167.252318:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13743:x1877759534098304:12345-192.168.204.50@tcp:35:ls.0 Request processed in 100us (1150us total) trans 4294968918 rc 0/0 00000100:00100000:1.0:1790771167.252326:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1743 00000100:00100000:0.0:1790771167.252348:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fa6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2397:x1877759534098432:12345-192.168.204.50@tcp:3:cat.0 Request processed in 129us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.252356:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.252363:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 470 00002000:00100000:0.0:1790771167.252369:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (626688->630783) req@ffff8bfc3fa6df80 x1877759534098432/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1790771167.252378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:0.0:1790771167.252387:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfc3fa6df80 with x1877759534098432 ext(626688->630783) 00002000:00010000:0.0:1790771167.252391:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfc3fa6df80 00000100:00100000:1.0:1790771167.252403:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099328 00000100:00100000:1.0:1790771167.252407:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099328 00000100:00100000:3.0:1790771167.252412:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.252427:0:13791:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095616 00000100:00100000:0.0:1790771167.252432:0:13791:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095616 00000100:00100000:1.0:1790771167.252438:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1745 00000100:00100000:3.0:1790771167.252444:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.252452:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14078:x1877759534099328:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:0.0:1790771167.252458:0:13791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 47 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.252462:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534100480 00000100:00100000:3.0:1790771167.252468:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534100480 00000004:00200000:1.0:1790771167.252511:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000100:00100000:3.0:1790771167.252515:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534100736 00000004:00200000:1.0:1790771167.252516:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.252521:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534100736 00000100:00100000:0.0:1790771167.252524:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1831 00000100:00100000:0.0:1790771167.252539:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+47:2397:x1877759534095616:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.252546:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14078:x1877759534099328:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.252547:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6647 00010000:00010000:0.0:1790771167.252550:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.252562:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 47 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.252566:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:13271:x1877759534100480:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:1.0:1790771167.252567:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1745 00010000:00010000:3.0:1790771167.252582:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.252583:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 47 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252593:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0fafa lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36889 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252598:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04caee00/0xfa0c505d97f0f50b lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366c2 expref: 47 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.252605:0:13774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6648 00010000:00010000:0.0:1790771167.252619:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00000100:00100000:1.0:1790771167.252625:0:13774:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14882:x1877759534100736:12345-192.168.204.50@tcp:101:dd.0 00010000:00010000:0.0:1790771167.252626:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252635:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252642:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252659:0:13774:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.252661:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.252664:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252671:0:13774:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fb08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36890 expref: -99 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252677:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.252681:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:2397:x1877759534095616:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 146us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.252696:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1831 00010000:00010000:3.0:1790771167.252709:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252716:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252722:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252728:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252738:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252745:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.252753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.252759:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252767:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.252768:0:13783:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099200 00000004:00200000:3.0:1790771167.252770:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00000100:00100000:0.0:1790771167.252774:0:13783:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099200 00010000:00010000:1.0:1790771167.252779:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252792:0:13783:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 46 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.252811:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1832 00010000:00010000:3.0:1790771167.252811:0:13772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252814:0:13774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.252826:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:2399:x1877759534099200:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.252836:0:13774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252836:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252837:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.252846:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 46 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252860:0:13774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252873:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252874:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 46 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.252884:0:13774:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.252893:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252900:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.252901:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252902:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686400/0xfa0c505d97f0f4f6 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366b4 expref: 46 pid: 13765 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252903:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252927:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252928:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252932:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.252941:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252951:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.252953:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252955:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.252964:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.252969:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 3/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.252970:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.252971:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.252977:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.252980:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fb01 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.252990:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.252991:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:2399:x1877759534099200:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 166us (236us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.252999:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253007:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1832 00010000:00010000:3.0:1790771167.253008:0:13772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253014:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:3.0:1790771167.253015:0:13772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253018:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.253024:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253026:0:13772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253035:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fb2b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.253042:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.253044:0:13772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.253050:0:13772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253054:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253056:0:13772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253069:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253074:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfc3607d600) 00010000:00010000:1.0:1790771167.253075:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253079:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.253084:0:13772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253086:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.253091:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253093:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fb0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253101:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534094080 00010000:00010000:1.0:1790771167.253104:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253107:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534094080 00000100:00100000:2.0:1790771167.253110:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.253127:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:1.0:1790771167.253129:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.253132:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253137:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fb16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253139:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096384 00000100:00100000:0.0:1790771167.253144:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096384 00010000:00010000:3.0:1790771167.253145:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0fafa lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36889 expref: 131 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253147:0:13774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253160:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 127 pid: 13772 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.253161:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.253171:0:13774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253171:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.253177:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790771167.253183:0:13774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253185:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0fafa lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36889 expref: 131 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253186:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096640 00000100:00100000:0.0:1790771167.253191:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096640 00010000:00010000:1.0:1790771167.253199:0:13774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57200 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:2.0:1790771167.253204:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.253206:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 45 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253206:0:13774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253209:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686000, rc 0) 00010000:00010000:1.0:1790771167.253227:0:13774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.253234:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13271:x1877759534100480:12345-192.168.204.50@tcp:101:ls.0 Request processed in 675us (862us total) trans 4294969506 rc 301/301 00010000:00010000:1.0:1790771167.253237:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc8b04d25 (ffff8bfc36078d00) 00010000:00010000:1.0:1790771167.253243:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.253244:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534096896 00010000:00010000:1.0:1790771167.253248:0:13774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.253248:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6647 00000100:00100000:0.0:1790771167.253250:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534096896 00000100:00100000:2.0:1790771167.253254:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.253261:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fb1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253268:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 46 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.253276:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6649 00000100:00100000:2.0:1790771167.253283:0:6480:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097280 00000100:00100000:2.0:1790771167.253289:0:6480:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097280 00000100:00100000:3.0:1790771167.253289:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14511:x1877759534094080:12345-192.168.204.50@tcp:101:rm.0 00010000:00010000:1.0:1790771167.253297:0:13774:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fb08 lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36890 expref: 129 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253299:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098560 00010000:00010000:3.0:1790771167.253300:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.253305:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098560 00010000:00010000:1.0:1790771167.253309:0:13774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771167.253313:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fb32 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36843 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253314:0:13774:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.253316:0:6480:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253322:0:13774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fb08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36890 expref: 130 pid: 13774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253323:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 130 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253353:0:13774:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0487ec00, rc 0) 00000100:00100000:1.0:1790771167.253374:0:13774:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_019:82a25f2c-222e-4ba7-abee-8e26bca511e6+129:14882:x1877759534100736:12345-192.168.204.50@tcp:101:dd.0 Request processed in 757us (931us total) trans 0 rc 301/301 00010000:00010000:3.0:1790771167.253376:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0fb39 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.253380:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1833 00000100:00100000:1.0:1790771167.253391:0:13774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6648 00000100:00100000:0.0:1790771167.253393:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1834 00010000:00010000:3.0:1790771167.253395:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0fb39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.253399:0:6480:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc08562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2397:x1877759534096384:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.253407:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0fb39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253408:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:2397:x1877759534096640:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.253418:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00200000:3.0:1790771167.253421:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.253424:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.253429:0:6480:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 128 pid: 13772 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253434:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 46 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253435:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1835 00000100:00100000:1.0:1790771167.253450:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+46:2397:x1877759534096896:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.253462:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.253464:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 46 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253465:0:6480:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 130 pid: 13772 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253470:0:9499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 46 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253510:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb04c81000/0xfa0c505d97f0f6a8 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e366de expref: 46 pid: 13770 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253519:0:9499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 46 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253535:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.253544:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253550:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253552:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fb32 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36843 expref: 130 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253559:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593400/0xfa0c505d97f0f7ea lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36771 expref: 130 pid: 13772 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253565:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.253575:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687200/0xfa0c505d97f0f4be lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36698 expref: 45 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253582:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668c00/0xfa0c505d97f0fb39 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x7d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36843 expref: 128 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253585:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:2397:x1877759534096640:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 180us (481us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.253586:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.253598:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253605:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1834 00010000:00010000:3.0:1790771167.253607:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:1.0:1790771167.253610:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:3.0:1790771167.253615:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771167.253621:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668c00, rc 0) 00000100:00100000:0.0:1790771167.253622:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1836 00010000:00010000:1.0:1790771167.253622:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253625:0:6480:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253634:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2397:x1877759534097280:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790771167.253656:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.253660:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:14511:x1877759534094080:12345-192.168.204.50@tcp:101:rm.0 Request processed in 356us (661us total) trans 4294969507 rc 0/0 00010000:00010000:0.0:1790771167.253661:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.253665:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253671:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253675:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.253685:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6649 00010000:00010000:2.0:1790771167.253695:0:6480:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253696:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d357100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+43:2397:x1877759534096896:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 250us (543us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.253698:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253716:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1835 00000100:00100000:3.0:1790771167.253726:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1837 00010000:00010000:0.0:1790771167.253729:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0f30c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36605 expref: 123 pid: 13773 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253735:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790771167.253740:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:2397:x1877759534098560:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.253741:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.253749:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253754:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.253755:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253762:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 128 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.253765:0:6480:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc08562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759534096384:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 368us (726us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.253769:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253793:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.253793:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1833 00010000:00010000:3.0:1790771167.253793:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 128 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253801:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790771167.253815:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c80200/0xfa0c505d97f0f64d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36716 expref: 128 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253818:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099072 00000100:00100000:1.0:1790771167.253824:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099072 00000100:00100000:0.0:1790771167.253825:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d354e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2397:x1877759534097280:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 190us (626us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.253831:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771167.253836:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1836 00010000:00010000:3.0:1790771167.253837:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.253844:0:9499:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 127 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253847:0:13784:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253862:0:13784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253877:0:13773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253882:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790771167.253883:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1838 00010000:00010000:2.0:1790771167.253894:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.253898:0:13791:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:2397:x1877759534099072:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1790771167.253905:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+127:2397:x1877759534098560:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 167us (657us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.253913:0:13791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1790771167.253918:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1837 00010000:00010000:0.0:1790771167.253922:0:13791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 127 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253932:0:13791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 127 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253948:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253949:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf3400/0xfa0c505d97f0f845 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x9:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3679b expref: 127 pid: 13774 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.253967:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253973:0:13791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:0.0:1790771167.253979:0:13791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.253981:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.253982:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.253987:0:13773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.253990:0:13791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254000:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099456 00000100:00100000:1.0:1790771167.254006:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099456 00010000:00010000:0.0:1790771167.254007:0:13791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254009:0:13773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254021:0:13773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.254025:0:13791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.254035:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1746 00000100:00100000:0.0:1790771167.254044:0:13791:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:2397:x1877759534099072:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 147us (254us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.254046:0:13773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.254049:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254052:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15088:x1877759534099456:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:2.0:1790771167.254055:0:13773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.254063:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1838 00010000:00010000:3.0:1790771167.254074:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254076:0:13773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x40218400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.254086:0:12030:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.254088:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.254093:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00000004:00200000:1.0:1790771167.254095:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.254100:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254102:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1790771167.254108:0:13773:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254117:0:13773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254125:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:15088:x1877759534099456:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 77us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.254127:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254136:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1746 00010000:00010000:2.0:1790771167.254162:0:13773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254163:0:13764:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.254173:0:12030:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcae2eb2 reply state 000000002793eeb0 transno 4294968919 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254187:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0f7f1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x33:0x0].0x0 bits 0x22/0x0 rrc: 8 type: IBT flags: 0x44a19400000020 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.254200:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05687c00/0xfa0c505d97f0f909 lrc: 3/0,1 mode: TXN/TXN res: [0x240000403:0x32:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254202:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.254217:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.254220:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1790771167.254222:0:12030:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790771167.254238:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14991:x1877759534082944:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 89252us (89668us total) trans 0 rc -61/-61 00000004:00200000:1.0:1790771167.254242:0:13764:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00000004:00200000:1.0:1790771167.254249:0:13764:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1790771167.254250:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+44:14947:x1877759534088832:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 23370us (23622us total) trans 4294968919 rc 0/0 00000100:00100000:2.0:1790771167.254251:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6608 00000100:00100000:0.0:1790771167.254262:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6625 00000004:00010000:1.0:1790771167.254268:0:13764:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254281:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254287:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254292:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254304:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254305:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254322:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254328:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058aec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.254332:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254337:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254339:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790771167.254340:0:13766:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x28:0x0], index 0: 0 00010000:00010000:1.0:1790771167.254347:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.254353:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.254357:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254359:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254372:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aec00/0xfa0c505d97f0f979 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254382:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254385:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254401:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254407:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254411:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb058ae800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.254414:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254419:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254425:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x510a92c1 (ffff8bfc36078a00) 00010000:00010000:1.0:1790771167.254428:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.254430:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254434:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058ae800/0xfa0c505d97f0f987 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x510a92c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254449:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0fb55 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254461:0:13762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254464:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058af400/0xfa0c505d97f0f964 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367e8 expref: 126 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254478:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.254531:0:13762:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x7d:0x0]: returning size 4096 00000004:00200000:2.0:1790771167.254535:0:13762:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790771167.254550:0:13762:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0fb55 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254565:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254566:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb058aea00/0xfa0c505d97f0f995 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367e8 expref: 125 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254590:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254591:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:3.0:1790771167.254595:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0fb5c lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.254599:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.254605:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb058aea00, rc 0) 00010000:00010000:2.0:1790771167.254615:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254625:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06593c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.254629:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254638:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15032:x1877759534091008:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 17504us (17679us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.254641:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.254657:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6631 00010000:00010000:3.0:1790771167.254664:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254674:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0x0 (ffff8bfc0ab7ee00) 00010000:00010000:2.0:1790771167.254679:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.254684:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254692:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06593c00/0xfa0c505d97f0f830 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254706:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254714:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254722:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254728:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.254732:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254743:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254752:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x33:0x0].0xbc0ca3a9 (ffff8bfc310f1600) 00010000:00010000:2.0:1790771167.254755:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.254760:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 2/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254767:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb4e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x33:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254798:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592800/0xfa0c505d97f0f829 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x33:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3677f expref: 128 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.254813:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0fb5c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.254818:0:13762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372400/0xfa0c505d97f0fb55 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x7d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3677f expref: 127 pid: 13762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.254826:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.254834:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0x0 (ffff8bfb03218700) 00010000:00010000:2.0:1790771167.254837:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790771167.254840:0:13762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372400, rc 0) 00000100:00100000:0.0:1790771167.254853:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.254868:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099712 00000100:00100000:1.0:1790771167.254874:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099712 00010000:00010000:3.0:1790771167.254878:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.254885:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:15069:x1877759534084480:12345-192.168.204.50@tcp:101:rm.0 Request processed in 76123us (76333us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.254888:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.254896:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.254904:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.254910:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6611 00000100:00100000:1.0:1790771167.254914:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1747 00010000:00010000:3.0:1790771167.254916:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.254917:0:13769:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534093184 00010000:00010000:3.0:1790771167.254923:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.254924:0:13769:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534093184 00000100:00100000:1.0:1790771167.254925:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14872:x1877759534099712:12345-192.168.204.50@tcp:35:mkdir.0 00000100:00100000:2.0:1790771167.254940:0:13762:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534099840 00010000:00010000:3.0:1790771167.254940:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.254947:0:13762:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534099840 00000100:00100000:0.0:1790771167.254961:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6650 00010000:00010000:3.0:1790771167.254962:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:3.0:1790771167.254967:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.254971:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.254976:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:14803:x1877759534093184:12345-192.168.204.50@tcp:101:cp.0 00000100:00100000:2.0:1790771167.254988:0:13762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6651 00010000:00010000:3.0:1790771167.254990:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0f853 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.254997:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.255004:0:13762:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15082:x1877759534099840:12345-192.168.204.50@tcp:36:setfattr.0 00000004:00010000:3.0:1790771167.255006:0:13766:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000818007e8 reply state 00000000d8a7b3ce transno 4294969508 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.255012:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0fb6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36835 expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.255014:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14872:x1877759534099712:12345-192.168.204.50@tcp:35:mkdir.0 Request processed in 88us (190us total) trans 4294969509 rc 0/0 00000100:00100000:1.0:1790771167.255032:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1747 00010000:00010000:3.0:1790771167.255034:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.255043:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfc3607db00) 00010000:00010000:3.0:1790771167.255045:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.255047:0:13766:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.255053:0:13762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.255067:0:13762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 127 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.255071:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0f84c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367b0 expref: 128 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.255079:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0fb6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36835 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.255092:0:13762:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.255106:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05668800/0xfa0c505d97f0fb5c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367b0 expref: 127 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.255108:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1a600/0xfa0c505d97f0fb6a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36835 expref: 127 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.255129:0:13762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 127 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.255131:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb3:0x0].0x0 (ffff8bfb02b20200) 00010000:00010000:0.0:1790771167.255136:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb8:0x0].0x0 (ffff8bfc310f1200) 00010000:00010000:3.0:1790771167.255139:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.255144:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790771167.255144:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05668800, rc 0) 00010000:00010000:0.0:1790771167.255151:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1a600, rc 0) 00010000:00010000:2.0:1790771167.255153:0:13762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 127 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.255168:0:13762:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc2d356680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539793280:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.255185:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14803:x1877759534093184:12345-192.168.204.50@tcp:101:cp.0 Request processed in 216us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.255192:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6650 00000100:00100000:2.0:1790771167.255221:0:13762:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb0668cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1790771167.255235:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3fb61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+128:14756:x1877759534086784:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 73960us (74046us total) trans 4294969508 rc 0/0 00000100:00100000:3.0:1790771167.255242:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6613 00000100:00100000:1.0:1790771167.261213:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.261242:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.261263:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.261276:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534102400 00000100:00100000:1.0:1790771167.261282:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.261285:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534102400 00000100:00100000:1.0:1790771167.261306:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.261324:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534108416 00000100:00100000:2.0:1790771167.261327:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534093952 00000100:00100000:1.0:1790771167.261330:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534100096 00000100:00100000:0.0:1790771167.261331:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534108416 00000100:00100000:2.0:1790771167.261334:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534093952 00000100:00100000:1.0:1790771167.261336:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534100096 00000100:00100000:1.0:1790771167.261374:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534100224 00000100:00100000:1.0:1790771167.261377:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534100224 00000100:00100000:0.0:1790771167.261381:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6652 00000100:00100000:3.0:1790771167.261386:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.261394:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6653 00000100:00100000:0.0:1790771167.261395:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:15173:x1877759534102400:12345-192.168.204.50@tcp:101:lfs.0 00000100:00100000:1.0:1790771167.261403:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1748 00010000:00010000:0.0:1790771167.261408:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1790771167.261413:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14882:x1877759534108416:12345-192.168.204.50@tcp:101:dd.0 00000100:00100000:1.0:1790771167.261415:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13265:x1877759534100096:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:0.0:1790771167.261419:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0fb78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368ac expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261428:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.261442:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36985 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.261468:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3fa6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6495:1877759539793024:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.261479:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0fb86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.261505:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261512:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0fb86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261521:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0fb86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.261528:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x1f:0x0]: returning size 76520 00010000:00010000:2.0:1790771167.261542:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261556:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.261564:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+134:13265:x1877759534100096:12345-192.168.204.50@tcp:35:ls.0 Request processed in 151us (281us total) trans 4294969510 rc 0/0 00010000:00010000:2.0:1790771167.261569:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.261575:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1748 00010000:00010000:0.0:1790771167.261586:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1bc00/0xfa0c505d97f0fb78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368ac expref: 135 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261593:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261604:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b000/0xfa0c505d97f0fb86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368ac expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.261605:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1749 00010000:00010000:2.0:1790771167.261608:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.261625:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:12240:x1877759534100224:12345-192.168.204.50@tcp:37:ls.0 00010000:00010000:2.0:1790771167.261634:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261662:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1f:0x0].0x0 (ffff8bfc3600f600) 00010000:00010000:0.0:1790771167.261667:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790771167.261671:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05a1b000, rc 0) 00000100:00100000:3.0:1790771167.261678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.261699:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.261705:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534101248 00000100:00100000:0.0:1790771167.261706:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+133:15173:x1877759534102400:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 310us (490us total) trans 4294969511 rc 0/0 00000100:00100000:3.0:1790771167.261713:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534101248 00010000:00010000:2.0:1790771167.261719:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.261725:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6652 00010000:00010000:2.0:1790771167.261735:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.261744:0:6494:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x6d:0x0]: returning size 4096 00000100:00100000:3.0:1790771167.261746:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534095360 00000100:00100000:3.0:1790771167.261750:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534095360 00010000:00010000:2.0:1790771167.261755:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.261760:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6654 00010000:00010000:2.0:1790771167.261770:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.261775:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15156:x1877759534093952:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:3.0:1790771167.261782:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6655 00010000:00010000:2.0:1790771167.261789:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261793:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.261796:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15040:x1877759534101248:12345-192.168.204.50@tcp:36:cp.0 00010000:00010000:2.0:1790771167.261805:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.261807:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0fba9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3684a expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261810:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261829:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.261838:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261840:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:2.0:1790771167.261848:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.261857:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.261857:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261858:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.261879:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261881:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fba2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261885:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261907:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261910:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261923:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261928:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261931:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261940:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261944:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261949:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261952:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.261960:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261972:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.261983:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:2.0:1790771167.261986:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.261990:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 3/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.261992:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790771167.261995:0:13772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].44, 88 off11608 00010000:00010000:2.0:1790771167.262001:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fb8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262008:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262014:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262015:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.262028:0:13772:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001042db23 reply state 0000000018191bf6 transno 4294969512 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262038:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.262042:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.262052:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0x2:0x0]: returning size 38336 00010000:00010000:2.0:1790771167.262053:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.262055:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc310f1800) 00000004:00200000:0.0:1790771167.262057:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.262062:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1790771167.262067:0:13772:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790771167.262070:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373400 already unused, calling callback (ffffffffc18aa4f0) 00000004:00010000:0.0:1790771167.262071:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262079:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262082:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262091:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262094:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262105:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262106:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xc8b04d25 (ffff8bfc310f1600) 00000100:00100000:3.0:1790771167.262111:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb029c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:15040:x1877759534101248:12345-192.168.204.50@tcp:36:cp.0 Request processed in 317us (733us total) trans 4294969512 rc 0/0 00010000:00010000:2.0:1790771167.262118:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.262119:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262125:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.262126:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6655 00010000:00010000:0.0:1790771167.262136:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262142:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6656 00010000:00010000:0.0:1790771167.262157:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1b800 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.262157:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14647:x1877759534095360:12345-192.168.204.50@tcp:101:cat.0 00010000:00010000:2.0:1790771167.262159:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fb9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0xc8b04d25 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262168:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262170:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.262181:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.262182:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262183:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fbcc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3685f expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262194:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb7f lrc: 1/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36985 expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262212:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771167.262216:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:0.0:1790771167.262218:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.262220:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.262225:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262228:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fb7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36985 expref: 132 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.262236:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.262240:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262250:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1b800/0xfa0c505d97f0fbb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262259:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372e00, rc 0) 00010000:00010000:1.0:1790771167.262261:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262269:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262270:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262278:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534101376 00000100:00100000:2.0:1790771167.262284:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534101376 00010000:00010000:0.0:1790771167.262289:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262296:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262300:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05a1ba00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.262304:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.262305:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x9:0x0]: returning size 13255 00010000:00010000:2.0:1790771167.262311:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 132 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262315:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.262315:0:12128:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.262317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00010000:1.0:1790771167.262335:0:12128:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262336:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x7a94fdef (ffff8bfc03c5ed00) 00010000:00010000:0.0:1790771167.262342:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.262347:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262353:0:13797:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534101632 00010000:00010000:0.0:1790771167.262360:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ba00/0xfa0c505d97f0fbbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262360:0:13797:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534101632 00010000:00010000:1.0:1790771167.262367:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fbcc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3685f expref: 133 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262379:0:13797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 44 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262386:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3685f expref: 133 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262391:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05a1ae00/0xfa0c505d97f0fba9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3684a expref: 133 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262406:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771167.262414:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1790771167.262415:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.262416:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1839 00010000:00010000:1.0:1790771167.262418:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56800, rc 0) 00010000:00010000:0.0:1790771167.262423:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05e84400/0xfa0c505d97f0fbc5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3684a expref: 132 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262430:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00000100:00100000:2.0:1790771167.262432:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+132:2397:x1877759534101376:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.262434:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.262438:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05e84400, rc 0) 00010000:00010000:2.0:1790771167.262447:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.262454:0:13797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 132 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262472:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:14647:x1877759534095360:12345-192.168.204.50@tcp:101:cat.0 Request processed in 318us (846us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.262474:0:13797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 132 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.262482:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+132:15156:x1877759534093952:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 707us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.262504:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.262511:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6656 00000100:00100000:0.0:1790771167.262528:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6654 00000100:00100000:1.0:1790771167.262534:0:12128:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534102144 00010000:00010000:2.0:1790771167.262535:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592200/0xfa0c505d97f0f7dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3676a expref: 132 pid: 13763 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262539:0:12128:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534102144 00010000:00010000:2.0:1790771167.262554:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:2.0:1790771167.262559:0:13797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.262561:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534102528 00000100:00100000:0.0:1790771167.262567:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534102528 00010000:00010000:2.0:1790771167.262571:0:13797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262576:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6657 00010000:00010000:2.0:1790771167.262586:0:13797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262594:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:14395:x1877759534102144:12345-192.168.204.50@tcp:36:rm.0 00000100:00100000:0.0:1790771167.262602:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1840 00000100:00100000:0.0:1790771167.262611:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:2397:x1877759534101632:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.262618:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.262621:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.262624:0:12128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790771167.262628:0:6481:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 5/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 45 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262639:0:6481:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 45 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262642:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fa7c lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36851 expref: 45 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262665:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:2397:x1877759534101376:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 220us (468us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.262674:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:3.0:1790771167.262678:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262683:0:12128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.262690:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1839 00010000:00010000:0.0:1790771167.262692:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:1.0:1790771167.262694:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,1 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.262699:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262700:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: --/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262708:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262718:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 924 00010000:00010000:0.0:1790771167.262725:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262730:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262732:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262737:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:2396:x1877759534102528:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790771167.262758:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.262760:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fbe1 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262761:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.262770:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262778:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.262778:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb064b5600/0xfa0c505d97f0fabb lrc: 0/0,0 mode: --/PR res: [0x240000402:0x26:0x0].0x0 bits 0x10/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36866 expref: 124 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.262789:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+44:2397:x1877759534101632:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 176us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.262804:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1840 00010000:00010000:2.0:1790771167.262814:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfb03026300) 00010000:00010000:2.0:1790771167.262820:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.262831:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262841:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 2/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 123 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262848:0:12128:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 2/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 123 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262856:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759534102528:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 120us (368us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.262857:0:12128:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 5/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262869:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb05686e00/0xfa0c505d97f0f88b lrc: 0/0,0 mode: --/PR res: [0x240000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e36786 expref: 43 pid: 12030 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.262876:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 924 00010000:00010000:1.0:1790771167.262886:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 123 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.262898:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb0305fb80 pname:cluuid:pid:xid:nid:opc:job mdt_io00_003:lustre-MDT0001_UUID:13785:1877759539793152:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.262898:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 122 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262917:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539793408:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.262927:0:13785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262934:0:13785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262939:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262957:0:13785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,1 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262965:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262970:0:12128:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 121 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.262974:0:13785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.262989:0:12128:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 121 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.262998:0:12128:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539793536:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.263022:0:12128:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4180 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.263044:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534102016 00000100:00100000:1.0:1790771167.263047:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534102016 00000100:00100000:1.0:1790771167.263091:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1750 00000100:00100000:1.0:1790771167.263098:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:11955:x1877759534102016:12345-192.168.204.50@tcp:35:ls.0 00000004:00080000:0.0:1790771167.263144:0:13785:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x240000403:0xf:0x0] is inserted into orphan list, open count = 1 00000100:00100000:1.0:1790771167.263189:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:11955:x1877759534102016:12345-192.168.204.50@tcp:35:ls.0 Request processed in 91us (877us total) trans 4294968920 rc 0/0 00000100:00100000:1.0:1790771167.263196:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1750 00010000:00010000:0.0:1790771167.263207:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,1 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263214:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 2/0,0 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263219:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,0 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263224:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfcc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.263226:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 3/0,0 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263231:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 4/0,0 mode: EX/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263237:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:0.0:1790771167.263239:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790771167.263242:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 2/0,0 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263245:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfcc00/0xfa0c505d97f0fbef lrc: 0/0,0 mode: --/EX res: [0x240000403:0xf:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.263257:0:13785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a113bf06 reply state 0000000090eb688d transno 4294968921 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263264:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfde00/0xfa0c505d97f0faad lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.263274:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.263276:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x4:0x0].0x0 (ffff8bfb0282a100) 00010000:00010000:0.0:1790771167.263279:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1790771167.263281:0:13785:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1790771167.263287:0:13785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a113bf06 reply state 0000000090eb688d transno 4294968921 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0faa6 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263292:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd000/0xfa0c505d97f0faa6 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0xdcc87686 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263298:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0xdcc87686 (ffff8bfc03c5e700) 00010000:00010000:0.0:1790771167.263300:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.263302:0:13785:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1790771167.263305:0:13785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263309:0:13785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 4/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263314:0:13785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263318:0:13785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263323:0:13785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cfd800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.263328:0:13785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.263328:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.263336:0:13785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 5/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263344:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.263346:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.263349:0:13785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 3/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263354:0:13785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfd800/0xfa0c505d97f0fa98 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.263362:0:13785:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a113bf06 reply state 0000000090eb688d transno 4294968921 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0fa9f lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.263369:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.263376:0:13785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfce00/0xfa0c505d97f0fa9f lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x7a94fdef bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13785 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263382:0:13785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x7a94fdef (ffff8bfc03c5e800) 00010000:00010000:0.0:1790771167.263384:0:13785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.263386:0:13785:0:(service.c:197:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1790771167.263406:0:13796:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106368 00000100:00100000:1.0:1790771167.263413:0:13796:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106368 00000100:00100000:3.0:1790771167.263413:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.263420:0:13785:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0566ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:14709:x1877759534094848:12345-192.168.204.50@tcp:36:mrename.0 Request processed in 14264us (14420us total) trans 4294968921 rc 0/0 00000100:00100000:0.0:1790771167.263428:0:13785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 42 00000100:00100000:1.0:1790771167.263450:0:13796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1093 00000100:00100000:3.0:1790771167.263457:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.263462:0:13796:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+25:2399:x1877759534106368:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771167.263473:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106496 00000100:00100000:0.0:1790771167.263479:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106496 00000100:00100000:3.0:1790771167.263523:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.263533:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097536 00000100:00100000:0.0:1790771167.263536:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097536 00000100:00100000:0.0:1790771167.263562:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534097920 00000100:00100000:0.0:1790771167.263566:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534097920 00000100:00100000:3.0:1790771167.263566:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00010000:1.0:1790771167.263577:0:13796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790771167.263582:0:13796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb mtime from disk: 1790771167 -> 1674053537 00002000:00010000:1.0:1790771167.263586:0:13796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:1.0:1790771167.263589:0:13796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:1.0:1790771167.263592:0:13796:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0xe:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790771167.263596:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6658 00000100:00100000:0.0:1790771167.263606:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13743:x1877759534106496:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.263613:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.263625:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fbf6 lrc: 2/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36977 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.263627:0:13796:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2399:x1877759534106368:12345-192.168.204.50@tcp:2:cp.0 Request processed in 166us (299us total) trans 4294967647 rc 0/0 00000100:00100000:2.0:1790771167.263659:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11370450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:12255:x1877759534098816:12345-192.168.204.50@tcp:37:ls.0 Request processed in 11390us (12397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.263662:0:13796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1093 00000100:00100000:2.0:1790771167.263675:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1744 00010000:00010000:0.0:1790771167.263688:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fbfd lrc: 3/1,0 mode: --/PR res: [0x240000403:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263697:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fbfd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263703:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fbfd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.263714:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x32:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.263717:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.263725:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fbfd lrc: 3/1,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.263729:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106112 00000100:00100000:2.0:1790771167.263734:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106112 00010000:00010000:0.0:1790771167.263740:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fbf6 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36977 expref: 125 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263754:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03c79000/0xfa0c505d97f0fbfd lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x32:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36977 expref: 124 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.263755:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106624 00000100:00100000:2.0:1790771167.263761:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106624 00010000:00010000:0.0:1790771167.263763:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x32:0x0].0x0 (ffff8bfc3607d200) 00010000:00010000:0.0:1790771167.263766:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771167.263769:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79000, rc 0) 00000100:00100000:2.0:1790771167.263783:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107136 00000100:00100000:2.0:1790771167.263788:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107136 00000100:00100000:0.0:1790771167.263795:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13743:x1877759534106496:12345-192.168.204.50@tcp:101:ls.0 Request processed in 188us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.263795:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6659 00000100:00100000:0.0:1790771167.263806:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6658 00000100:00100000:3.0:1790771167.263811:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14564:x1877759534097536:12345-192.168.204.50@tcp:101:chmod.0 00000100:00100000:2.0:1790771167.263812:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1751 00010000:00010000:3.0:1790771167.263823:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.263827:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6660 00000100:00100000:2.0:1790771167.263830:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14078:x1877759534106112:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:3.0:1790771167.263836:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0fc04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3686d expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.263840:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14618:x1877759534097920:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771167.263857:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:2.0:1790771167.263864:0:13778:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.263868:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0fc0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3687b expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.263870:0:13778:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1790771167.263875:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.263890:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1752 00010000:00010000:3.0:1790771167.263893:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.263901:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.263904:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14511:x1877759534106624:12345-192.168.204.50@tcp:37:rm.0 00000100:00100000:2.0:1790771167.263912:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:14078:x1877759534106112:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 85us (641us total) trans 0 rc 0/0 00010000:00010000:0.0:1790771167.263919:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.263926:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1751 00010000:00010000:0.0:1790771167.263931:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263939:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.263949:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1753 00010000:00010000:0.0:1790771167.263951:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263958:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.263965:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:15088:x1877759534107136:12345-192.168.204.50@tcp:33:getfattr.0 00010000:00010000:3.0:1790771167.263965:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.263968:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.264001:0:13778:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.264007:0:13767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.264007:0:13778:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1790771167.264016:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264029:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264032:0:13767:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264041:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.264044:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:15088:x1877759534107136:12345-192.168.204.50@tcp:33:getfattr.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.264062:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1753 00000004:00200000:0.0:1790771167.264071:0:13767:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790771167.264087:0:13767:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264088:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264107:0:13766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 2/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264112:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264115:0:13766:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.264116:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:14882:x1877759534108416:12345-192.168.204.50@tcp:101:dd.0 Request processed in 2707us (2869us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771167.264134:0:13767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.264140:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6653 00010000:00010000:3.0:1790771167.264141:0:13766:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264146:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264159:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.264160:0:13766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264172:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264177:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.264180:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264185:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264193:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771167.264195:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.264197:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264202:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0400/0xfa0c505d97f0fc19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264210:0:13767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264215:0:13767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264219:0:13767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264224:0:13767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e1600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.264226:0:13767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264230:0:13767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264237:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xf7a5b27a (ffff8bfc03c5e900) 00010000:00010000:0.0:1790771167.264239:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.264240:0:13767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264244:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fc20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13767 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264260:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79e00/0xfa0c505d97f0fc0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3687b expref: 137 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264272:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3687b expref: 136 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.264277:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb0:0x0].0x0 (ffff8bfc19631400) 00010000:00010000:0.0:1790771167.264279:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.264281:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e0a00, rc 0) 00000100:00100000:0.0:1790771167.264300:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+136:14618:x1877759534097920:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 466us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.264304:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6660 00000100:00100000:0.0:1790771167.264404:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.264418:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.264452:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107392 00000100:00100000:2.0:1790771167.264457:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107392 00000100:00100000:0.0:1790771167.264471:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.264529:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.264530:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106880 00000100:00100000:3.0:1790771167.264535:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106880 00000100:00100000:2.0:1790771167.264558:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1754 00000100:00100000:0.0:1790771167.264569:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.264574:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6661 00000100:00100000:2.0:1790771167.264576:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc11373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13664:x1877759534107392:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.264587:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13293:x1877759534106880:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.264591:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107776 00000100:00100000:0.0:1790771167.264595:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107776 00010000:00010000:3.0:1790771167.264604:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.264618:0:9499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534106752 00010000:00010000:3.0:1790771167.264618:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0fc3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3689e expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.264625:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1755 00000100:00100000:1.0:1790771167.264625:0:9499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534106752 00000100:00100000:0.0:1790771167.264642:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+130:13271:x1877759534107776:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:1.0:1790771167.264679:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 925 00000100:00100000:1.0:1790771167.264688:0:9499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759534106752:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000004:00200000:3.0:1790771167.264690:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xa0:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.264695:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790771167.264709:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x45:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36827 expref: 139 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.264715:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc11373850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13664:x1877759534107392:12345-192.168.204.50@tcp:35:ls.0 Request processed in 144us (296us total) trans 4294968922 rc 0/0 00010000:00010000:1.0:1790771167.264727:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x45:0x0].0x0 (ffff8bfc20109300) 00000100:00100000:2.0:1790771167.264731:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1754 00010000:00010000:1.0:1790771167.264733:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790771167.264758:0:9499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+139:2396:x1877759534106752:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 73us (288us total) trans 0 rc 0/0 00010000:00010000:3.0:1790771167.264765:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0fc3c lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3689e expref: 139 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.264773:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 925 00010000:00010000:3.0:1790771167.264780:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:0.0:1790771167.264783:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+131:13271:x1877759534107776:12345-192.168.204.50@tcp:35:ls.0 Request processed in 142us (214us total) trans 4294969515 rc 0/0 00010000:00010000:3.0:1790771167.264784:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771167.264792:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc35fff000/0xfa0c505d97f0fc3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3689e expref: 138 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.264796:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1755 00010000:00010000:3.0:1790771167.264809:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc35fff000, rc 0) 00000100:00100000:3.0:1790771167.264836:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13293:x1877759534106880:12345-192.168.204.50@tcp:101:ls.0 Request processed in 254us (432us total) trans 4294969514 rc 301/301 00000100:00100000:3.0:1790771167.264843:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6661 00000100:00100000:1.0:1790771167.264862:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.264865:0:13794:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107008 00000100:00100000:0.0:1790771167.264871:0:13794:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107008 00002000:00100000:0.0:1790771167.264900:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (630784->634879) req@ffff8bfb0673bb80 x1877759534107008/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.264911:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0673bb80 with x1877759534107008 ext(630784->634879) 00002000:00010000:0.0:1790771167.264920:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0673bb80 00000100:00100000:1.0:1790771167.264920:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.264946:0:13794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 471 00000100:00100000:1.0:1790771167.264948:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534101504 00000100:00100000:1.0:1790771167.264955:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534101504 00000100:00100000:0.0:1790771167.264956:0:13794:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534107008:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:1.0:1790771167.264992:0:13764:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534098944 00000100:00100000:1.0:1790771167.264996:0:13764:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534098944 00000100:00100000:1.0:1790771167.265019:0:13764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6662 00000100:00100000:1.0:1790771167.265028:0:13764:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13749:x1877759534101504:12345-192.168.204.50@tcp:101:ln.0 00010000:00010000:1.0:1790771167.265036:0:13764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.265048:0:13764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fc4a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368a5 expref: -99 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.265055:0:13794:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2396:x1877759534107008:12345-192.168.204.50@tcp:3:cat.0 Request processed in 100us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.265062:0:13794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 471 00002000:00100000:0.0:1790771167.265068:0:13794:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000400:0xb:0x0] (630784->634879) req@ffff8bfb0673bb80 x1877759534107008/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.265074:0:13794:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb0673bb80 with x1877759534107008 ext(630784->634879) 00002000:00010000:0.0:1790771167.265078:0:13794:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb0673bb80 00010000:00010000:1.0:1790771167.265082:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790771167.265091:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969513 is committed 00010000:00010000:1.0:1790771167.265092:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.265101:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6663 00010000:00010000:1.0:1790771167.265105:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.265112:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:15122:x1877759534098944:12345-192.168.204.50@tcp:101:setfattr.0 00000001:00080000:2.0:1790771167.265118:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969511 is committed 00010000:00010000:1.0:1790771167.265119:0:13764:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265121:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.265129:0:13764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265133:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0fc5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36882 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265136:0:13764:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265160:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265165:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265170:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265171:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265190:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265199:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487ec00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.265202:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265202:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265203:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.265211:0:6495:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bcab03af reply state 0000000019b02bfc transno 4294969513 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265232:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265233:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265241:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265244:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265260:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265266:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.265274:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.265274:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:0.0:1790771167.265276:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265280:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265282:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790771167.265283:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c79400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.265288:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265292:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265297:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265302:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487ec00/0xfa0c505d97f0fc51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265312:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265322:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265330:0:13764:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265330:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265353:0:13764:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265355:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0fc74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265360:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x7d:0x0].0xbc0ca3a9 (ffff8bfb02b20e00) 00000100:00100000:3.0:1790771167.265363:0:6495:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790771167.265364:0:13764:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265371:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00200000:3.0:1790771167.265371:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.265379:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265380:0:13764:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0487f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.265382:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265386:0:13764:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265402:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0f718 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x7d:0x0].0xbc0ca3a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1790771167.265403:0:6495:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1790771167.265405:0:13764:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265408:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.265414:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15044:x1877759534096256:12345-192.168.204.50@tcp:36:chown.0 Request processed in 16253us (16368us total) trans 4294969513 rc 0/0 00010000:00010000:1.0:1790771167.265430:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc36078d00) 00010000:00010000:1.0:1790771167.265435:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.265435:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6642 00010000:00010000:1.0:1790771167.265441:0:13764:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265445:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.265450:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x63:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.265457:0:13766:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.265458:0:7771:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1790771167.265458:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487f600/0xfa0c505d97f0fc58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13764 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265468:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.265474:0:7771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0fc74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265480:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265521:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265532:0:13764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fc4a lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368a5 expref: 128 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265533:0:7771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.265534:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xb6:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.265537:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06391200 already unused, calling callback (ffffffffc18aa4f0) 00000004:00200000:3.0:1790771167.265541:0:13766:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.265546:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.265554:0:13766:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265557:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265572:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265576:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265589:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265592:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265596:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xc:0x0].0xf7a5b27a (ffff8bfc310f1300) 00010000:00010000:2.0:1790771167.265605:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.265612:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265615:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265629:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06391200/0xfa0c505d97f0f77a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xc:0x0].0xf7a5b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265633:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265634:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb063e0800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.265635:0:13764:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.265654:0:13764:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.265660:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265662:0:13764:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fc4a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368a5 expref: 128 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265667:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.265675:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265678:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265680:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265686:0:13764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57c00, rc 0) 00010000:00010000:3.0:1790771167.265701:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265703:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265705:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771167.265713:0:13764:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13749:x1877759534101504:12345-192.168.204.50@tcp:101:ln.0 Request processed in 684us (851us total) trans 0 rc 301/301 00010000:00010000:0.0:1790771167.265714:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.265720:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265726:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00000100:00100000:1.0:1790771167.265730:0:13764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6662 00010000:00010000:2.0:1790771167.265732:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265735:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.265742:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265743:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fc66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265746:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4a000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.265754:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265758:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265764:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687200/0xfa0c505d97f0fc12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265768:0:7771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265781:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265782:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265789:0:7771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265792:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265806:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265812:0:7771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265813:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265826:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.265834:0:7771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.265837:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265838:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265839:0:7771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265841:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x59d92b11 (ffff8bfc36078200) 00010000:00010000:2.0:1790771167.265850:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.265856:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265858:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.265865:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265866:0:7771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265867:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265871:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4a000/0xfa0c505d97f0f91e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265891:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:3.0:1790771167.265894:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265899:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.265906:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265909:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265914:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x1d91fb2c (ffff8bfc03c5e100) 00010000:00010000:0.0:1790771167.265922:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.265927:0:7771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265928:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fa8a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265936:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265937:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xa5ec40c9 (ffff8bfc20109800) 00010000:00010000:3.0:1790771167.265945:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.265949:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e400/0xfa0c505d97f0fc6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265951:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265957:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265961:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.265972:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05687000/0xfa0c505d97f0fc27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265980:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.265989:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1800/0xfa0c505d97f0fc5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36882 expref: 127 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.265995:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.265997:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05c4ae00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.266005:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533ec00/0xfa0c505d97f0fc74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x63:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36882 expref: 127 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266006:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03c78800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.266007:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266013:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266014:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686000/0xfa0c505d97f0fc04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3686d expref: 127 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.266031:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x63:0x0].0x0 (ffff8bfb02b20100) 00010000:00010000:1.0:1790771167.266037:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266037:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.266038:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790771167.266043:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533ec00, rc 0) 00010000:00010000:3.0:1790771167.266048:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e1800/0xfa0c505d97f0fc35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3686d expref: 126 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266062:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb8:0x0].0x0 (ffff8bfc310f1200) 00010000:00010000:3.0:1790771167.266065:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:1.0:1790771167.266067:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.266069:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15122:x1877759534098944:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 957us (1152us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.266069:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb4:0x0].0x0 (ffff8bfc36078600) 00010000:00010000:3.0:1790771167.266072:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790771167.266073:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266078:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfc3e8e1800, rc 0) 00010000:00010000:2.0:1790771167.266079:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.266089:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6663 00010000:00010000:2.0:1790771167.266089:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266090:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0f910 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266111:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14564:x1877759534097536:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 2302us (2697us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.266115:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05c4ae00/0xfa0c505d97f0f92c lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266126:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266126:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6659 00010000:00010000:1.0:1790771167.266135:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266140:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266144:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03cf2800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.266146:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266148:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266164:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266167:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266177:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:2.0:1790771167.266178:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266181:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.266186:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266189:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.266202:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cf2800/0xfa0c505d97f0f87d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266202:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05669800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.266212:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266217:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266217:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.266234:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266235:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266245:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266260:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05686400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.266265:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266271:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x9537b590 (ffff8bfc3607db00) 00010000:00010000:1.0:1790771167.266274:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266277:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.266278:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.266286:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266289:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb5:0x0].0x0 (ffff8bfc310f1800) 00010000:00010000:1.0:1790771167.266295:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790771167.266298:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266304:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fbb0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266312:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05669800/0xfa0c505d97f0fb47 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266314:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266332:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266337:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266341:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.266343:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266348:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266352:0:13761:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534109312 00000100:00100000:3.0:1790771167.266358:0:13761:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534109312 00010000:00010000:1.0:1790771167.266361:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x9537b590 (ffff8bfc03c5ef00) 00010000:00010000:1.0:1790771167.266365:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.266367:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266371:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5e00/0xfa0c505d97f0f6fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266379:0:13762:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc2d356680 pname:cluuid:pid:xid:nid:opc:job mdt00_007:lustre-MDT0000_UUID:13762:1877759539793280:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.266390:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266393:0:13761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6664 00010000:00010000:1.0:1790771167.266401:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.266406:0:13762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.266407:0:13761:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+109:14872:x1877759534109312:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771167.266414:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266430:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b5800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.266432:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266437:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266444:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0xa5ec40c9 (ffff8bfc03c5e600) 00010000:00010000:1.0:1790771167.266446:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.266448:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266452:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b5800/0xfa0c505d97f0f703 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266463:0:13778:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534108928 00010000:00010000:1.0:1790771167.266466:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266469:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 3/0,1 mode: --/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266470:0:13778:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534108928 00010000:00010000:1.0:1790771167.266474:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266509:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266516:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb064b4200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.266516:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266525:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266528:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266542:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266549:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266557:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266559:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2c:0x0].0x0 (ffff8bfb0282ae00) 00000100:00100000:2.0:1790771167.266564:0:13778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1756 00010000:00010000:1.0:1790771167.266568:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790771167.266569:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.266575:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266581:0:13778:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+43:13885:x1877759534108928:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771167.266589:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb064b4200/0xfa0c505d97f0f70a lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x2c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266712:0:13778:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+44:13885:x1877759534108928:12345-192.168.204.50@tcp:35:ls.0 Request processed in 136us (527us total) trans 4294968923 rc 0/0 00000100:00100000:2.0:1790771167.266722:0:13778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1756 00000100:00100000:2.0:1790771167.266765:0:8409:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534108800 00000100:00100000:2.0:1790771167.266770:0:8409:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534108800 00000100:00100000:0.0:1790771167.266780:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:12240:x1877759534100224:12345-192.168.204.50@tcp:37:ls.0 Request processed in 5161us (5473us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.266790:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1749 00000100:00100000:2.0:1790771167.266809:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1094 00000100:00100000:2.0:1790771167.266820:0:8409:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+22:2396:x1877759534108800:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771167.266861:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94c000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539793408:192.168.204.50@tcp:104: 00000100:00100000:0.0:1790771167.266876:0:12128:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001_UUID:12128:1877759539793536:192.168.204.50@tcp:104: 00010000:00010000:0.0:1790771167.266900:0:12128:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.266911:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1790771167.266916:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb mtime from disk: 1674053537 -> 1674053537 00002000:00010000:2.0:1790771167.266920:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb atime from disk: 1752421453 -> 1752421453 00002000:00010000:2.0:1790771167.266924:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb ctime from disk: 1790771167 -> 1790771167 00002000:00010000:2.0:1790771167.266926:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x27:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:3.0:1790771167.266956:0:13761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: --/PW res: [0x200000403:0xb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266965:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266971:0:8409:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2396:x1877759534108800:12345-192.168.204.50@tcp:2:cp.0 Request processed in 150us (697us total) trans 4294967660 rc 0/0 00010000:00010000:3.0:1790771167.266975:0:13761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.266984:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1094 00000004:00010000:3.0:1790771167.266987:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008c06b884 reply state 00000000caad534b transno 4294969516 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.266996:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267005:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb7:0x0].0x0 (ffff8bfc20109c00) 00010000:00010000:3.0:1790771167.267008:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.267009:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790771167.267012:0:13761:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000403:0xb7:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.267017:0:13761:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267022:0:13761:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267027:0:13761:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267032:0:13761:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267035:0:13761:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.267037:0:13761:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267042:0:13761:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 5/0,0 mode: CW/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267048:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb4:0x0].0x0 (ffff8bfc20109200) 00010000:00010000:3.0:1790771167.267050:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.267052:0:13761:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 3/0,0 mode: --/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267056:0:13761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fc7b lrc: 0/0,0 mode: --/CW res: [0x200000403:0xb4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790771167.267066:0:13761:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008c06b884 reply state 00000000caad534b transno 4294969516 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267072:0:13761:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.267077:0:13761:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb4:0x0].0x59d92b11 (ffff8bfc20109500) 00010000:00010000:3.0:1790771167.267079:0:13761:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1790771167.267080:0:13761:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1790771167.267155:0:13761:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14872:x1877759534109312:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 751us (941us total) trans 4294969516 rc 0/0 00000100:00100000:3.0:1790771167.267161:0:13761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6664 00000100:00100000:3.0:1790771167.267966:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.267995:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.268014:0:13773:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534110080 00000100:00100000:2.0:1790771167.268021:0:13773:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534110080 00000100:00100000:1.0:1790771167.268036:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107520 00000100:00100000:1.0:1790771167.268044:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107520 00000100:00100000:2.0:1790771167.268071:0:13773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6665 00000100:00100000:3.0:1790771167.268081:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6666 00000100:00100000:2.0:1790771167.268087:0:13773:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+110:14538:x1877759534110080:12345-192.168.204.50@tcp:101:cat.0 00000100:00100000:3.0:1790771167.268094:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:13285:x1877759534107520:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.268100:0:13773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.268105:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.268115:0:13773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fc90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36993 expref: -99 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.268118:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fc97 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368b3 expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.268171:0:13767:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:2.0:1790771167.268208:0:13773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fca5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.268220:0:13773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.268222:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fc97 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368b3 expref: 123 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.268242:0:13773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fca5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.268246:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:3.0:1790771167.268253:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771167.268260:0:13767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fc97 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368b3 expref: 123 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.268275:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83c00, rc 0) 00000100:00100000:3.0:1790771167.268309:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:13285:x1877759534107520:12345-192.168.204.50@tcp:101:ls.0 Request processed in 221us (312us total) trans 4294969517 rc 301/301 00000100:00100000:3.0:1790771167.268316:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6666 00010000:00010000:2.0:1790771167.268327:0:13773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fc90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36993 expref: 113 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.268345:0:13773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fca5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36993 expref: 112 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.268354:0:13773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb0:0x0].0x0 (ffff8bfc19631400) 00010000:00010000:2.0:1790771167.268358:0:13773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.268362:0:13773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373400, rc 0) 00000100:00100000:2.0:1790771167.268403:0:13773:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_018:82a25f2c-222e-4ba7-abee-8e26bca511e6+112:14538:x1877759534110080:12345-192.168.204.50@tcp:101:cat.0 Request processed in 323us (436us total) trans 4294969518 rc 0/0 00000100:00100000:2.0:1790771167.268413:0:13773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6665 00000100:00100000:3.0:1790771167.275914:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.275947:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.275949:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534110464 00000100:00100000:0.0:1790771167.275956:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534110464 00000100:00100000:3.0:1790771167.275979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.275992:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534109696 00000100:00100000:1.0:1790771167.275999:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534109696 00000100:00100000:0.0:1790771167.276003:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1757 00000100:00100000:0.0:1790771167.276015:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:6156:x1877759534110464:12345-192.168.204.50@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790771167.276038:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534109568 00000100:00100000:1.0:1790771167.276043:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534109568 00000100:00100000:3.0:1790771167.276043:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.276064:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 123 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276092:0:13784:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534110208 00000100:00100000:1.0:1790771167.276095:0:13784:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534110208 00000100:00100000:3.0:1790771167.276102:0:13783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1841 00010000:00010000:1.0:1790771167.276109:0:13784:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 125 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.276115:0:13797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 926 00000100:00100000:3.0:1790771167.276116:0:13783:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759534109568:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.276134:0:13783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790771167.276135:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:6156:x1877759534110464:12345-192.168.204.50@tcp:35:ldlm_bl.0 Request processed in 120us (218us total) trans 4294968924 rc 0/0 00000100:00100000:2.0:1790771167.276136:0:13797:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759534109696:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.276145:0:13783:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 123 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276146:0:13784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1842 00000100:00100000:0.0:1790771167.276155:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1757 00010000:00010000:2.0:1790771167.276158:0:13797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.276163:0:13784:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:2396:x1877759534110208:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790771167.276171:0:13783:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 123 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276174:0:13784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790771167.276182:0:13797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fbd3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3685f expref: 123 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276183:0:13784:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 4/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 124 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276208:0:13784:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 3/0,0 mode: PR/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 124 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276214:0:13797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:2.0:1790771167.276220:0:13797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.276224:0:13784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fa00/0xfa0c505d97f0e265 lrc: 0/0,0 mode: --/PR res: [0x240000403:0x9:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3607f expref: 124 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276238:0:13784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:1.0:1790771167.276242:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276249:0:13784:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276256:0:13784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790771167.276263:0:13797:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_009:dd3e9fa3-001c-49c2-ab75-41a75fa63682+122:2396:x1877759534109696:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 133us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1790771167.276275:0:13797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 926 00000100:00100000:1.0:1790771167.276284:0:13784:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:2396:x1877759534110208:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 126us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.276289:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.276299:0:13784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1842 00000100:00100000:0.0:1790771167.276314:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534111488 00000100:00100000:0.0:1790771167.276318:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534111488 00000100:00100000:0.0:1790771167.276347:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6667 00000100:00100000:0.0:1790771167.276357:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14747:x1877759534111488:12345-192.168.204.50@tcp:101:file_concat.sh.0 00010000:00010000:0.0:1790771167.276366:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.276372:0:13783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0f9b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e367ef expref: 121 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276377:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0fcb3 lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369a8 expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276389:0:13783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00010000:00010000:3.0:1790771167.276394:0:13783:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276401:0:13783:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276407:0:13783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276422:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.276444:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 3/1,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276455:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534100992 00010000:00010000:2.0:1790771167.276455:0:13762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276456:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276460:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534100992 00010000:00010000:0.0:1790771167.276480:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276481:0:13762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276511:0:13765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6668 00010000:00010000:0.0:1790771167.276525:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.276527:0:13765:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:15161:x1877759534100992:12345-192.168.204.50@tcp:101:touch.0 00010000:00010000:1.0:1790771167.276544:0:13765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.276549:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276550:0:13783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790771167.276560:0:13765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fcc8 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e367d3 expref: -99 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276562:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.276576:0:13783:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+121:2396:x1877759534109568:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 464us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.276589:0:13783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1841 00010000:00010000:2.0:1790771167.276595:0:13762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276606:0:13762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276614:0:13762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276620:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0fccf lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276625:0:13762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06373e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.276631:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0fccf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276633:0:13762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276638:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276659:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0fccf lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276670:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276674:0:13762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.276675:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771167.276681:0:12030:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 0 00010000:00010000:1.0:1790771167.276693:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276699:0:13762:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00000100:00100000:3.0:1790771167.276701:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534107904 00010000:00010000:2.0:1790771167.276705:0:13762:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790771167.276708:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534107904 00010000:00010000:1.0:1790771167.276714:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276714:0:13762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276730:0:12030:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276732:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.276735:0:13762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fb71 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xab:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13762 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.276744:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6669 00010000:00010000:0.0:1790771167.276750:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 4/1,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.276755:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.276759:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3e8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:15160:x1877759534107904:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:0.0:1790771167.276773:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276778:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.276780:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276785:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533fc00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.276788:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 4/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276790:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0fceb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36897 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.276803:0:13762:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:15082:x1877759534099840:12345-192.168.204.50@tcp:36:setfattr.0 Request processed in 21801us (21908us total) trans 0 rc -61/-61 00010000:00010000:0.0:1790771167.276812:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 5/0,0 mode: CR/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.276826:0:13762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6651 00010000:00010000:0.0:1790771167.276827:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.276832:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.276834:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 3/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276839:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fc00/0xfa0c505d97f0fcba lrc: 0/0,0 mode: --/CR res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276849:0:12030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276857:0:12030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 2/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276864:0:12030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276871:0:12030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0533ee00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.276875:0:12030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276887:0:12030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 4/0,0 mode: PR/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276898:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x9537b590 (ffff8bfc03c5e900) 00010000:00010000:0.0:1790771167.276901:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.276905:0:12030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 2/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276909:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fcf2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276927:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533ee00/0xfa0c505d97f0fcc1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x1:0x0].0x9537b590 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12030 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276930:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fcf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.276941:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fcf2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.276949:0:13772:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.276971:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533f000/0xfa0c505d97f0fcb3 lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369a8 expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276985:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0533fe00/0xfa0c505d97f0fccf lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369a8 expref: 125 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.276991:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff8bfc113f3700) 00010000:00010000:0.0:1790771167.276993:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790771167.276996:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fe00, rc 0) 00010000:00010000:3.0:1790771167.277007:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82e00/0xfa0c505d97f0fceb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36897 expref: 125 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790771167.277009:0:13765:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x29:0x0], index 1: 0 00000100:00100000:0.0:1790771167.277021:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14747:x1877759534111488:12345-192.168.204.50@tcp:101:file_concat.sh.0 Request processed in 665us (734us total) trans 4294968925 rc 0/0 00000100:00100000:0.0:1790771167.277028:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6667 00010000:00010000:3.0:1790771167.277035:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83400/0xfa0c505d97f0fcf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36897 expref: 124 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.277052:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x8:0x0].0x0 (ffff8bfc3607a800) 00010000:00010000:3.0:1790771167.277056:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790771167.277060:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83400, rc 0) 00000100:00100000:0.0:1790771167.277093:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.277093:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3e8f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15160:x1877759534107904:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 336us (423us total) trans 4294969519 rc 0/0 00000100:00100000:3.0:1790771167.277105:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6669 00000100:00100000:3.0:1790771167.277124:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534110720 00000100:00100000:3.0:1790771167.277128:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534110720 00010000:00010000:1.0:1790771167.277132:0:13765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fd00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xbc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.277133:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.277144:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fd00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277153:0:13765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fd00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.277158:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534111104 00000100:00100000:3.0:1790771167.277162:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534111104 00010000:00010000:1.0:1790771167.277174:0:13765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277181:0:13765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277186:0:13765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277190:0:13765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.277194:0:13765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.277198:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6670 00010000:00010000:1.0:1790771167.277203:0:13765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.277210:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14758:x1877759534110720:12345-192.168.204.50@tcp:36:mkdir.0 00010000:00010000:1.0:1790771167.277213:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x0 (ffff8bfc3607d000) 00010000:00010000:1.0:1790771167.277217:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.277219:0:13765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277226:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fcd6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.277227:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6671 00000100:00100000:0.0:1790771167.277246:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14756:x1877759534111104:12345-192.168.204.50@tcp:101:cat.0 00000004:00010000:1.0:1790771167.277248:0:13765:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e9821807 reply state 000000009bb362ed transno 4294969520 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277258:0:13765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.277260:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.277265:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x7a94fdef (ffff8bfc36078d00) 00010000:00010000:1.0:1790771167.277268:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790771167.277271:0:13765:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790771167.277273:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0fd0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369a1 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.277286:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:14758:x1877759534110720:12345-192.168.204.50@tcp:36:mkdir.0 Request processed in 75us (193us total) trans 0 rc -17/-17 00010000:00010000:1.0:1790771167.277291:0:13765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fcc8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x59:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367d3 expref: 125 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.277297:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369a1 expref: 114 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.277304:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6670 00010000:00010000:1.0:1790771167.277316:0:13765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e200/0xfa0c505d97f0fd00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xbc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e367d3 expref: 124 pid: 13765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.277324:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0533e200/0xfa0c505d97f0fd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369a1 expref: 113 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.277326:0:13765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xbc:0x0].0x0 (ffff8bfc36078400) 00010000:00010000:1.0:1790771167.277333:0:13765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790771167.277337:0:13765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656e200, rc 0) 00010000:00010000:0.0:1790771167.277339:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:0.0:1790771167.277342:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.277345:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533e200, rc 0) 00000100:00100000:1.0:1790771167.277368:0:13765:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_010:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15161:x1877759534100992:12345-192.168.204.50@tcp:101:touch.0 Request processed in 845us (947us total) trans 4294969520 rc 0/0 00000100:00100000:1.0:1790771167.277381:0:13765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6668 00000100:00100000:0.0:1790771167.277383:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:14756:x1877759534111104:12345-192.168.204.50@tcp:101:cat.0 Request processed in 137us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.277395:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6671 00000100:00100000:1.0:1790771167.278232:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:14511:x1877759534106624:12345-192.168.204.50@tcp:37:rm.0 Request processed in 14331us (14706us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.278238:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1752 00000100:00100000:0.0:1790771167.278284:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.278349:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112512 00000100:00100000:3.0:1790771167.278353:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112512 00000100:00100000:3.0:1790771167.278417:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6672 00000100:00100000:3.0:1790771167.278424:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+113:13261:x1877759534112512:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:3.0:1790771167.278434:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790771167.278443:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fd15 lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3699a expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278474:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/1,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278508:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278515:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278527:0:13766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/1,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278533:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278539:0:13766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790771167.278582:0:13766:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x5b:0x0]: returning size 4096 00010000:00010000:3.0:1790771167.278620:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278628:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278636:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278656:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83800 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.278661:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278669:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278686:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.278690:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.278694:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 2/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278701:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fd1c lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278714:0:13766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278721:0:13766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278729:0:13766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278734:0:13766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:3.0:1790771167.278737:0:13766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278742:0:13766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278748:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x9b50d0cc (ffff8bfc20109200) 00010000:00010000:3.0:1790771167.278749:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.278752:0:13766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 2/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278756:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd23 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb:0x0].0x9b50d0cc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13766 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278783:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fd15 lrc: 1/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3699a expref: 115 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278790:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb:0x0].0x0 (ffff8bfc0ab7ef00) 00010000:00010000:3.0:1790771167.278792:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790771167.278795:0:13766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fd15 lrc: 0/0,0 mode: --/CR res: [0x200000403:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3699a expref: 115 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.278804:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83c00, rc 0) 00000100:00100000:3.0:1790771167.278835:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:13261:x1877759534112512:12345-192.168.204.50@tcp:101:ls.0 Request processed in 412us (555us total) trans 4294969521 rc 301/301 00000100:00100000:3.0:1790771167.278839:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6672 00000100:00100000:1.0:1790771167.283198:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.283236:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534109056 00000100:00100000:0.0:1790771167.283243:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534109056 00000100:00100000:0.0:1790771167.283277:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6673 00000100:00100000:0.0:1790771167.283284:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+123:13288:x1877759534109056:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.283296:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.283305:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0fd31 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368ba expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.283354:0:6493:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.283410:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0fd31 lrc: 1/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368ba expref: 125 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.283423:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x26:0x0].0x0 (ffff8bfc08974e00) 00010000:00010000:0.0:1790771167.283425:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.283428:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c79400/0xfa0c505d97f0fd31 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368ba expref: 125 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.283442:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c79400, rc 0) 00000100:00100000:0.0:1790771167.283530:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13288:x1877759534109056:12345-192.168.204.50@tcp:101:ls.0 Request processed in 199us (286us total) trans 4294969522 rc 301/301 00000100:00100000:0.0:1790771167.283542:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6673 00000100:00100000:0.0:1790771167.283798:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.283828:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.283842:0:6494:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534111616 00000100:00100000:1.0:1790771167.283848:0:6494:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534111616 00000100:00100000:0.0:1790771167.283857:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.283880:0:13779:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534108544 00000100:00100000:2.0:1790771167.283888:0:13779:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534108544 00000100:00100000:0.0:1790771167.283889:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.283895:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6674 00000100:00100000:3.0:1790771167.283896:0:13786:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534109824 00000100:00100000:3.0:1790771167.283905:0:13786:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534109824 00000100:00100000:1.0:1790771167.283913:0:6494:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:14757:x1877759534111616:12345-192.168.204.50@tcp:101:cp.0 00010000:00010000:1.0:1790771167.283924:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.283935:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.283935:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fd3f lrc: 2/0,0 mode: --/CR res: [0x240000403:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369af expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1790771167.283935:0:13779:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x1e:0x0] (4194304->6228196) req@ffff8bfb06738700 x1877759534108544/t0(0) o4->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1790771167.283944:0:13786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1095 00000100:00100000:3.0:1790771167.283960:0:13786:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+23:2398:x1877759534109824:12345-192.168.204.50@tcp:2:cp.0 00000100:00100000:0.0:1790771167.283970:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00002000:00100000:2.0:1790771167.283971:0:13779:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb06738700 with x1877759534108544 ext(4194304->6228196) 00010000:00010000:1.0:1790771167.283980:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fd3f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369af expref: 126 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790771167.283983:0:13779:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb06738700 00000100:00100000:0.0:1790771167.283987:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534111744 00000100:00100000:0.0:1790771167.283994:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534111744 00010000:00010000:1.0:1790771167.283997:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb0656e000/0xfa0c505d97f0fd3f lrc: 3/0,0 mode: CR/CR res: [0x240000403:0xf:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369af expref: 126 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.284012:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0xf:0x0].0x0 (ffff8bfb03146a00) 00010000:00010000:1.0:1790771167.284015:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790771167.284018:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656e000, rc 0) 00000100:00100000:0.0:1790771167.284025:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534111872 00000100:00100000:0.0:1790771167.284029:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534111872 00000100:00100000:2.0:1790771167.284035:0:13779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 472 00000100:00100000:2.0:1790771167.284052:0:13779:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+20:2398:x1877759534108544:12345-192.168.204.50@tcp:4:cat.0 00000100:00100000:0.0:1790771167.284053:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112128 00000100:00100000:1.0:1790771167.284053:0:6494:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06739f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:14757:x1877759534111616:12345-192.168.204.50@tcp:101:cp.0 Request processed in 141us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.284059:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112128 00000100:00100000:1.0:1790771167.284068:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6674 00002000:00010000:3.0:1790771167.284076:0:13786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x28:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1790771167.284080:0:13786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x28:0x0] updating lvb mtime from disk: 0 -> 1674053537 00002000:00010000:3.0:1790771167.284083:0:13786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x28:0x0] updating lvb atime from disk: 0 -> 1752421453 00002000:00010000:3.0:1790771167.284087:0:13786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x28:0x0] updating lvb ctime from disk: 0 -> 1790771167 00000100:00100000:0.0:1790771167.284088:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1758 00002000:00010000:3.0:1790771167.284092:0:13786:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x28:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790771167.284101:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1759 00000100:00100000:0.0:1790771167.284102:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb06738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+114:15098:x1877759534111744:12345-192.168.204.50@tcp:35:fallocate.0 00000100:00100000:1.0:1790771167.284112:0:6496:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:13743:x1877759534111872:12345-192.168.204.50@tcp:37:ls.0 00000100:00100000:3.0:1790771167.284121:0:13786:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0673a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:dd3e9fa3-001c-49c2-ab75-41a75fa63682+24:2398:x1877759534109824:12345-192.168.204.50@tcp:2:cp.0 Request processed in 164us (262us total) trans 4294967661 rc 0/0 00000100:00100000:3.0:1790771167.284127:0:13786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1095 00000100:00100000:3.0:1790771167.284154:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1760 00000100:00100000:3.0:1790771167.284161:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+127:11804:x1877759534112128:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.284248:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb06738e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:15098:x1877759534111744:12345-192.168.204.50@tcp:35:fallocate.0 Request processed in 150us (362us total) trans 4294969523 rc 0/0 00000100:00100000:0.0:1790771167.284255:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1758 00000100:00100000:3.0:1790771167.284273:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:11804:x1877759534112128:12345-192.168.204.50@tcp:35:ls.0 Request processed in 110us (303us total) trans 4294968926 rc 0/0 00000100:00100000:3.0:1790771167.284284:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1760 00000100:00100000:0.0:1790771167.284295:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.284314:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112640 00000100:00100000:3.0:1790771167.284320:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112640 00000100:00100000:0.0:1790771167.284334:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.284353:0:13767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6675 00000100:00100000:3.0:1790771167.284360:0:13767:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+115:15173:x1877759534112640:12345-192.168.204.50@tcp:101:lfs.0 00010000:00010000:3.0:1790771167.284368:0:13767:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.284375:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.284377:0:13767:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fd46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369bd expref: -99 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.284396:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534113152 00010000:00010000:3.0:1790771167.284397:0:13767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369bd expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.284403:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534113152 00010000:00010000:3.0:1790771167.284409:0:13767:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82800/0xfa0c505d97f0fd46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369bd expref: 116 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.284415:0:13767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8bfb03188a00) 00010000:00010000:3.0:1790771167.284418:0:13767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.284420:0:13767:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c82800, rc 0) 00000100:00100000:0.0:1790771167.284436:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1761 00000100:00100000:3.0:1790771167.284441:0:13767:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_012:82a25f2c-222e-4ba7-abee-8e26bca511e6+116:15173:x1877759534112640:12345-192.168.204.50@tcp:101:lfs.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.284448:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:13293:x1877759534113152:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:3.0:1790771167.284452:0:13767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6675 00000100:00100000:0.0:1790771167.284560:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:13293:x1877759534113152:12345-192.168.204.50@tcp:35:ls.0 Request processed in 117us (188us total) trans 4294969524 rc 0/0 00000100:00100000:0.0:1790771167.284566:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1761 00000100:00100000:0.0:1790771167.284602:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.284624:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534113536 00000100:00100000:3.0:1790771167.284631:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534113536 00000100:00100000:0.0:1790771167.284664:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.284676:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1762 00000100:00100000:3.0:1790771167.284686:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13678:x1877759534113536:12345-192.168.204.50@tcp:35:ls.0 00000100:00100000:0.0:1790771167.284700:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.284755:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.284781:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.284787:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13678:x1877759534113536:12345-192.168.204.50@tcp:35:ls.0 Request processed in 103us (182us total) trans 4294968927 rc 0/0 00000100:00100000:0.0:1790771167.284797:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534108032 00000100:00100000:0.0:1790771167.284801:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534108032 00000100:00100000:0.0:1790771167.284817:0:12030:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534113920 00000100:00100000:0.0:1790771167.284819:0:12030:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534113920 00000100:00100000:3.0:1790771167.284832:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1762 00000100:00100000:0.0:1790771167.284837:0:12030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6676 00000100:00100000:0.0:1790771167.284845:0:12030:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+125:15032:x1877759534108032:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:3.0:1790771167.284851:0:13775:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534113664 00010000:00010000:0.0:1790771167.284853:0:12030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.284857:0:13775:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534113664 00010000:00010000:0.0:1790771167.284863:0:12030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0fd4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e3697e expref: -99 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.284885:0:12030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0fd54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.284891:0:13775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1763 00010000:00010000:0.0:1790771167.284903:0:12030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.284906:0:13775:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:15069:x1877759534113664:12345-192.168.204.50@tcp:35:rm.0 00010000:00010000:0.0:1790771167.284921:0:12030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0fd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.284955:0:13769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6677 00000100:00100000:1.0:1790771167.284964:0:13769:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14860:x1877759534113920:12345-192.168.204.50@tcp:101:mrename.0 00010000:00010000:1.0:1790771167.284975:0:13769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.284987:0:13769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fd5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369cb expref: -99 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.285000:0:13775:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:15069:x1877759534113664:12345-192.168.204.50@tcp:35:rm.0 Request processed in 96us (297us total) trans 4294969525 rc 0/0 00000100:00100000:3.0:1790771167.285007:0:13775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1763 00010000:00010000:0.0:1790771167.285015:0:12030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78800/0xfa0c505d97f0fd4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3697e expref: 127 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285030:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285036:0:12030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03c78600/0xfa0c505d97f0fd54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3697e expref: 126 pid: 12030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285041:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285053:0:12030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8bfc3600f900) 00010000:00010000:1.0:1790771167.285056:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285060:0:12030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790771167.285067:0:12030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03c78600, rc 0) 00010000:00010000:1.0:1790771167.285072:0:13769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285079:0:13769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285086:0:13769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.285098:0:12030:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15032:x1877759534108032:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 252us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.285104:0:12030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6676 00010000:00010000:1.0:1790771167.285105:0:13769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285111:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 4/1,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285116:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285121:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285126:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.285131:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285137:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285143:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:1.0:1790771167.285146:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.285149:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285154:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e600/0xfa0c505d97f0fd62 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285163:0:13769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285168:0:13769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285173:0:13769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285178:0:13769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656e400 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.285181:0:13769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285189:0:13769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.285190:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:1.0:1790771167.285201:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0xea196397 (ffff8bfc36078300) 00010000:00010000:1.0:1790771167.285203:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.285205:0:13769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285210:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656e400/0xfa0c505d97f0fd69 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x6d:0x0].0xea196397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.285227:0:13772:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112384 00000100:00100000:3.0:1790771167.285234:0:13772:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112384 00010000:00010000:1.0:1790771167.285235:0:13769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fd5b lrc: 1/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369cb expref: 118 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285244:0:13769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x6d:0x0].0x0 (ffff8bfb03218c00) 00010000:00010000:1.0:1790771167.285246:0:13769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.285248:0:13769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ec00/0xfa0c505d97f0fd5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x6d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369cb expref: 118 pid: 13769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.285258:0:13769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656ec00, rc 0) 00000100:00100000:3.0:1790771167.285277:0:13772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6678 00000100:00100000:1.0:1790771167.285284:0:13769:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_014:82a25f2c-222e-4ba7-abee-8e26bca511e6+117:14860:x1877759534113920:12345-192.168.204.50@tcp:101:mrename.0 Request processed in 321us (500us total) trans 0 rc 301/301 00000100:00100000:3.0:1790771167.285292:0:13772:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+126:15156:x1877759534112384:12345-192.168.204.50@tcp:101:truncate.0 00000100:00100000:1.0:1790771167.285294:0:13769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6677 00000100:00100000:1.0:1790771167.285350:0:8413:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534113792 00000100:00100000:1.0:1790771167.285353:0:8413:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534113792 00000100:00100000:0.0:1790771167.285356:0:13782:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112768 00000100:00100000:0.0:1790771167.285361:0:13782:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112768 00002000:00100000:1.0:1790771167.285371:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (634880->638975) req@ffff8bfb03c6dc00 x1877759534113792/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790771167.285379:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6dc00 with x1877759534113792 ext(634880->638975) 00002000:00010000:1.0:1790771167.285383:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6dc00 00010000:00010000:3.0:1790771167.285403:0:13772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.285406:0:13782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1096 00000100:00100000:1.0:1790771167.285409:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 473 00010000:00010000:3.0:1790771167.285415:0:13772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fd70 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369b6 expref: -99 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.285426:0:8413:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534113792:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771167.285427:0:13782:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+26:2396:x1877759534112768:12345-192.168.204.50@tcp:101:chmod.0 00010000:00010000:0.0:1790771167.285440:0:13782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.285451:0:13782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057d4944e/0xfa0c505d97f0fd77 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369c4 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285471:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790771167.285476:0:13782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790771167.285476:0:13772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.285506:0:13772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.285513:0:13772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285519:0:13782:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057d4944e/0xfa0c505d97f0fd77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369c4 expref: 27 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285545:0:13782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000057d4944e/0xfa0c505d97f0fd77 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369c4 expref: 27 pid: 13782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.285554:0:13782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0533fa00, rc 0) 00000100:00100000:1.0:1790771167.285568:0:8413:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:82a25f2c-222e-4ba7-abee-8e26bca511e6+21:2397:x1877759534113792:12345-192.168.204.50@tcp:3:cat.0 Request processed in 148us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.285581:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 473 00000100:00100000:0.0:1790771167.285582:0:13782:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:dd3e9fa3-001c-49c2-ab75-41a75fa63682+27:2396:x1877759534112768:12345-192.168.204.50@tcp:101:chmod.0 Request processed in 161us (1243us total) trans 0 rc 0/0 00002000:00100000:1.0:1790771167.285589:0:8413:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000400:0xb:0x0] (634880->638975) req@ffff8bfb03c6dc00 x1877759534113792/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1790771167.285591:0:13782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1096 00010000:00010000:3.0:1790771167.285600:0:13772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83c00/0xfa0c505d97f0fd70 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369b6 expref: 128 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1790771167.285602:0:8413:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6dc00 with x1877759534113792 ext(634880->638975) 00002000:00010000:1.0:1790771167.285607:0:8413:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6dc00 00010000:00010000:3.0:1790771167.285844:0:13772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83200/0xfa0c505d97f0fd7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369b6 expref: 127 pid: 13772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.285869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:3.0:1790771167.285899:0:13772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x2:0x0].0x0 (ffff8bfc03ed1100) 00010000:00010000:3.0:1790771167.285905:0:13772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790771167.285908:0:13772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83200, rc 0) 00000100:00100000:1.0:1790771167.285910:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534112896 00000100:00100000:1.0:1790771167.285915:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534112896 00000100:00100000:1.0:1790771167.285944:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6679 00000100:00100000:3.0:1790771167.285944:0:13772:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_017:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:15156:x1877759534112384:12345-192.168.204.50@tcp:101:truncate.0 Request processed in 656us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.285956:0:13772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6678 00000100:00100000:1.0:1790771167.285958:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+128:13552:x1877759534112896:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.285967:0:7771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.285977:0:7771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fd85 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368c1 expref: -99 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.286019:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fd8c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.286027:0:7771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fd8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.286034:0:7771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fd8c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.286040:0:7771:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.286081:0:7771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656ee00/0xfa0c505d97f0fd85 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368c1 expref: 130 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.286094:0:7771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fa00/0xfa0c505d97f0fd8c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368c1 expref: 129 pid: 7771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.286101:0:7771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:1.0:1790771167.286103:0:7771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771167.286105:0:7771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb0656fa00, rc 0) 00000100:00100000:1.0:1790771167.286135:0:7771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:13552:x1877759534112896:12345-192.168.204.50@tcp:101:ls.0 Request processed in 182us (267us total) trans 4294969526 rc 0/0 00000100:00100000:1.0:1790771167.286141:0:7771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6679 00000100:00100000:0.0:1790771167.287451:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.287478:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.287532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.287551:0:13770:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114304 00000100:00100000:0.0:1790771167.287557:0:6497:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114688 00000100:00100000:1.0:1790771167.287559:0:13770:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114304 00000100:00100000:2.0:1790771167.287561:0:13763:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114432 00000100:00100000:0.0:1790771167.287564:0:6497:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114688 00000100:00100000:2.0:1790771167.287570:0:13763:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114432 00000100:00100000:1.0:1790771167.287601:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6680 00000100:00100000:1.0:1790771167.287614:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14546:x1877759534114304:12345-192.168.204.50@tcp:101:setfattr.0 00000100:00100000:0.0:1790771167.287621:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1764 00000100:00100000:2.0:1790771167.287623:0:13763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6681 00010000:00010000:1.0:1790771167.287625:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1790771167.287640:0:6497:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:12240:x1877759534114688:12345-192.168.204.50@tcp:35:ls.0 00010000:00010000:1.0:1790771167.287640:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fd9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369d9 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.287642:0:13763:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+118:14589:x1877759534114432:12345-192.168.204.50@tcp:101:chown.0 00010000:00010000:2.0:1790771167.287678:0:13763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790771167.287695:0:13763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fda1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369e0 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287703:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287713:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287721:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287737:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287740:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287746:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.287758:0:6497:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:12240:x1877759534114688:12345-192.168.204.50@tcp:35:ls.0 Request processed in 123us (223us total) trans 4294968928 rc 0/0 00010000:00010000:2.0:1790771167.287760:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287762:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.287773:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1764 00010000:00010000:2.0:1790771167.287788:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287807:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287816:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.287817:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.287829:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.287842:0:13766:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114816 00010000:00010000:1.0:1790771167.287843:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.287848:0:13766:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114816 00010000:00010000:1.0:1790771167.287857:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287868:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287878:0:13763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287889:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.287891:0:13766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6682 00000100:00100000:0.0:1790771167.287892:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:1.0:1790771167.287893:0:13770:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1790771167.287902:0:13770:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1790771167.287907:0:13763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.287911:0:6493:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114944 00000100:00100000:0.0:1790771167.287916:0:6493:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114944 00000004:00010000:1.0:1790771167.287918:0:13770:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x59/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287928:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287934:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.287937:0:13763:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0xab:0x0]: returning size 30132 00010000:00010000:1.0:1790771167.287940:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790771167.287943:0:13763:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:3.0:1790771167.287947:0:13766:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14886:x1877759534114816:12345-192.168.204.50@tcp:101:ls.0 00000100:00100000:0.0:1790771167.287953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6683 00010000:00010000:1.0:1790771167.287960:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790771167.287964:0:13763:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.287965:0:13766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.287967:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656fe00 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:0.0:1790771167.287971:0:6493:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14889:x1877759534114944:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.287974:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.287977:0:13766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fdd2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369e7 expref: -99 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.287991:0:13763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.287997:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.287998:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.288010:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fdd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369ee expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.288015:0:13766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369e7 expref: 123 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288019:0:13763:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.288050:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369ee expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288061:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.288065:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.288065:0:13766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83800/0xfa0c505d97f0fdd2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369e7 expref: 124 pid: 13766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288071:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 13 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288073:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 4/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.288074:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e1600/0xfa0c505d97f0fdd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369ee expref: 124 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288094:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fe00/0xfa0c505d97f0fda8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288104:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288116:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.288117:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:2.0:1790771167.288118:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.288124:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.288129:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb063e1600, rc 0) 00010000:00010000:3.0:1790771167.288130:0:13766:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.288134:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790771167.288138:0:13766:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790771167.288144:0:13766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb04c83800, rc 0) 00010000:00010000:2.0:1790771167.288145:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.288146:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288153:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288154:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfc3e8e0200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.288160:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.288162:0:6493:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14889:x1877759534114944:12345-192.168.204.50@tcp:101:ls.0 Request processed in 195us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790771167.288174:0:13766:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_011:82a25f2c-222e-4ba7-abee-8e26bca511e6+124:14886:x1877759534114816:12345-192.168.204.50@tcp:101:ls.0 Request processed in 230us (355us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.288178:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288182:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.288189:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6683 00000100:00100000:3.0:1790771167.288202:0:13766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6682 00010000:00010000:1.0:1790771167.288206:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd6e9df9d (ffff8bfc36078000) 00010000:00010000:1.0:1790771167.288210:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.288212:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.288213:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288219:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.288226:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288227:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfc3e8e0200/0xfa0c505d97f0fdaf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd6e9df9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.288239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.288255:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372e00/0xfa0c505d97f0fdb6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288264:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656fc00/0xfa0c505d97f0fd9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369d9 expref: 123 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.288270:0:13767:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534114048 00010000:00010000:2.0:1790771167.288272:0:13763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.288276:0:13767:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534114048 00010000:00010000:1.0:1790771167.288280:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e56800/0xfa0c505d97f0fdc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x19/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369d9 expref: 122 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288286:0:13763:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288288:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8bfb0314b800) 00010000:00010000:1.0:1790771167.288293:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 19 00010000:00010000:1.0:1790771167.288297:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e56800, rc 0) 00010000:00010000:2.0:1790771167.288304:0:13763:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288313:0:13763:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb06372000 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:2.0:1790771167.288317:0:13763:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.288325:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:82a25f2c-222e-4ba7-abee-8e26bca511e6+122:14546:x1877759534114304:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 716us (874us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.288325:0:13763:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.288339:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6680 00010000:00010000:2.0:1790771167.288344:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x18618557 (ffff8bfc310f1300) 00010000:00010000:2.0:1790771167.288350:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790771167.288354:0:13763:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.288360:0:13770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6684 00010000:00010000:2.0:1790771167.288368:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372000/0xfa0c505d97f0fdbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x18618557 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13763 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.288372:0:13770:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15105:x1877759534114048:12345-192.168.204.50@tcp:101:setfattr.0 00010000:00010000:1.0:1790771167.288384:0:13770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.288393:0:13770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fde0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e369d2 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288416:0:13763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373e00/0xfa0c505d97f0fda1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369e0 expref: 122 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288419:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288435:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288456:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288462:0:13763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373200/0xfa0c505d97f0fdcb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369e0 expref: 121 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288468:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288475:0:13763:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xab:0x0].0x0 (ffff8bfc08974100) 00010000:00010000:1.0:1790771167.288478:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288508:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790771167.288508:0:13763:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790771167.288515:0:13763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06373200, rc 0) 00010000:00010000:1.0:1790771167.288531:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288541:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288549:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.288558:0:13763:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_008:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:14589:x1877759534114432:12345-192.168.204.50@tcp:101:chown.0 Request processed in 919us (1074us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.288559:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e57c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.288566:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288574:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.288574:0:13763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6681 00010000:00010000:1.0:1790771167.288588:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.288590:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.288593:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288599:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57c00/0xfa0c505d97f0fde7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288609:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288614:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288619:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288624:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2200 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.288626:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288631:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288638:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xd964d85e (ffff8bfc36078500) 00010000:00010000:1.0:1790771167.288639:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.288642:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288664:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2200/0xfa0c505d97f0fdee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xd964d85e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288694:0:13770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fde0 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369d2 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288707:0:13770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8bfc36079c00) 00010000:00010000:1.0:1790771167.288709:0:13770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.288713:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03e57200/0xfa0c505d97f0fde0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e369d2 expref: 130 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.288724:0:13770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03e57200, rc 0) 00000100:00100000:1.0:1790771167.288747:0:13770:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_015:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:15105:x1877759534114048:12345-192.168.204.50@tcp:101:setfattr.0 Request processed in 378us (515us total) trans 0 rc 301/301 00000100:00100000:1.0:1790771167.288754:0:13770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6684 00000100:00100000:1.0:1790771167.288813:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.288866:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534118528 00000100:00100000:2.0:1790771167.288872:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534118528 00000100:00100000:1.0:1790771167.288887:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.288921:0:13768:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534116352 00000100:00100000:2.0:1790771167.288926:0:13768:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534116352 00000100:00100000:2.0:1790771167.288963:0:13768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6685 00000100:00100000:1.0:1790771167.288973:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:2.0:1790771167.288980:0:13768:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13282:x1877759534118528:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:2.0:1790771167.288995:0:13768:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1790771167.289005:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:2.0:1790771167.289008:0:13768:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0fdf5 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368d6 expref: -99 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289028:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:3.0:1790771167.289056:0:13790:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534117888 00000100:00100000:3.0:1790771167.289063:0:13790:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534117888 00010000:00010000:2.0:1790771167.289067:0:13768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fdfc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289071:0:13771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6686 00000100:00100000:1.0:1790771167.289083:0:13771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:11208:x1877759534116352:12345-192.168.204.50@tcp:101:dir_create.sh.0 00010000:00010000:2.0:1790771167.289085:0:13768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fdfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289094:0:13771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790771167.289095:0:13790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1765 00010000:00010000:2.0:1790771167.289104:0:13768:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fdfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13768 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289108:0:13771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0fe03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e36a26 expref: -99 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.289110:0:13790:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:14747:x1877759534117888:12345-192.168.204.50@tcp:35:file_concat.sh.0 00000100:00100000:0.0:1790771167.289126:0:6496:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb0305dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:13743:x1877759534111872:12345-192.168.204.50@tcp:37:ls.0 Request processed in 5014us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.289144:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1759 00000004:00200000:2.0:1790771167.289146:0:13768:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:1.0:1790771167.289156:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289165:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289175:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289185:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289193:0:13771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289199:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534115968 00010000:00010000:1.0:1790771167.289200:0:13771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289205:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534115968 00010000:00010000:2.0:1790771167.289225:0:13768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373600/0xfa0c505d97f0fdf5 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368d6 expref: 134 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289230:0:13771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 6 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289235:0:7434:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534115584 00000100:00100000:0.0:1790771167.289240:0:7434:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534115584 00000100:00100000:3.0:1790771167.289253:0:13790:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+131:14747:x1877759534117888:12345-192.168.204.50@tcp:35:file_concat.sh.0 Request processed in 145us (221us total) trans 4294968929 rc 0/0 00010000:00010000:0.0:1790771167.289258:0:7434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 131 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289258:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfc3f94dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539793664:0@lo:104: 00010000:00010000:2.0:1790771167.289260:0:13768:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06372200/0xfa0c505d97f0fdfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368d6 expref: 133 pid: 13768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790771167.289276:0:13790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1765 00010000:00010000:2.0:1790771167.289287:0:13768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:2.0:1790771167.289290:0:13768:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790771167.289295:0:13768:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb06372200, rc 0) 00000100:00100000:1.0:1790771167.289303:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.289304:0:7434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1843 00000100:00100000:0.0:1790771167.289316:0:7434:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc085bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+130:2397:x1877759534115584:12345-192.168.204.50@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.289326:0:7434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1790771167.289332:0:13768:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_013:dd3e9fa3-001c-49c2-ab75-41a75fa63682+133:13282:x1877759534118528:12345-192.168.204.50@tcp:101:ls.0 Request processed in 357us (517us total) trans 4294969527 rc 0/0 00010000:00010000:0.0:1790771167.289333:0:7434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 4/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 130 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289351:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790771167.289357:0:13768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6685 00010000:00010000:0.0:1790771167.289358:0:7434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 3/0,0 mode: CR/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 130 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289376:0:7434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb063e1e00/0xfa0c505d97f0de83 lrc: 0/0,0 mode: --/CR res: [0x240000403:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e35de6 expref: 130 pid: 6493 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289378:0:10372:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539793664 00000100:00100000:1.0:1790771167.289384:0:10372:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539793664 00010000:00010000:0.0:1790771167.289394:0:7434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:0.0:1790771167.289399:0:7434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289407:0:7434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.289412:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 927 00010000:00010000:0.0:1790771167.289416:0:7434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 4/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.289427:0:6479:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+121:2397:x1877759534115968:12345-192.168.204.50@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1790771167.289434:0:10372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00010000:00010000:0.0:1790771167.289437:0:7434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790771167.289444:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.289445:0:10372:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0001-mdtlov_UUID+4:13771:x1877759539793664:12345-0@lo:104: 00010000:00010000:1.0:1790771167.289458:0:10372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289463:0:7434:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc085bd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dd3e9fa3-001c-49c2-ab75-41a75fa63682+129:2397:x1877759534115584:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 146us (456us total) trans 0 rc 0/0 00010000:00010000:2.0:1790771167.289466:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06373400/0xfa0c505d97f0fca5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36993 expref: 121 pid: 13773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289505:0:7434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1843 00010000:00010000:0.0:1790771167.289550:0:12128:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289557:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.289578:0:10372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790771167.289585:0:10372:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_004:lustre-MDT0001-mdtlov_UUID+4:13771:x1877759539793664:12345-0@lo:104: Request processed in 144us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.289594:0:10372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790771167.289637:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfc3f94dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000_UUID:13771:1877759539793664:0@lo:104: 00010000:00010000:1.0:1790771167.289671:0:13771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289718:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000004:00200000:0.0:1790771167.289749:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x240000403:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.289760:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,1 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289766:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 2/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289772:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289776:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.289780:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 3/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289785:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 4/0,0 mode: EX/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289794:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000403:0x9:0x0].0x0 (ffff8bfc4205d600) 00010000:00010000:0.0:1790771167.289796:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790771167.289800:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 2/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289804:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56a00/0xfa0c505d97f0fbe8 lrc: 0/0,0 mode: --/EX res: [0x240000403:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289828:0:12128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,1 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289833:0:12128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 2/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289842:0:12128:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289850:0:12128:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb03e56400 already unused, calling callback (ffffffffc18aa4f0) 00000100:00100000:1.0:1790771167.289851:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00010000:00010000:0.0:1790771167.289853:0:12128:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 3/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289860:0:12128:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 4/0,0 mode: CW/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289868:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x0 (ffff8bfb03188c00) 00010000:00010000:0.0:1790771167.289870:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.289873:0:12128:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 2/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289879:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56400/0xfa0c505d97f0fbda lrc: 0/0,0 mode: --/CW res: [0x240000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.289879:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534120192 00010000:00010000:2.0:1790771167.289883:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb0:0x0].0x0 (ffff8bfc19631400) 00000100:00100000:1.0:1790771167.289887:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534120192 00010000:00010000:2.0:1790771167.289892:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:0.0:1790771167.289894:0:12128:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d3d7963 reply state 000000000e8508c4 transno 4294968930 ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289902:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8bfb03e56200/0xfa0c505d97f0fbe1 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x1:0x0].0x1d91fb2c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.289908:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x1:0x0].0x1d91fb2c (ffff8bfc36078a00) 00010000:00010000:0.0:1790771167.289910:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1790771167.289912:0:12128:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790771167.289917:0:6495:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534120448 00000100:00100000:1.0:1790771167.289921:0:6495:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534120448 00000100:00100000:0.0:1790771167.289949:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:82a25f2c-222e-4ba7-abee-8e26bca511e6+45:14395:x1877759534102144:12345-192.168.204.50@tcp:36:rm.0 Request processed in 27360us (27541us total) trans 4294968930 rc 0/0 00000100:00100000:1.0:1790771167.289951:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6687 00000100:00100000:0.0:1790771167.289963:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6657 00000100:00100000:1.0:1790771167.289965:0:6495:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+134:13564:x1877759534120192:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:1.0:1790771167.289975:0:6495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790771167.289986:0:6495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0fe1f lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368dd expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.289994:0:12128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6688 00000100:00100000:0.0:1790771167.290005:0:12128:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+135:13555:x1877759534120448:12345-192.168.204.50@tcp:101:ls.0 00010000:00010000:0.0:1790771167.290013:0:12128:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790771167.290023:0:12128:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fe26 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x61116bf958e368c8 expref: -99 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.290030:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9c00/0xfa0c505d97f0fe2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.290039:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9c00/0xfa0c505d97f0fe2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.290047:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9c00/0xfa0c505d97f0fe2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790771167.290054:0:6495:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00010000:00010000:0.0:1790771167.290067:0:12128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fe34 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290077:0:12128:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fe34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290086:0:12128:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fe34 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12128 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.290089:0:6479:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:2397:x1877759534115968:12345-192.168.204.50@tcp:103:ldlm_bl.0 Request processed in 663us (1113us total) trans 0 rc 0/0 00010000:00010000:1.0:1790771167.290099:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9400/0xfa0c505d97f0fe1f lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368dd expref: 138 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790771167.290101:0:12128:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x3a:0x0]: returning size 4096 00000100:00100000:2.0:1790771167.290110:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 927 00010000:00010000:1.0:1790771167.290127:0:6495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b9c00/0xfa0c505d97f0fe2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368dd expref: 137 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.290133:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:1.0:1790771167.290135:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790771167.290137:0:6495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb048b9c00, rc 0) 00000100:00100000:1.0:1790771167.290158:0:6495:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dd3e9fa3-001c-49c2-ab75-41a75fa63682+138:13564:x1877759534120192:12345-192.168.204.50@tcp:101:ls.0 Request processed in 198us (443us total) trans 4294969528 rc 0/0 00000100:00100000:1.0:1790771167.290164:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6687 00010000:00010000:0.0:1790771167.290170:0:12128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0800/0xfa0c505d97f0fe26 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x26:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368c8 expref: 139 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290188:0:12128:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb03cfc800/0xfa0c505d97f0fe34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3a:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e368c8 expref: 137 pid: 12128 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290195:0:12128:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3a:0x0].0x0 (ffff8bfb03026b00) 00010000:00010000:0.0:1790771167.290197:0:12128:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790771167.290199:0:12128:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb03cfc800, rc 0) 00000100:00100000:0.0:1790771167.290227:0:12128:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:13555:x1877759534120448:12345-192.168.204.50@tcp:101:ls.0 Request processed in 225us (382us total) trans 4294969529 rc 0/0 00000100:00100000:0.0:1790771167.290236:0:12128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6688 00010000:00010000:0.0:1790771167.290262:0:6483:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790771167.290271:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290281:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb05687a00 already unused, calling callback (ffffffffc18b6ee0) 00010000:00010000:0.0:1790771167.290287:0:6483:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.290297:0:6483:0:(mdt_handler.c:3974:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290327:0:6483:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290333:0:6483:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790771167.290360:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.290366:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8bfb05687a00/0xfa0c505d97f0f46a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xfa0c505d97f0f471 expref: -99 pid: 13763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790771167.290370:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539793792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.290382:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.290385:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790771167.290389:0:6483:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790771167.290410:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.290447:0:6481:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539793792 00000100:00100000:0.0:1790771167.290451:0:6481:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539793792 00010000:00010000:0.0:1790771167.290465:0:6481:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790771167.290519:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:0.0:1790771167.290526:0:6481:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:3625:x1877759539793792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790771167.290533:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1790771167.292124:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:1.0:1790771167.292146:0:7771:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534121088 00000100:00100000:1.0:1790771167.292150:0:7771:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534121088 00000100:00100000:1.0:1790771167.292176:0:7771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 6689 00000100:00100000:1.0:1790771167.292184:0:7771:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03ce4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:82a25f2c-222e-4ba7-abee-8e26bca511e6+120:14969:x1877759534121088:12345-192.168.204.50@tcp:36:setfattr.0 00010000:00010000:1.0:1790771167.292213:0:7771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0fe49 lrc: 3/0,1 mode: --/EX res: [0x200000403:0xb0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292221:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b1 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292229:0:7771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e3687b expref: 136 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292234:0:7771:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb048b8800/0xfa0c505d97f0fe49 lrc: 5/0,1 mode: --/EX res: [0x200000403:0xb0:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292256:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3687b expref: 136 pid: 13767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292267:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb063e0a00/0xfa0c505d97f0fc2e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e3687b expref: 136 pid: 13767 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.292277:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539793920:192.168.204.50@tcp:104: 00010000:00010000:1.0:1790771167.292337:0:7771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b1 expref: 120 pid: 13764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.292347:0:7771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0487fa00/0xfa0c505d97f0f2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0xb0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.50@tcp remote: 0x61116bf958e365b1 expref: 120 pid: 13764 timeout: 267 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.292355:0:7771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03ce6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7771:1877759539794048:192.168.204.50@tcp:104: 00000100:00100000:1.0:1790771167.292375:0:7771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfb06bb4480 going to sleep for 11 seconds 00000100:00100000:0.0:1790771167.292736:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.292755:0:13789:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534121472 00000100:00100000:0.0:1790771167.292759:0:13789:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534121472 00002000:00100000:0.0:1790771167.292783:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (638976->643071) req@ffff8bfb03c6ea00 x1877759534121472/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/0 e 0 to 0 dl 1790771178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.292794:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6ea00 with x1877759534121472 ext(638976->643071) 00002000:00010000:0.0:1790771167.292800:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6ea00 00000100:00100000:0.0:1790771167.292830:0:13789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 474 00000100:00100000:0.0:1790771167.292842:0:13789:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759534121472:12345-192.168.204.50@tcp:3:cat.0 00000100:00100000:0.0:1790771167.292957:0:13789:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:82a25f2c-222e-4ba7-abee-8e26bca511e6+22:2396:x1877759534121472:12345-192.168.204.50@tcp:3:cat.0 Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.292966:0:13789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 474 00002000:00100000:0.0:1790771167.292974:0:13789:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000400:0xb:0x0] (638976->643071) req@ffff8bfb03c6ea00 x1877759534121472/t0(0) o3->82a25f2c-222e-4ba7-abee-8e26bca511e6@192.168.204.50@tcp:268/0 lens 488/440 e 0 to 0 dl 1790771178 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790771167.292981:0:13789:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8bfb03c6ea00 with x1877759534121472 ext(638976->643071) 00002000:00010000:0.0:1790771167.292985:0:13789:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8bfb03c6ea00 00000100:00100000:1.0:1790771167.293007:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.50@tcp (source: 12345-192.168.204.50@tcp) 00000100:00100000:0.0:1790771167.293034:0:13780:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759534121984 00000100:00100000:0.0:1790771167.293038:0:13780:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759534121984 00000100:00100000:0.0:1790771167.293075:0:13780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.50@tcp, seq: 1766 00000100:00100000:0.0:1790771167.293086:0:13780:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfc0847dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:15160:x1877759534121984:12345-192.168.204.50@tcp:33:lfs.0 00000004:00200000:0.0:1790771167.293167:0:13780:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000402:0x8:0x0]: returning size 4096 00000004:00200000:0.0:1790771167.293172:0:13780:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:0.0:1790771167.293210:0:13780:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc0847dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:dd3e9fa3-001c-49c2-ab75-41a75fa63682+137:15160:x1877759534121984:12345-192.168.204.50@tcp:33:lfs.0 Request processed in 128us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.293221:0:13780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 1766 00000001:00080000:1.0:1790771167.293798:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969529 is committed 00000001:00080000:1.0:1790771167.293820:0:6473:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294969525 is committed 00010000:00010000:0.0:1790771167.293823:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293831:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293838:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293843:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb0656f600 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.293846:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293852:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293862:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x59:0x0].0x7a94fdef (ffff8bfc36078d00) 00010000:00010000:0.0:1790771167.293865:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.293868:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.293873:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb0656f600/0xfa0c505d97f0fce4 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0x59:0x0].0x7a94fdef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293881:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293894:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293903:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293913:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c82c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.293917:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293923:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293932:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb4:0x0].0x59d92b11 (ffff8bfc20109500) 00010000:00010000:1.0:1790771167.293934:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.293937:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293942:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c82c00/0xfa0c505d97f0fc82 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb4:0x0].0x59d92b11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293957:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293961:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293967:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293971:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04c83e00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:1.0:1790771167.293973:0:3610:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293977:0:3610:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293990:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0xb7:0x0].0x0 (ffff8bfc20109c00) 00010000:00010000:1.0:1790771167.293992:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790771167.293995:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 2/0,0 mode: --/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.293999:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04c83e00/0xfa0c505d97f0fc89 lrc: 0/0,0 mode: --/TXN res: [0x200000403:0xb7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13761 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.294064:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb06592400/0xfa0c505d97f0f471 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xfa0c505d97f0f46a expref: 7 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.294074:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0xa5ec40c9 (ffff8bfc4205de00) 00010000:00010000:1.0:1790771167.294076:0:6481:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.294082:0:6481:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.294086:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790771167.294107:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790771167.294130:0:13771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294139:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790771167.294144:0:6481:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc2d356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1877759539793792:12345-0@lo:103:ldlm_bl.0 Request processed in 3617us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.294160:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1790771167.294187:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3625:1877759539793792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790771167.294239:0:13771:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8bfb03c6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-mdtlov_UUID:13771:1877759539794176:0@lo:1000:mdt00_016.0 00000100:00100000:0.0:1790771167.294274:0:13771:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790771167.294297:0:13771:0:(client.c:2716:ptlrpc_set_wait()) set ffff8bfc2d3249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790771167.294311:0:6499:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877759539794176 00000100:00100000:1.0:1790771167.294315:0:6499:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877759539794176 00000100:00100000:1.0:1790771167.294348:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:1.0:1790771167.294357:0:6499:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13771:x1877759539794176:12345-0@lo:1000:mdt00_016.0 00000100:00100000:1.0:1790771167.294424:0:6499:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfb03c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13771:x1877759539794176:12345-0@lo:1000:mdt00_016.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1790771167.294431:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1790771167.294449:0:13771:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8bfb03c6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_016:lustre-MDT0000-mdtlov_UUID:13771:1877759539794176:0@lo:1000:mdt00_016.0 00010000:00010000:0.0:1790771167.294482:0:13771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fe50 lrc: 3/1,0 mode: --/PR res: [0x240000402:0xb2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294635:0:13771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fe50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294642:0:13771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fe50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790771167.294675:0:13771:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fe50 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0xb2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294688:0:13771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294694:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 4/1,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294699:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294703:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294707:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe2c00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.294710:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294716:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294726:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0x0 (ffff8bfc310f1b00) 00010000:00010000:0.0:1790771167.294728:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.294731:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 3/0,0 mode: --/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294736:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe2c00/0xfa0c505d97f0fe0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294747:0:13771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294751:0:13771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294756:0:13771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294761:0:13771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8bfb04fe3a00 already unused, calling callback (ffffffffc18aa4f0) 00010000:00010000:0.0:1790771167.294764:0:13771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294769:0:13771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294774:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb6:0x0].0xa5ec40c9 (ffff8bfc4205de00) 00010000:00010000:0.0:1790771167.294776:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790771167.294778:0:13771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294784:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3a00/0xfa0c505d97f0fe18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb6:0x0].0xa5ec40c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294815:0:13771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb04fe3000/0xfa0c505d97f0fe03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb6:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36a26 expref: 125 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294830:0:13771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8bfb05686400/0xfa0c505d97f0fe50 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0xb2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.50@tcp remote: 0x61116bf958e36a26 expref: 124 pid: 13771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790771167.294836:0:13771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0xb2:0x0].0x0 (ffff8bfc03c5e900) 00010000:00010000:0.0:1790771167.294839:0:13771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790771167.294841:0:13771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8bfb05686400, rc 0) 00000100:00100000:0.0:1790771167.294872:0:13771:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff8bfc3f94f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_016:dd3e9fa3-001c-49c2-ab75-41a75fa63682+124:11208:x1877759534116352:12345-192.168.204.50@tcp:101:dir_create.sh.0 Request processed in 5790us (5987us total) trans 0 rc 0/0 00000100:00100000:0.0:1790771167.294880:0:13771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.50@tcp, seq: 6686 Debug log: 64121 lines, 64121 kept, 0 dropped, 0 bad.